-- Logs begin at Fri 2022-05-27 08:52:12 UTC, end at Fri 2022-05-27 10:05:25 UTC. -- May 27 09:24:02.863595 dv-cinder-797608-21-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 27 09:24:02.873573 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 27 09:24:02.875639 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 09:24:02 2022] *** May 27 09:24:02.875639 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 09:24:02.875639 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 09:24:02.875639 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: nodename: dv-cinder-797608-21-iscsi May 27 09:24:02.875639 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: machine: x86_64 May 27 09:24:02.875639 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: clock source: unix May 27 09:24:02.875639 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: pcre jit disabled May 27 09:24:02.875639 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: detected number of CPU cores: 4 May 27 09:24:02.875639 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: current working directory: / May 27 09:24:02.875639 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: detected binary path: /usr/bin/uwsgi-core May 27 09:24:02.875639 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: your processes number limit is 47680 May 27 09:24:02.876209 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: your memory page size is 4096 bytes May 27 09:24:02.876209 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: detected max file descriptor number: 2048 May 27 09:24:02.876209 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: lock engine: pthread robust mutexes May 27 09:24:02.876209 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: thunder lock: enabled May 27 09:24:02.876209 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 27 09:24:02.876209 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 09:24:02.920248 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: Python main interpreter initialized at 0x55dd9262c9c0 May 27 09:24:02.920248 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: python threads support enabled May 27 09:24:02.920248 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: your server socket listen backlog is limited to 100 connections May 27 09:24:02.920248 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: your mercy for graceful operations on workers is 90 seconds May 27 09:24:02.920590 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: mapped 403077 bytes (393 KB) for 2 cores May 27 09:24:02.920667 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: *** Operational MODE: preforking *** May 27 09:24:02.920947 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: *** uWSGI is running in multiple interpreter mode *** May 27 09:24:02.920947 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: spawned uWSGI master process (pid: 80077) May 27 09:24:02.921149 dv-cinder-797608-21-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 27 09:24:02.922742 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: spawned uWSGI worker 1 (pid: 80090, cores: 1) May 27 09:24:02.922742 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: spawned uWSGI worker 2 (pid: 80091, cores: 1) May 27 09:24:02.922742 dv-cinder-797608-21-iscsi devstack@keystone.service[80077]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 09:24:08.594769 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:24:08.594769 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: from cryptography.utils import int_from_bytes May 27 09:24:08.595602 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:24:08.595602 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: from cryptography.utils import int_from_bytes May 27 09:24:08.595713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:24:08.595713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: from cryptography.utils import int_from_bytes May 27 09:24:08.596137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:24:08.596137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: from cryptography.utils import int_from_bytes May 27 09:24:08.645253 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 09:24:08.645439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 09:24:08.645634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] command line args: [] {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 09:24:08.645729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 09:24:08.645908 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 09:24:08.646000 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 09:24:08.646132 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ================================================================================ {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 09:24:08.646216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] command line args: [] {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 09:24:08.646342 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] admin_token = **** {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.646424 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 09:24:08.646605 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ================================================================================ {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 09:24:08.647199 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] config_dir = [] {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.647377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.647466 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] admin_token = **** {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.647526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] config_source = [] {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.647758 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] config_dir = [] {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.647841 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] debug = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.647912 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.647975 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.648217 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] config_source = [] {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.648217 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] debug = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.648340 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.649331 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.649331 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.649331 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.649331 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.649847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] list_limit = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.649847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] log_config_append = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.651400 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.651603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.652125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.652486 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] log_dir = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.652486 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] log_file = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.652609 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.652667 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.652667 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.652770 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.652833 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.652833 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.652944 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] list_limit = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.653005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.653068 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] log_config_append = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.653129 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.653129 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.653238 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.653295 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.653351 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] log_dir = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.653406 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.653465 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] log_file = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.653521 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.653521 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.653634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.653690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.653690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.653802 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.653876 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.653940 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.654002 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.654528 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.654528 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.654799 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.41/identity {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.654940 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.655081 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] publish_errors = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.655207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.655375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.655375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.655630 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.655756 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.655879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.656004 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.656138 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.656273 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.656442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.656581 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] standard_threads = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.656713 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.656837 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.656962 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.657099 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.657099 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.657341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.657466 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] use_journal = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.657651 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.657793 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] use_json = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.657793 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] use_stderr = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.657793 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] use_syslog = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.658164 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.41/identity {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.658291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.658422 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] publish_errors = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.658548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.658678 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.658808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.658939 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.658939 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.659185 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.659332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.659520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.660601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.660899 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.662594 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] standard_threads = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.663906 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.664083 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.664243 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.664407 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.664541 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.664682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.664814 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.664944 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] use_journal = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.664944 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] use_json = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.665201 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.665339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] use_stderr = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.665482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.665616 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] use_syslog = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.665744 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.665871 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:24:08.665999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.666205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.666205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.666453 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.666580 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.666707 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.666841 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.666979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.667114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.667242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.667447 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.667447 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.667693 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.667828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.667963 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.668091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.668218 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.668344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.668471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.668609 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.668738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.668864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.668864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.669121 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.669254 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.669391 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.669519 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.669654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.669782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.669909 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.669909 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.670162 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.670296 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.670429 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.670557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.670685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.670827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.670966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.671095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.671222 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.671388 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.671516 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.671652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.671792 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.671919 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.672051 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.672179 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.672305 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.672432 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.672633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.672775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.672909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.673047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.673175 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.673302 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.673439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.673568 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.673694 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.673821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.673947 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.674081 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.674214 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.674343 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.674482 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.674611 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.674738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.674874 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.675001 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.675128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.675255 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.675473 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.675602 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.675744 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.675880 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.676008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.676135 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.676262 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.677520 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.677690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.678348 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.678481 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.678616 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.678750 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.678879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.679015 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.679145 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.679305 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.679441 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.679569 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.679696 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.679845 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.679981 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.680141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.680278 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.680407 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.680535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.680535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.680787 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.680914 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.681041 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.681169 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.681296 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.681431 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.681559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.681703 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.681843 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.681972 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.682106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.682244 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.682383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.682528 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.682665 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.682794 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.682934 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.683073 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.683213 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.683389 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.683531 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.683660 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.683788 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.683917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.684063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.684192 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.684328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.684469 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.684599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.684727 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.684854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.684993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.684993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.685247 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.685388 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.685516 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.685516 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.685767 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.685896 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.686024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.686152 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.686280 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.686409 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.686545 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.686680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.686680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.686981 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.687125 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.687125 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.687501 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.687630 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.687758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.687885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.687885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.688134 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.688262 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.688262 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.688503 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.688630 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.688630 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.688877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.689016 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.689016 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.689259 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.689386 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.689386 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.689635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.689770 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.689898 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.690026 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.690026 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.690266 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.690405 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.690405 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.690668 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.690806 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.690934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.691062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.691189 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.691342 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.691342 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] auth.external = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.691605 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.691734 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.691862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.691989 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.692124 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.692261 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.692390 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.692528 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] auth.password = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.692656 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.692784 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] auth.token = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.692918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.693058 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.693188 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.693315 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.694042 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.694179 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.694314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.694453 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.694583 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.694720 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.694851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.694990 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.695128 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.695321 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.695468 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.695607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] credential.caching = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.695737 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.695866 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.695995 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.696124 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.696254 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.696391 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.696521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.696649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.696823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.696958 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.697097 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.697227 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.697364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] auth.external = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.697500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.697637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.697767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.697905 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.698042 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.698172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.698300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.698429 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] auth.password = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.698558 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.698705 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] auth.token = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.698836 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.698966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.699103 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.699233 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.699442 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.699583 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.699712 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.699840 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.699976 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] federation.caching = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.700107 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.700236 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.700372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.700519 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.700655 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.700785 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.700913 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] credential.caching = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.701042 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.701181 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.701311 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.701440 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.701569 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.701697 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.701825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.701961 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.702092 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.702220 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.702358 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.702486 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.702614 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.702754 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.702883 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.703018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.703153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] identity.caching = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.703309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.703445 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.703653 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.703787 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.703916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.704045 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.704185 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.704314 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.704455 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.704585 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.704719 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.704848 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.704977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.705113 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.705249 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] federation.caching = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.705379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.705508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.705636 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.705770 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.705899 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.706045 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.706174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.706303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.706431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.706558 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.706687 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.706823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.706952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.706952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.707194 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.707375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.707523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.707654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.707793 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.707928 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.708056 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.708184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.708321 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.708452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.708581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] identity.caching = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.708709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.708837 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.708965 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.709108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.709245 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.709378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.709514 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.709658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.709792 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.709934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.710108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.710250 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.710384 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.710526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.710697 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.710841 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.710977 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.711111 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.711244 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.711408 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.711545 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.711701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.711839 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.711973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.712107 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.712241 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.712374 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.712516 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.712653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.712786 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.712920 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.713064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.713200 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.713343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.713490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.713625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.713760 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.713893 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.714027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.714172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.714308 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.714442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.714576 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.714710 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.714844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.714986 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.715121 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.715256 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.715438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.715574 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.715709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.715854 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.715990 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.716124 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.716258 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.716398 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.716534 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.716676 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.716812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.716946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.717079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.user = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.717231 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.717367 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.717509 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.717509 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.717764 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.717899 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.718033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.718167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.718309 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.718445 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.718578 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.718711 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.718844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.718979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.719134 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.719308 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.719452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.719587 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.719722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.719856 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.720002 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.720138 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.720272 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.720406 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.720540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.720674 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.720816 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.720953 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.721097 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.721232 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.721366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.721500 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.721642 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.721784 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.721784 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.722041 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.722175 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.722317 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.722453 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.user = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.722588 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.722722 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.722870 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.723012 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.723160 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.723312 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.723453 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.723587 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.723721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.723855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.724003 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.724140 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.724275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.724409 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.724542 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.724677 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.724831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.724966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.725101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.725235 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.725369 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.725503 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.725645 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.725780 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.725914 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.726048 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.726183 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.726317 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.726459 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.726595 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.726739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.726875 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.727010 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.727143 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.727317 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.727459 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.727594 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] resource.caching = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.727729 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.727863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.727998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.728147 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.728283 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.728419 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.728564 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.728564 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.728819 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.728961 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.729097 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.729231 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.729366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.729501 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.729636 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.729840 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.729980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.730114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.730249 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.730383 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.730530 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] role.caching = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.730675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.730811 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] role.driver = sql {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.730946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.731080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.731215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.731375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.731524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.731661 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.731795 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.731929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.732063 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.732198 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.732340 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.732485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.732621 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] resource.caching = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.732756 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.732756 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.733017 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.733164 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.733299 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.733433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.733569 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.733801 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.733972 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.734125 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.734263 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.734410 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.734545 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.734680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.734815 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.734815 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.735085 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.735219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.735422 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.735559 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] role.caching = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.735706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.735844 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] role.driver = sql {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.735978 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.736364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.736504 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.736650 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.736795 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.736931 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.737066 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.737200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.737334 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.737468 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.737610 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.737747 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.737882 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.738016 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.738150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.738284 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.738437 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.738574 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.738709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.738844 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.738979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.739113 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.739255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.739412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.739559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.739699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.739836 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.739970 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.740113 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.740113 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.740882 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.741017 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] token.caching = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.741151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.741285 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.741428 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.741563 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.741697 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.741831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.741965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.742099 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.742241 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.742377 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.742511 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.742655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.742790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.742923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.743077 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.743214 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.743373 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.743509 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.743643 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.743792 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.743928 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.744063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.744197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.744331 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.744475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.744636 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.744860 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.745030 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.745170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.745304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.745439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.745582 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.745724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.745860 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.745995 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.745995 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] token.caching = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.746253 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] database.connection = **** {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.746401 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.746556 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.746699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.746835 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.746970 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.747104 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.747240 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.747433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.747581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.747717 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.747851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.748004 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.748141 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.748276 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.748433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.748570 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.748570 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.748831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.748965 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.749105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.749105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.749377 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.749513 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.749647 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.749781 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.749915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.750057 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.750193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.750339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.750474 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.750608 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.750742 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.750742 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.751006 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.751140 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.751290 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] database.connection = **** {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.751447 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 09:24:08.751592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.751592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.751592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.751592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.751592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.751592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.751592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.751592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.751592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.752788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.752788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.752788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.752788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.752788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.752788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.752788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.752788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.752788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:24:08.753900 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 09:24:08.764524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.764762 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.764995 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.768805 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.769044 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.769274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.775292 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.777836 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.804216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.804450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.804612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.804843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.857282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.857523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.909139 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.909390 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.909558 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.909703 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.974746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.975001 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.975195 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.975372 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.975534 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.975677 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.975818 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.975956 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.976094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.976240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.976240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.976502 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.999598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.999829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:08.999995 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.000138 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.000277 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.000415 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.000553 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.000699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.000837 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.000977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.001114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.001262 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.001400 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.001400 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.012802 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.013021 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.025363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.025652 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.025855 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.025998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.026138 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.026275 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.026425 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.026571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.026710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.026846 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.026983 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.027119 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.027256 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.027256 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 09:24:09.045252 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.045510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.045663 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 09:24:09.045821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 09:24:09.045988 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.046133 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.046271 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 09:24:09.046409 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 09:24:09.046547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.046684 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.046830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.046967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.047105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.047241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.047431 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.047582 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.058508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.058784 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.059051 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.063306 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.063499 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.063499 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.063499 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.063499 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.067571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.069870 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.071366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.071650 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.071931 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.072212 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.072494 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.072754 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.073131 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.073275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.073415 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.073569 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.073717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.073856 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.073992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.074129 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.074267 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.074414 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.074664 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.074940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.075217 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.075517 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.075794 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.076065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.101244 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.103006 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.103304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.103458 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.104933 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.105217 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.108634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.108874 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.109154 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.110522 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.110804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.111086 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.117337 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.117617 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.119242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.119549 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.122094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.122498 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.122783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.123069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.123367 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.123646 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.123919 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.124182 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.124329 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.124479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.124746 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.125031 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.125313 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.125589 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.125861 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.126131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.142933 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.143220 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.145133 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.145417 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.148187 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.150219 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.151984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.152289 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.154020 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.154330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.157531 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.159671 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.161212 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.163923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.165595 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.165903 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.166190 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.166474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.166762 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.167061 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.167787 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.168092 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.168383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.168678 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.168960 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.169249 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.186970 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.187364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.187561 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.187825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.189192 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.189506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.189886 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.190157 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.196059 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.197808 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.198083 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.198279 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.200039 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.200328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.201197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.201485 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.201768 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.202059 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.202338 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.203465 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.203755 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.204040 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.204322 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.204602 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.216135 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.216434 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.216724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.217004 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.217290 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.217564 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.217852 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.218424 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.218723 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.219007 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.219318 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.219606 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.219884 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.220169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.237001 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.239212 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.240988 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.243115 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.244370 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.245989 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.246494 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.247664 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.247956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.248146 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.248295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.249770 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.250055 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.250348 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.255675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.257323 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.257873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.259528 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.261793 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.262088 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.262371 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.262650 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.262784 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.263076 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.263389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.263678 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.272826 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.273027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.273210 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.273359 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.273523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.273667 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.281455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.281601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 09:24:09.281740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.282015 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.282113 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.282286 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.282367 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.282559 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.282643 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.282833 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.282912 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.283107 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.283198 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.283406 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.283699 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.283974 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.284253 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.284413 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.284596 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.284741 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.284881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.285029 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.285171 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.285309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.285448 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.285585 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.285724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.285919 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 09:24:09.325697 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55dd9262c9c0 pid: 80090 (default app) May 27 09:24:09.326637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55dd9262c9c0 pid: 80091 (default app) May 27 09:24:09.329093 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2078e-8b25-42ad-935c-4555f6518e90 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:09.329393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2078e-8b25-42ad-935c-4555f6518e90 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:09.329675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2078e-8b25-42ad-935c-4555f6518e90 None None] PATH_INFO: `/v3` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:09.333852 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1/1] 10.222.0.41 () {50 vars in 791 bytes} [Fri May 27 09:24:09 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:17.248401 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61c00b-ef88-4b25-acc7-ca59bfeb4e40 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:17.248949 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61c00b-ef88-4b25-acc7-ca59bfeb4e40 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:17.248949 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61c00b-ef88-4b25-acc7-ca59bfeb4e40 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:17.253289 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1/2] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:24:17.258481 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb964b1-de5b-41b8-a5d7-d5a563cd5631 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:17.258898 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb964b1-de5b-41b8-a5d7-d5a563cd5631 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:17.259052 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb964b1-de5b-41b8-a5d7-d5a563cd5631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:17.326032 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: INFO dbcounter [None req-deb964b1-de5b-41b8-a5d7-d5a563cd5631 None None] Registered counter for database keystone May 27 09:24:17.348833 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG oslo_db.sqlalchemy.engines [None req-deb964b1-de5b-41b8-a5d7-d5a563cd5631 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80090) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:24:17.355164 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writer thread running {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:24:17.530846 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG passlib.handlers.bcrypt [None req-deb964b1-de5b-41b8-a5d7-d5a563cd5631 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80090) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 27 09:24:17.531256 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG passlib.handlers.bcrypt [None req-deb964b1-de5b-41b8-a5d7-d5a563cd5631 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80090) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 27 09:24:17.586523 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-deb964b1-de5b-41b8-a5d7-d5a563cd5631 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:17.588125 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-deb964b1-de5b-41b8-a5d7-d5a563cd5631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:17.710942 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 2/3] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 27 09:24:17.911920 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61c00b-ef88-4b25-acc7-ca59bfeb4e40 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:17.983144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: INFO dbcounter [None req-aa61c00b-ef88-4b25-acc7-ca59bfeb4e40 None None] Registered counter for database keystone May 27 09:24:18.002960 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG oslo_db.sqlalchemy.engines [None req-aa61c00b-ef88-4b25-acc7-ca59bfeb4e40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80091) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:24:18.009746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writer thread running {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:24:18.130083 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61c00b-ef88-4b25-acc7-ca59bfeb4e40 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:18.134827 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c567c-40dc-4348-98ac-90032d3c597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:18.135521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c567c-40dc-4348-98ac-90032d3c597a admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:18.135805 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c567c-40dc-4348-98ac-90032d3c597a admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:18.136078 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c567c-40dc-4348-98ac-90032d3c597a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:18.144261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c567c-40dc-4348-98ac-90032d3c597a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:18.195708 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: WARNING keystone.common.rbac_enforcer.enforcer [None req-939c567c-40dc-4348-98ac-90032d3c597a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 27 09:24:18.195996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c567c-40dc-4348-98ac-90032d3c597a admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:18.205292 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 2/4] 10.222.0.41 () {58 vars in 1324 bytes} [Fri May 27 09:24:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:24:18.211877 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb964b1-de5b-41b8-a5d7-d5a563cd5631 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:18.226285 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb964b1-de5b-41b8-a5d7-d5a563cd5631 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:18.230606 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57831940-9c53-4ded-bfe1-49685959f47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:18.231833 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57831940-9c53-4ded-bfe1-49685959f47c admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:18.232125 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57831940-9c53-4ded-bfe1-49685959f47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:18.232412 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57831940-9c53-4ded-bfe1-49685959f47c admin admin] PATH_INFO: `/v3/projects/ad2dfb9d6b014e38a0011fb0eee6eae7` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:18.233932 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57831940-9c53-4ded-bfe1-49685959f47c admin admin] RBAC: Authorizing `identity:get_project(project_id=ad2dfb9d6b014e38a0011fb0eee6eae7)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:18.287469 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: WARNING keystone.common.rbac_enforcer.enforcer [None req-57831940-9c53-4ded-bfe1-49685959f47c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 27 09:24:18.288027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57831940-9c53-4ded-bfe1-49685959f47c admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:18.292365 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 3/5] 10.222.0.41 () {56 vars in 1207 bytes} [Fri May 27 09:24:18 2022] GET /identity/v3/projects/ad2dfb9d6b014e38a0011fb0eee6eae7 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:20.454280 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a20542-fd8e-44bc-8c00-7183f3714263 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:20.454764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a20542-fd8e-44bc-8c00-7183f3714263 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:20.454764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a20542-fd8e-44bc-8c00-7183f3714263 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:20.458834 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 3/6] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:24:20.464334 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07500330-27a9-4e18-afbe-b6918fc06641 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:20.464738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07500330-27a9-4e18-afbe-b6918fc06641 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:20.464900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07500330-27a9-4e18-afbe-b6918fc06641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:20.483715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-07500330-27a9-4e18-afbe-b6918fc06641 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:20.485204 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-07500330-27a9-4e18-afbe-b6918fc06641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:20.493668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 4/7] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 27 09:24:20.515434 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a20542-fd8e-44bc-8c00-7183f3714263 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:20.527203 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a20542-fd8e-44bc-8c00-7183f3714263 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:20.531519 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e324dc-8ac4-4acf-9cb9-d3149314b5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:20.532150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e324dc-8ac4-4acf-9cb9-d3149314b5bf admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:20.532438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e324dc-8ac4-4acf-9cb9-d3149314b5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:20.532720 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e324dc-8ac4-4acf-9cb9-d3149314b5bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:20.540861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e324dc-8ac4-4acf-9cb9-d3149314b5bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:20.542642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e324dc-8ac4-4acf-9cb9-d3149314b5bf admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:20.551212 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 4/8] 10.222.0.41 () {58 vars in 1324 bytes} [Fri May 27 09:24:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:24:20.556879 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07500330-27a9-4e18-afbe-b6918fc06641 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:20.565560 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07500330-27a9-4e18-afbe-b6918fc06641 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:20.569884 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b662b4a-33f9-4332-806e-b7dfd10ef21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:20.570732 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b662b4a-33f9-4332-806e-b7dfd10ef21c admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:20.571018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b662b4a-33f9-4332-806e-b7dfd10ef21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:20.571316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b662b4a-33f9-4332-806e-b7dfd10ef21c admin admin] PATH_INFO: `/v3/users/0745bfc9958247ec85586308336b6dda` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:20.572689 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b662b4a-33f9-4332-806e-b7dfd10ef21c admin admin] RBAC: Authorizing `identity:get_user(user_id=0745bfc9958247ec85586308336b6dda)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:20.574494 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b662b4a-33f9-4332-806e-b7dfd10ef21c admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:20.576057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 5/9] 10.222.0.41 () {56 vars in 1198 bytes} [Fri May 27 09:24:20 2022] GET /identity/v3/users/0745bfc9958247ec85586308336b6dda => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:22.852529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f4192-af4e-4c87-ae10-2bb50ccbdae7 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:22.853068 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f4192-af4e-4c87-ae10-2bb50ccbdae7 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:22.853068 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f4192-af4e-4c87-ae10-2bb50ccbdae7 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:22.854426 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 5/10] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:22.859648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af92568-98ee-431e-af55-787618cf41e2 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:22.860071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af92568-98ee-431e-af55-787618cf41e2 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:22.860214 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af92568-98ee-431e-af55-787618cf41e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:22.868350 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cf11d-a68b-469a-a998-0f2ad5c4ff6a None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:22.868637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cf11d-a68b-469a-a998-0f2ad5c4ff6a None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:22.868917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cf11d-a68b-469a-a998-0f2ad5c4ff6a None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:22.870203 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 6/11] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:24:22.875235 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081e91d-70ac-42f6-970b-7b3ad155b05d None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:22.875555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081e91d-70ac-42f6-970b-7b3ad155b05d None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:22.875839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081e91d-70ac-42f6-970b-7b3ad155b05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:22.877243 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-2af92568-98ee-431e-af55-787618cf41e2 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:22.878432 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-2af92568-98ee-431e-af55-787618cf41e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:22.915966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG passlib.handlers.bcrypt [None req-2081e91d-70ac-42f6-970b-7b3ad155b05d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80091) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 27 09:24:22.916402 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG passlib.handlers.bcrypt [None req-2081e91d-70ac-42f6-970b-7b3ad155b05d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80091) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 27 09:24:22.957696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 6/12] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:22.963286 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-2081e91d-70ac-42f6-970b-7b3ad155b05d None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:22.964880 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-2081e91d-70ac-42f6-970b-7b3ad155b05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:22.980516 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af92568-98ee-431e-af55-787618cf41e2 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:23.004085 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:23.064288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 7/13] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:24:23.084619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af92568-98ee-431e-af55-787618cf41e2 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:23.086783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081e91d-70ac-42f6-970b-7b3ad155b05d None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:23.118202 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c5f05-1284-495b-b2c2-b85f29dc9edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:23.118922 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c5f05-1284-495b-b2c2-b85f29dc9edc None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:23.119205 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c5f05-1284-495b-b2c2-b85f29dc9edc None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:23.119510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c5f05-1284-495b-b2c2-b85f29dc9edc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:23.130275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c5f05-1284-495b-b2c2-b85f29dc9edc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:23.142022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-387c5f05-1284-495b-b2c2-b85f29dc9edc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:23.142022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:23.142022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:23.142022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:23.142022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:23.142022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:23.142022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:23.142022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:23.142022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:23.142022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:23.142022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:23.142022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:23.142022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:23.142022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:23.142022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:23.142022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:23.143050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:23.143050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:23.143050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:23.143050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:23.143050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:23.143050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:23.143050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:23.143050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:23.143050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:23.143050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:23.143050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:23.143050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:24:23.143050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:23.143050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:23.143050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:23.143050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:23.144393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:23.144393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:23.144393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:23.144393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:23.144393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:23.144393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:23.144393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:23.144393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:23.144393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:23.144393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:23.144393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:23.144393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:24:23.144393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 7/14] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:24:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:23.148871 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c5f05-1284-495b-b2c2-b85f29dc9edc None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:23.301981 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081e91d-70ac-42f6-970b-7b3ad155b05d None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:23.305166 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:23.344034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90f0a2-c1a1-40ef-a1c2-620de59c2bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:23.344943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90f0a2-c1a1-40ef-a1c2-620de59c2bfb None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:23.345235 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90f0a2-c1a1-40ef-a1c2-620de59c2bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:23.345482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:23.345592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90f0a2-c1a1-40ef-a1c2-620de59c2bfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:23.366672 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c5f05-1284-495b-b2c2-b85f29dc9edc None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:23.401025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e68ad-1d91-49f3-b2cc-77d80b09dd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:23.401619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e68ad-1d91-49f3-b2cc-77d80b09dd89 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:23.401894 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e68ad-1d91-49f3-b2cc-77d80b09dd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:23.402169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e68ad-1d91-49f3-b2cc-77d80b09dd89 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:23.402910 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e68ad-1d91-49f3-b2cc-77d80b09dd89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:23.403215 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e68ad-1d91-49f3-b2cc-77d80b09dd89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:23.404637 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e68ad-1d91-49f3-b2cc-77d80b09dd89 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:23.414949 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90f0a2-c1a1-40ef-a1c2-620de59c2bfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:23.416493 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90f0a2-c1a1-40ef-a1c2-620de59c2bfb None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:23.416907 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 8/15] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:24:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:23.422328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e68ad-1d91-49f3-b2cc-77d80b09dd89 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:23.514318 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 8/16] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:24:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 09:24:23.519226 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e68ad-1d91-49f3-b2cc-77d80b09dd89 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:23.519768 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90f0a2-c1a1-40ef-a1c2-620de59c2bfb None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:23.523058 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:23.553680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe5528-7388-4a4d-bfae-b6fbd54fa05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:23.554548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe5528-7388-4a4d-bfae-b6fbd54fa05c None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:23.554828 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe5528-7388-4a4d-bfae-b6fbd54fa05c None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:23.555098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe5528-7388-4a4d-bfae-b6fbd54fa05c None admin] PATH_INFO: `/v3/users/0745bfc9958247ec85586308336b6dda` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:23.556331 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe5528-7388-4a4d-bfae-b6fbd54fa05c None admin] RBAC: Authorizing `identity:get_user(user_id=0745bfc9958247ec85586308336b6dda)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:23.557792 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe5528-7388-4a4d-bfae-b6fbd54fa05c None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:23.559418 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 9/17] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:24:23 2022] GET /identity/v3/users/0745bfc9958247ec85586308336b6dda => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:23.564573 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe5528-7388-4a4d-bfae-b6fbd54fa05c None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:23.578751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:23.619497 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90f0a2-c1a1-40ef-a1c2-620de59c2bfb None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:23.652091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534597e-129e-4912-adb1-2ec2cfa3637f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:23.652816 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534597e-129e-4912-adb1-2ec2cfa3637f None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:23.653101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534597e-129e-4912-adb1-2ec2cfa3637f None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:23.653379 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534597e-129e-4912-adb1-2ec2cfa3637f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:23.662853 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe5528-7388-4a4d-bfae-b6fbd54fa05c None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:23.674546 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d534597e-129e-4912-adb1-2ec2cfa3637f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:23.676057 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d534597e-129e-4912-adb1-2ec2cfa3637f None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:23.697818 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-d534597e-129e-4912-adb1-2ec2cfa3637f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:23.697818 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:23.697818 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:23.697818 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:23.697818 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:23.697818 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:23.697818 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:23.697818 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:23.697818 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:23.697818 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:23.697818 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:23.697818 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:23.697818 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:24:23.697818 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:24:23.697818 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:24:23.698685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:24:23.698685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:23.698685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:23.698685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:23.698685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:23.698685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:23.698685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:23.698685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:23.698685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:24:23.698685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:23.698685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:23.698685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:23.698685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:23.698685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:23.698685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:23.698685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:23.698685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:23.699622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:24:23.699622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:24:23.699622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:23.699622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:24:23.699622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 9/18] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:23.704904 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534597e-129e-4912-adb1-2ec2cfa3637f None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:23.707348 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4802d3-a0a8-44bb-a54a-77eade675364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:23.709812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4802d3-a0a8-44bb-a54a-77eade675364 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:23.710511 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4802d3-a0a8-44bb-a54a-77eade675364 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:23.710791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4802d3-a0a8-44bb-a54a-77eade675364 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:23.712027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4802d3-a0a8-44bb-a54a-77eade675364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:23.714307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4802d3-a0a8-44bb-a54a-77eade675364 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:23.717469 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 10/19] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:24:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:23.723798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4802d3-a0a8-44bb-a54a-77eade675364 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:23.763318 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:23.804481 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:23.807120 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534597e-129e-4912-adb1-2ec2cfa3637f None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:23.825552 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4802d3-a0a8-44bb-a54a-77eade675364 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:23.841188 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb84590-5bb5-4f39-b252-22db3ddfa1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:23.841858 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb84590-5bb5-4f39-b252-22db3ddfa1ba None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:23.842145 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb84590-5bb5-4f39-b252-22db3ddfa1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:23.842424 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb84590-5bb5-4f39-b252-22db3ddfa1ba None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:23.843146 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb84590-5bb5-4f39-b252-22db3ddfa1ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:23.843485 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb84590-5bb5-4f39-b252-22db3ddfa1ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:23.844871 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb84590-5bb5-4f39-b252-22db3ddfa1ba None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:23.860475 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753e8c5-2f1e-4761-b77c-f387392e3431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:23.861394 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753e8c5-2f1e-4761-b77c-f387392e3431 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:23.861686 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753e8c5-2f1e-4761-b77c-f387392e3431 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:23.861965 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753e8c5-2f1e-4761-b77c-f387392e3431 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:23.862801 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753e8c5-2f1e-4761-b77c-f387392e3431 None admin] RBAC: Adding query filter params (role.id=bb6c5483d9be4a16ac64750536c5e2e2, scope.domain.id=default, user.id=0745bfc9958247ec85586308336b6dda) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:23.863125 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753e8c5-2f1e-4761-b77c-f387392e3431 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:23.864562 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 10/20] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:23.865108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753e8c5-2f1e-4761-b77c-f387392e3431 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:23.871887 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 11/21] 10.222.0.41 () {56 vars in 1322 bytes} [Fri May 27 09:24:23 2022] GET /identity/v3/role_assignments?user.id=0745bfc9958247ec85586308336b6dda&scope.domain.id=default&role.id=bb6c5483d9be4a16ac64750536c5e2e2 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:26.665574 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064f1c8-6a63-42b4-bacd-816764c4d622 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:26.666114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064f1c8-6a63-42b4-bacd-816764c4d622 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:26.666114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064f1c8-6a63-42b4-bacd-816764c4d622 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:26.667825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 11/22] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:26.673197 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ac7c3-4109-4475-b5ea-bec7dc9133f8 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:26.674112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ac7c3-4109-4475-b5ea-bec7dc9133f8 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:26.674618 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ac7c3-4109-4475-b5ea-bec7dc9133f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:26.694098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-793ac7c3-4109-4475-b5ea-bec7dc9133f8 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:26.695440 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-793ac7c3-4109-4475-b5ea-bec7dc9133f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:26.776731 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7d2dc-69ea-406c-9133-f043a2a78396 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:26.777386 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7d2dc-69ea-406c-9133-f043a2a78396 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:26.777877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7d2dc-69ea-406c-9133-f043a2a78396 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:26.783605 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 12/23] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:24:26.790644 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7022f-4a62-4cbb-9fb1-5e64e5837106 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:26.791264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7022f-4a62-4cbb-9fb1-5e64e5837106 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:26.791782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7022f-4a62-4cbb-9fb1-5e64e5837106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:26.800731 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 12/24] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:26.824318 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-65d7022f-4a62-4cbb-9fb1-5e64e5837106 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:26.825868 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-65d7022f-4a62-4cbb-9fb1-5e64e5837106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:26.835312 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ac7c3-4109-4475-b5ea-bec7dc9133f8 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:26.933772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 13/25] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:24:26.976954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d7022f-4a62-4cbb-9fb1-5e64e5837106 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:27.036231 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ac7c3-4109-4475-b5ea-bec7dc9133f8 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:27.045453 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:27.070089 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:27.079641 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cdf97-e572-479e-b82f-970fafdf53b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:27.080560 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cdf97-e572-479e-b82f-970fafdf53b7 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:27.080844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cdf97-e572-479e-b82f-970fafdf53b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:27.081234 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cdf97-e572-479e-b82f-970fafdf53b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:27.092388 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cdf97-e572-479e-b82f-970fafdf53b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:27.100923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-df0cdf97-e572-479e-b82f-970fafdf53b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:27.100923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:27.100923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:27.100923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:27.100923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:27.100923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:27.100923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:27.100923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:27.100923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:27.100923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:27.100923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:27.100923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:27.100923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:27.100923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:27.100923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:27.100923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:27.101940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:27.101940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:27.101940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:27.101940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:27.101940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:27.101940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:27.101940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:27.101940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:27.101940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:27.101940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:27.101940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:27.101940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:24:27.101940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:27.101940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:27.101940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:27.101940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:27.102709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:27.102709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:27.102709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:27.102709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:27.102709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:27.102709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:27.102709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:27.102709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:27.102709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:27.102709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:27.102709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:27.102709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:24:27.102709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 13/26] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:24:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:27.103588 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fb1db-0edb-4717-a2e6-8f871b7249db None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:27.103785 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fb1db-0edb-4717-a2e6-8f871b7249db None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:27.104013 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fb1db-0edb-4717-a2e6-8f871b7249db None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:27.107297 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 14/27] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:27.107297 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0353e-c8e8-48e7-8377-a55456f1dd0a None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:27.107297 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0353e-c8e8-48e7-8377-a55456f1dd0a None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:27.107297 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0353e-c8e8-48e7-8377-a55456f1dd0a None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:27.108026 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 15/28] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:27.110266 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0353e-c8e8-48e7-8377-a55456f1dd0a None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:27.140785 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d7022f-4a62-4cbb-9fb1-5e64e5837106 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:27.188613 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2efd3f-94fa-421b-a050-70a33c668604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:27.189485 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2efd3f-94fa-421b-a050-70a33c668604 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:27.189887 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2efd3f-94fa-421b-a050-70a33c668604 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:27.190175 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2efd3f-94fa-421b-a050-70a33c668604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:27.203592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2efd3f-94fa-421b-a050-70a33c668604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:27.205832 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2efd3f-94fa-421b-a050-70a33c668604 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:27.226563 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0353e-c8e8-48e7-8377-a55456f1dd0a None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:27.230850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-aa2efd3f-94fa-421b-a050-70a33c668604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:27.230850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:27.230850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:27.230850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:27.230850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:27.230850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:27.230850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:27.230850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:27.230850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:27.230850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:27.230850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:27.230850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:27.230850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:24:27.230850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:24:27.230850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:24:27.231915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:24:27.231915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:27.231915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:27.231915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:27.231915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:27.231915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:27.231915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:27.231915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:27.231915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:24:27.231915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:27.231915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:27.231915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:27.231915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:27.231915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:27.231915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:27.231915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:27.231915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:27.232715 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:24:27.232715 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:24:27.232715 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:24:27.232715 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:24:27.235472 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 14/29] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:27.236927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6346025-d9ed-47b8-8720-e12fb7346352 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:27.237214 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6346025-d9ed-47b8-8720-e12fb7346352 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:27.237490 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6346025-d9ed-47b8-8720-e12fb7346352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:27.261855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-a6346025-d9ed-47b8-8720-e12fb7346352 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:27.263973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-a6346025-d9ed-47b8-8720-e12fb7346352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:27.268590 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c32b28-bf1e-41f5-9f4b-474714ace326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:27.269261 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c32b28-bf1e-41f5-9f4b-474714ace326 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:27.269545 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c32b28-bf1e-41f5-9f4b-474714ace326 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:27.269822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c32b28-bf1e-41f5-9f4b-474714ace326 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:27.270573 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c32b28-bf1e-41f5-9f4b-474714ace326 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:27.270880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c32b28-bf1e-41f5-9f4b-474714ace326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:27.272888 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c32b28-bf1e-41f5-9f4b-474714ace326 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:27.274513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:27.286410 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 16/30] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:24:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:27.288249 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ce038-ec28-4c94-aab1-082150e074d0 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:27.288538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ce038-ec28-4c94-aab1-082150e074d0 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:27.288815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ce038-ec28-4c94-aab1-082150e074d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:27.309942 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-202ce038-ec28-4c94-aab1-082150e074d0 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:27.311142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-202ce038-ec28-4c94-aab1-082150e074d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:27.351562 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 15/31] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:27.352505 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6346025-d9ed-47b8-8720-e12fb7346352 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:27.400341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:27.406552 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 17/32] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:27.407508 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ce038-ec28-4c94-aab1-082150e074d0 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:27.517966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6346025-d9ed-47b8-8720-e12fb7346352 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:27.537645 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ce038-ec28-4c94-aab1-082150e074d0 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:27.563125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef46168-ee66-425f-8cc8-9517ccd8bbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:27.564079 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef46168-ee66-425f-8cc8-9517ccd8bbdd None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:27.564487 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef46168-ee66-425f-8cc8-9517ccd8bbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:27.564778 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef46168-ee66-425f-8cc8-9517ccd8bbdd None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:27.565760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef46168-ee66-425f-8cc8-9517ccd8bbdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:27.566076 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef46168-ee66-425f-8cc8-9517ccd8bbdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:27.568286 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef46168-ee66-425f-8cc8-9517ccd8bbdd None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:27.569343 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:27.581805 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aff915-8063-449a-9077-9562ca4de1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:27.583189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aff915-8063-449a-9077-9562ca4de1ae None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:27.584138 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aff915-8063-449a-9077-9562ca4de1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:27.584556 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aff915-8063-449a-9077-9562ca4de1ae None admin] PATH_INFO: `/v3/users/0745bfc9958247ec85586308336b6dda` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:27.586560 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aff915-8063-449a-9077-9562ca4de1ae None admin] RBAC: Authorizing `identity:get_user(user_id=0745bfc9958247ec85586308336b6dda)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:27.588209 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aff915-8063-449a-9077-9562ca4de1ae None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:27.589561 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 16/33] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:27.590435 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 18/34] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:24:27 2022] GET /identity/v3/users/0745bfc9958247ec85586308336b6dda => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:27.590543 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef46168-ee66-425f-8cc8-9517ccd8bbdd None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:27.591417 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aff915-8063-449a-9077-9562ca4de1ae None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:27.701645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:27.719101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef46168-ee66-425f-8cc8-9517ccd8bbdd None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:27.723202 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aff915-8063-449a-9077-9562ca4de1ae None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:27.765644 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd9d46-5cda-4bb2-be98-e6efd8deb5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:27.766320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd9d46-5cda-4bb2-be98-e6efd8deb5f1 None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:27.766612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd9d46-5cda-4bb2-be98-e6efd8deb5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:27.766873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd9d46-5cda-4bb2-be98-e6efd8deb5f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:27.767715 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd9d46-5cda-4bb2-be98-e6efd8deb5f1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:27.769943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd9d46-5cda-4bb2-be98-e6efd8deb5f1 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:27.777519 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cf52e-877a-4218-8b83-4f024b485479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:27.778224 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cf52e-877a-4218-8b83-4f024b485479 None admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:27.778507 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cf52e-877a-4218-8b83-4f024b485479 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:27.778836 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cf52e-877a-4218-8b83-4f024b485479 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:27.779680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cf52e-877a-4218-8b83-4f024b485479 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:27.781095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cf52e-877a-4218-8b83-4f024b485479 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:27.895059 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 17/35] 10.222.0.41 () {60 vars in 1131 bytes} [Fri May 27 09:24:27 2022] POST /identity/v3/roles => generated 219 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:24:27.896951 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd9d46-5cda-4bb2-be98-e6efd8deb5f1 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:27.923446 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 19/36] 10.222.0.41 () {60 vars in 1131 bytes} [Fri May 27 09:24:27 2022] POST /identity/v3/roles => generated 225 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:24:27.923446 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cf52e-877a-4218-8b83-4f024b485479 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:27.996868 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:28.048256 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd9d46-5cda-4bb2-be98-e6efd8deb5f1 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:28.048449 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cf52e-877a-4218-8b83-4f024b485479 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:28.089846 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13005cf7-155f-4609-92e8-d81f056317e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:28.091052 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13005cf7-155f-4609-92e8-d81f056317e7 None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:28.091528 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13005cf7-155f-4609-92e8-d81f056317e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:28.091803 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e3a82-186a-4442-8310-161b76221aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:28.091918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13005cf7-155f-4609-92e8-d81f056317e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:28.092629 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e3a82-186a-4442-8310-161b76221aef None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:28.092806 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13005cf7-155f-4609-92e8-d81f056317e7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:28.092950 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e3a82-186a-4442-8310-161b76221aef None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:28.093197 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e3a82-186a-4442-8310-161b76221aef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:28.094543 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13005cf7-155f-4609-92e8-d81f056317e7 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:28.094649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e3a82-186a-4442-8310-161b76221aef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:28.096223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e3a82-186a-4442-8310-161b76221aef None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:28.097945 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 20/37] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:24:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:28.099382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfa1b4-4efd-485b-a224-1c7ea3f05d31 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:28.099680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfa1b4-4efd-485b-a224-1c7ea3f05d31 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:28.099965 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfa1b4-4efd-485b-a224-1c7ea3f05d31 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:28.101234 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 21/38] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:28.102331 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fe8a0-7c6d-494e-a919-fee763fc2642 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:28.102627 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fe8a0-7c6d-494e-a919-fee763fc2642 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:28.102911 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fe8a0-7c6d-494e-a919-fee763fc2642 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:28.104399 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 22/39] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:28.110226 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb917f0d-a758-4f80-9252-a481f25e4626 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:28.110522 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb917f0d-a758-4f80-9252-a481f25e4626 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:28.110805 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb917f0d-a758-4f80-9252-a481f25e4626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:28.126634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:28.131949 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-fb917f0d-a758-4f80-9252-a481f25e4626 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:28.133541 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-fb917f0d-a758-4f80-9252-a481f25e4626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:28.134749 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 18/40] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 09:24:27 2022] POST /identity/v3/projects => generated 301 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:24:28.140924 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1a4de-88dd-43a7-a2a0-11761f6b83b0 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:28.141214 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1a4de-88dd-43a7-a2a0-11761f6b83b0 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:28.141565 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1a4de-88dd-43a7-a2a0-11761f6b83b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:28.162223 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-34f1a4de-88dd-43a7-a2a0-11761f6b83b0 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:28.164805 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-34f1a4de-88dd-43a7-a2a0-11761f6b83b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:28.225965 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 23/41] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:28.227179 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb917f0d-a758-4f80-9252-a481f25e4626 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:28.256969 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 19/42] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:28.257929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1a4de-88dd-43a7-a2a0-11761f6b83b0 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:28.301626 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:28.356266 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb917f0d-a758-4f80-9252-a481f25e4626 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:28.379149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1a4de-88dd-43a7-a2a0-11761f6b83b0 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:28.399320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758db7c-89da-497a-bf1a-444388d638e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:28.399320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758db7c-89da-497a-bf1a-444388d638e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:28.399320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758db7c-89da-497a-bf1a-444388d638e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:28.399320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758db7c-89da-497a-bf1a-444388d638e9 None admin] PATH_INFO: `/v3/domains/default/users/0745bfc9958247ec85586308336b6dda/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:28.401567 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758db7c-89da-497a-bf1a-444388d638e9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0745bfc9958247ec85586308336b6dda, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:28.403376 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758db7c-89da-497a-bf1a-444388d638e9 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:28.413361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:28.420639 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d03d9a-5852-48ed-8f1d-157c2fd74c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:28.421353 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d03d9a-5852-48ed-8f1d-157c2fd74c44 None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:28.421642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d03d9a-5852-48ed-8f1d-157c2fd74c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:28.421921 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d03d9a-5852-48ed-8f1d-157c2fd74c44 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:28.424391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d03d9a-5852-48ed-8f1d-157c2fd74c44 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:28.424503 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 24/43] 10.222.0.41 () {58 vars in 1361 bytes} [Fri May 27 09:24:28 2022] PUT /identity/v3/domains/default/users/0745bfc9958247ec85586308336b6dda/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:24:28.424503 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758db7c-89da-497a-bf1a-444388d638e9 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:28.424649 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d03d9a-5852-48ed-8f1d-157c2fd74c44 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:28.441372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 20/44] 10.222.0.41 () {60 vars in 1131 bytes} [Fri May 27 09:24:28 2022] POST /identity/v3/roles => generated 223 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:24:28.554618 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758db7c-89da-497a-bf1a-444388d638e9 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:28.571351 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:28.598225 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdcccf-33a2-4333-8287-2e5ec2955661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:28.599986 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdcccf-33a2-4333-8287-2e5ec2955661 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:28.600478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdcccf-33a2-4333-8287-2e5ec2955661 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:28.600990 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdcccf-33a2-4333-8287-2e5ec2955661 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:28.602587 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdcccf-33a2-4333-8287-2e5ec2955661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:28.604567 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdcccf-33a2-4333-8287-2e5ec2955661 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:28.606588 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 25/45] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:24:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:28.612669 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d03d9a-5852-48ed-8f1d-157c2fd74c44 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:28.718379 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d03d9a-5852-48ed-8f1d-157c2fd74c44 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:28.753793 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42947a2f-6fc0-482b-bb8d-4461bf5790cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:28.754462 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42947a2f-6fc0-482b-bb8d-4461bf5790cc None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:28.754749 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42947a2f-6fc0-482b-bb8d-4461bf5790cc None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:28.755030 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42947a2f-6fc0-482b-bb8d-4461bf5790cc None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:28.755797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42947a2f-6fc0-482b-bb8d-4461bf5790cc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:28.757245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42947a2f-6fc0-482b-bb8d-4461bf5790cc None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:28.782749 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 21/46] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 09:24:28 2022] POST /identity/v3/projects => generated 312 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:24:30.650284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97813d7-38bc-4bf6-b514-363cb42e12ef None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:30.650795 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97813d7-38bc-4bf6-b514-363cb42e12ef None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:30.650930 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97813d7-38bc-4bf6-b514-363cb42e12ef None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:30.652338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 26/47] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:30.657537 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5dc03-d220-4b28-a5f3-35fdac478378 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:30.657959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5dc03-d220-4b28-a5f3-35fdac478378 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:30.658098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5dc03-d220-4b28-a5f3-35fdac478378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:30.674913 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-fbc5dc03-d220-4b28-a5f3-35fdac478378 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:30.676110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-fbc5dc03-d220-4b28-a5f3-35fdac478378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:30.709720 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:30.746833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 22/48] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:24:30.778760 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97813d7-38bc-4bf6-b514-363cb42e12ef None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:30.883960 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97813d7-38bc-4bf6-b514-363cb42e12ef None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:30.916224 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79cc07-24a1-4631-8490-254f39cc354f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:30.916956 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79cc07-24a1-4631-8490-254f39cc354f None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:30.917251 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79cc07-24a1-4631-8490-254f39cc354f None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:30.917534 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79cc07-24a1-4631-8490-254f39cc354f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:30.927880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79cc07-24a1-4631-8490-254f39cc354f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:30.935451 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-ab79cc07-24a1-4631-8490-254f39cc354f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:30.935451 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:30.935451 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:30.935451 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:30.935451 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:30.935451 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:30.935451 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:30.935451 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:30.935451 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:30.935451 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:30.935451 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:30.935451 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:30.935451 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:30.935451 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:30.935451 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:30.935451 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:30.936240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:30.936240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:30.936240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:30.936240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:30.936240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:30.936240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:30.936240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:30.936240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:30.936240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:30.936240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:30.936240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:30.936240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:24:30.936240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:30.936240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:30.936240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:30.936240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:30.936980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:30.936980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:30.936980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:30.936980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:30.936980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:30.936980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:30.936980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:30.936980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:30.936980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:30.936980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:30.936980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:30.936980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:24:30.936980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 27/49] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:24:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:30.942375 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5dc03-d220-4b28-a5f3-35fdac478378 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:30.977773 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea5934-8600-4543-a82a-59664e98ddbe None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:30.978074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea5934-8600-4543-a82a-59664e98ddbe None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:30.978365 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea5934-8600-4543-a82a-59664e98ddbe None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:30.980475 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 28/50] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:24:30.985121 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f3b4d-377b-42dc-8cd2-78c4827a0a5c None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:30.985420 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f3b4d-377b-42dc-8cd2-78c4827a0a5c None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:30.985711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f3b4d-377b-42dc-8cd2-78c4827a0a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:31.002410 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-1b3f3b4d-377b-42dc-8cd2-78c4827a0a5c None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:31.003645 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-1b3f3b4d-377b-42dc-8cd2-78c4827a0a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:31.042042 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5dc03-d220-4b28-a5f3-35fdac478378 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:31.042896 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:31.076750 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 29/51] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:24:31.076887 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b097e68-fcb7-4190-aa56-e7fc861219cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:31.077498 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b097e68-fcb7-4190-aa56-e7fc861219cb None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:31.077924 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b097e68-fcb7-4190-aa56-e7fc861219cb None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:31.078240 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b097e68-fcb7-4190-aa56-e7fc861219cb None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:31.078989 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b097e68-fcb7-4190-aa56-e7fc861219cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:31.079320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b097e68-fcb7-4190-aa56-e7fc861219cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:31.080709 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b097e68-fcb7-4190-aa56-e7fc861219cb None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:31.097279 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 23/52] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:24:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:31.098338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f3b4d-377b-42dc-8cd2-78c4827a0a5c None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:31.099622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b097e68-fcb7-4190-aa56-e7fc861219cb None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:31.134472 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:31.198987 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f3b4d-377b-42dc-8cd2-78c4827a0a5c None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:31.199441 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b097e68-fcb7-4190-aa56-e7fc861219cb None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:31.232643 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af54cfe-ba0a-4351-9959-c110d17611fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:31.232822 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c7a21-e81c-4356-8bf2-8341452c152d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:31.233527 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af54cfe-ba0a-4351-9959-c110d17611fe None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:31.233626 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c7a21-e81c-4356-8bf2-8341452c152d None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:31.233814 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af54cfe-ba0a-4351-9959-c110d17611fe None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:31.233953 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c7a21-e81c-4356-8bf2-8341452c152d None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:31.234089 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af54cfe-ba0a-4351-9959-c110d17611fe None admin] PATH_INFO: `/v3/users/0745bfc9958247ec85586308336b6dda` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:31.234230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c7a21-e81c-4356-8bf2-8341452c152d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:31.235299 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af54cfe-ba0a-4351-9959-c110d17611fe None admin] RBAC: Authorizing `identity:get_user(user_id=0745bfc9958247ec85586308336b6dda)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:31.235433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c7a21-e81c-4356-8bf2-8341452c152d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:31.237043 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af54cfe-ba0a-4351-9959-c110d17611fe None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:31.237150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c7a21-e81c-4356-8bf2-8341452c152d None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:31.238884 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 30/53] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:24:31 2022] GET /identity/v3/users/0745bfc9958247ec85586308336b6dda => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:31.239000 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 24/54] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:24:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:31.244037 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c7a21-e81c-4356-8bf2-8341452c152d None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:31.244172 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af54cfe-ba0a-4351-9959-c110d17611fe None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:31.284221 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:31.342267 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c7a21-e81c-4356-8bf2-8341452c152d None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:31.343824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:31.344499 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af54cfe-ba0a-4351-9959-c110d17611fe None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:31.377035 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390503ad-bb63-488c-bcd5-d3c7eeeefacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:31.377702 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390503ad-bb63-488c-bcd5-d3c7eeeefacb None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:31.377996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390503ad-bb63-488c-bcd5-d3c7eeeefacb None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:31.378087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee988c-d39b-4aaf-b3dd-c677b0fd40bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:31.378279 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390503ad-bb63-488c-bcd5-d3c7eeeefacb None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:31.378854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee988c-d39b-4aaf-b3dd-c677b0fd40bc None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:31.378985 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390503ad-bb63-488c-bcd5-d3c7eeeefacb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:31.379145 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee988c-d39b-4aaf-b3dd-c677b0fd40bc None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:31.379460 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee988c-d39b-4aaf-b3dd-c677b0fd40bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:31.380525 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390503ad-bb63-488c-bcd5-d3c7eeeefacb None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:31.380681 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee988c-d39b-4aaf-b3dd-c677b0fd40bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:31.382140 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee988c-d39b-4aaf-b3dd-c677b0fd40bc None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:31.383785 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 31/55] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:24:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:31.389348 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee988c-d39b-4aaf-b3dd-c677b0fd40bc None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:31.405970 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 25/56] 10.222.0.41 () {60 vars in 1140 bytes} [Fri May 27 09:24:31 2022] POST /identity/v3/projects => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:24:31.494103 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee988c-d39b-4aaf-b3dd-c677b0fd40bc None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:31.501965 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:31.530654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd9400-cf09-4aee-aa6d-9e016dc7e538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:31.531372 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd9400-cf09-4aee-aa6d-9e016dc7e538 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:31.531662 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd9400-cf09-4aee-aa6d-9e016dc7e538 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:31.531942 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd9400-cf09-4aee-aa6d-9e016dc7e538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:31.532795 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd9400-cf09-4aee-aa6d-9e016dc7e538 None admin] RBAC: Adding query filter params (role.id=bb6c5483d9be4a16ac64750536c5e2e2, scope.domain.id=default, user.id=0745bfc9958247ec85586308336b6dda) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:31.533113 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd9400-cf09-4aee-aa6d-9e016dc7e538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:31.534635 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd9400-cf09-4aee-aa6d-9e016dc7e538 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:31.541922 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 32/57] 10.222.0.41 () {56 vars in 1322 bytes} [Fri May 27 09:24:31 2022] GET /identity/v3/role_assignments?user.id=0745bfc9958247ec85586308336b6dda&scope.domain.id=default&role.id=bb6c5483d9be4a16ac64750536c5e2e2 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:33.593743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34534697-d430-4a6d-a892-c691fd17a883 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:33.594277 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34534697-d430-4a6d-a892-c691fd17a883 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:33.594277 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34534697-d430-4a6d-a892-c691fd17a883 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:33.595701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 26/58] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:33.601546 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2631b-8f34-491a-862d-d4384a127e01 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:33.601946 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2631b-8f34-491a-862d-d4384a127e01 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:33.602105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2631b-8f34-491a-862d-d4384a127e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:33.618984 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-a9b2631b-8f34-491a-862d-d4384a127e01 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:33.620201 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-a9b2631b-8f34-491a-862d-d4384a127e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:33.683572 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 33/59] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:33.706732 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34534697-d430-4a6d-a892-c691fd17a883 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:33.809868 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34534697-d430-4a6d-a892-c691fd17a883 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:33.842565 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7954a9-2f6e-4b32-8c6d-e65dc7a291bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:33.843369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7954a9-2f6e-4b32-8c6d-e65dc7a291bd None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:33.843651 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7954a9-2f6e-4b32-8c6d-e65dc7a291bd None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:33.843971 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7954a9-2f6e-4b32-8c6d-e65dc7a291bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:33.845075 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7954a9-2f6e-4b32-8c6d-e65dc7a291bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:33.846522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7954a9-2f6e-4b32-8c6d-e65dc7a291bd None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:33.848128 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 27/60] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:24:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:33.853615 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2631b-8f34-491a-862d-d4384a127e01 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:33.945122 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:33.948047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2631b-8f34-491a-862d-d4384a127e01 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:33.980937 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6d8a8-4aaf-4e42-bb4b-e86780aa1698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:33.981594 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6d8a8-4aaf-4e42-bb4b-e86780aa1698 None admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:33.981877 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6d8a8-4aaf-4e42-bb4b-e86780aa1698 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:33.982155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6d8a8-4aaf-4e42-bb4b-e86780aa1698 None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:33.982856 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6d8a8-4aaf-4e42-bb4b-e86780aa1698 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:33.984342 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6d8a8-4aaf-4e42-bb4b-e86780aa1698 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:34.008673 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 34/61] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 09:24:33 2022] POST /identity/v3/users => generated 275 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:24:37.391119 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3d656-c087-46e6-96d2-e91b21c871cb None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:37.391644 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3d656-c087-46e6-96d2-e91b21c871cb None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:37.391644 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3d656-c087-46e6-96d2-e91b21c871cb None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:37.393145 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 28/62] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:37.408929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff498dbd-10f3-466b-877b-52cdb5239e6b None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:37.409884 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff498dbd-10f3-466b-877b-52cdb5239e6b None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:37.410380 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff498dbd-10f3-466b-877b-52cdb5239e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:37.417313 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc8a7e-0966-4e41-882b-229ee1aa6dd6 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:37.417865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc8a7e-0966-4e41-882b-229ee1aa6dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:37.418394 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc8a7e-0966-4e41-882b-229ee1aa6dd6 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:37.419996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 29/63] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:24:37.425135 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994110e-596a-482d-9d39-ae1bb76bf406 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:37.425683 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994110e-596a-482d-9d39-ae1bb76bf406 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:37.426157 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994110e-596a-482d-9d39-ae1bb76bf406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:37.432979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-ff498dbd-10f3-466b-877b-52cdb5239e6b None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:37.435471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-ff498dbd-10f3-466b-877b-52cdb5239e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:37.458243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-f994110e-596a-482d-9d39-ae1bb76bf406 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:37.459948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f994110e-596a-482d-9d39-ae1bb76bf406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:37.494888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:37.582007 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 35/64] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:37.605141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff498dbd-10f3-466b-877b-52cdb5239e6b None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:37.618547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 30/65] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:24:37.641264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994110e-596a-482d-9d39-ae1bb76bf406 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:37.748060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:37.767461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff498dbd-10f3-466b-877b-52cdb5239e6b None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:37.798458 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994110e-596a-482d-9d39-ae1bb76bf406 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:37.803320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb45a6-e1df-4b06-8200-a2963341c215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:37.804308 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb45a6-e1df-4b06-8200-a2963341c215 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:37.804735 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb45a6-e1df-4b06-8200-a2963341c215 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:37.805151 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb45a6-e1df-4b06-8200-a2963341c215 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:37.822189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb45a6-e1df-4b06-8200-a2963341c215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:37.833229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-acbb45a6-e1df-4b06-8200-a2963341c215 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:24:37.833229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:37.833229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:37.833229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:37.833229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:37.833229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:37.833229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:37.833229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:37.833229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:37.833229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:37.833229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:37.833229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:37.833229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:37.833229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:37.833229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:37.833229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:37.834753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:37.834753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:37.834753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:37.834753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:37.834753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:37.834753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:37.834753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:37.834753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:37.834753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:37.834753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:37.834753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:37.834753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:24:37.834753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:37.834753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:37.834753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:37.834753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:37.835617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:37.835617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:37.835617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:37.835617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:37.835617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:37.835617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:37.835617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:37.835617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:37.835617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:37.835617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:37.835617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:24:37.835617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:24:37.836662 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 36/66] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:24:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:37.838298 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45b0cb-2ff8-43c8-b674-71b4a1160d85 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:37.838822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45b0cb-2ff8-43c8-b674-71b4a1160d85 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:37.839333 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45b0cb-2ff8-43c8-b674-71b4a1160d85 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:37.840891 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 37/67] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:37.845586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b7d40-b10e-4058-a08c-2f059ce3266e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:37.845586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b7d40-b10e-4058-a08c-2f059ce3266e None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:37.845586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b7d40-b10e-4058-a08c-2f059ce3266e None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:37.845586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b7d40-b10e-4058-a08c-2f059ce3266e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:37.845911 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45b0cb-2ff8-43c8-b674-71b4a1160d85 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:37.857981 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b7d40-b10e-4058-a08c-2f059ce3266e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:37.867361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-384b7d40-b10e-4058-a08c-2f059ce3266e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:37.867361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:37.867361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:37.867361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:37.867361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:37.867361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:37.867361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:37.867361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:37.867361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:37.867361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:37.867361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:37.867361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:37.867361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:37.867361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:37.867361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:37.867361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:37.868242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:37.868242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:37.868242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:37.868242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:37.868242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:37.868242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:37.868242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:37.868242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:37.868242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:37.868242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:37.868242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:37.868242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:24:37.868242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:37.868242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:37.868242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:37.868242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:37.868979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:37.868979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:37.868979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:37.868979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:37.868979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:37.868979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:37.868979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:37.868979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:37.868979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:37.868979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:37.868979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:37.868979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:24:37.868979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 31/68] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:24:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:37.870096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6c7e8-8933-4b3c-b111-996ca3f786a5 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:37.870096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6c7e8-8933-4b3c-b111-996ca3f786a5 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:37.870328 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6c7e8-8933-4b3c-b111-996ca3f786a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:37.892632 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-b5a6c7e8-8933-4b3c-b111-996ca3f786a5 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:37.893734 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-b5a6c7e8-8933-4b3c-b111-996ca3f786a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:37.902673 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:37.960558 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45b0cb-2ff8-43c8-b674-71b4a1160d85 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:37.962667 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 32/69] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:37.964022 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2db499-7bac-4915-acd4-7ea75585ff70 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:37.964309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2db499-7bac-4915-acd4-7ea75585ff70 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:37.964587 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2db499-7bac-4915-acd4-7ea75585ff70 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:37.965989 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 33/70] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:37.966529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2db499-7bac-4915-acd4-7ea75585ff70 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:38.003932 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3883193-5153-4c1f-8c48-27d68856c38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:38.004714 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3883193-5153-4c1f-8c48-27d68856c38e None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:38.005005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3883193-5153-4c1f-8c48-27d68856c38e None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:38.005890 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3883193-5153-4c1f-8c48-27d68856c38e None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:38.006640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3883193-5153-4c1f-8c48-27d68856c38e None admin] RBAC: Adding query filter params (name=member) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:38.006955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3883193-5153-4c1f-8c48-27d68856c38e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:38.008406 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3883193-5153-4c1f-8c48-27d68856c38e None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:38.017018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 38/71] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:24:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:38.018266 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954808b7-dacb-432a-9a38-e33f70f23461 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:38.018561 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954808b7-dacb-432a-9a38-e33f70f23461 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:38.018848 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954808b7-dacb-432a-9a38-e33f70f23461 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:38.020085 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 39/72] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:38.021267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41defe-23ac-4253-83c9-b90d62910a9e None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:38.021692 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41defe-23ac-4253-83c9-b90d62910a9e None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:38.021974 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41defe-23ac-4253-83c9-b90d62910a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:38.039668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-1c41defe-23ac-4253-83c9-b90d62910a9e None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:38.040853 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-1c41defe-23ac-4253-83c9-b90d62910a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:38.042852 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:38.079999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2db499-7bac-4915-acd4-7ea75585ff70 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:38.111941 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 40/73] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:38.113083 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41defe-23ac-4253-83c9-b90d62910a9e None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:38.115112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5753b-1e42-4c79-89bc-91fbab21da77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:38.115821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5753b-1e42-4c79-89bc-91fbab21da77 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:38.116114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5753b-1e42-4c79-89bc-91fbab21da77 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:38.116390 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5753b-1e42-4c79-89bc-91fbab21da77 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:38.117141 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5753b-1e42-4c79-89bc-91fbab21da77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:38.117453 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5753b-1e42-4c79-89bc-91fbab21da77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:38.118841 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5753b-1e42-4c79-89bc-91fbab21da77 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:38.133754 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 34/74] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:24:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:38.134937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5753b-1e42-4c79-89bc-91fbab21da77 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:38.139119 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:38.214559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41defe-23ac-4253-83c9-b90d62910a9e None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:38.234804 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5753b-1e42-4c79-89bc-91fbab21da77 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:38.247479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0693d4-7cd5-49f8-af09-397dc180a8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:38.248297 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0693d4-7cd5-49f8-af09-397dc180a8bb None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:38.248589 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0693d4-7cd5-49f8-af09-397dc180a8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:38.248870 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0693d4-7cd5-49f8-af09-397dc180a8bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:38.255535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:38.259876 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0693d4-7cd5-49f8-af09-397dc180a8bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:38.267163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff264814-8a0c-47c3-b37d-01146abf9053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:38.268059 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff264814-8a0c-47c3-b37d-01146abf9053 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:38.268344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff264814-8a0c-47c3-b37d-01146abf9053 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:38.268433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-7c0693d4-7cd5-49f8-af09-397dc180a8bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:24:38.268433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:38.268433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:38.268433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:38.268433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:38.268433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:38.268433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:38.268433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:38.268433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:38.268433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:38.268433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:38.268433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:38.268433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:38.268433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:38.268433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:38.268433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:38.269368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:38.269368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:38.269368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:38.269368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:38.269368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:38.269368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:38.269368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:38.269368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:38.269368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:38.269368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:38.269368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:38.269368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:24:38.269368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:38.269368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:38.269368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:38.269368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:38.270110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:38.270110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:38.270110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:38.270110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:38.270110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:38.270110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:38.270110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:38.270110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:38.270110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:38.270110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:38.270110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:24:38.270110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:24:38.271202 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff264814-8a0c-47c3-b37d-01146abf9053 None admin] PATH_INFO: `/v3/users/8f51d7d2041048b4af85b1c48e527498` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:38.271354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 41/75] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 09:24:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:38.271354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4bd0a-3d46-47f5-994a-130c8a9dd79d None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:38.271603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4bd0a-3d46-47f5-994a-130c8a9dd79d None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:38.271962 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4bd0a-3d46-47f5-994a-130c8a9dd79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:38.286258 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff264814-8a0c-47c3-b37d-01146abf9053 None admin] RBAC: Authorizing `identity:get_user(user_id=8f51d7d2041048b4af85b1c48e527498)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:38.288313 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff264814-8a0c-47c3-b37d-01146abf9053 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:38.288492 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-9cb4bd0a-3d46-47f5-994a-130c8a9dd79d None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:38.289691 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-9cb4bd0a-3d46-47f5-994a-130c8a9dd79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:38.289999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 35/76] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:24:38 2022] GET /identity/v3/users/8f51d7d2041048b4af85b1c48e527498 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:38.290771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff264814-8a0c-47c3-b37d-01146abf9053 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:38.350751 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:38.357059 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 42/77] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:38.361657 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4bd0a-3d46-47f5-994a-130c8a9dd79d None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:38.391386 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff264814-8a0c-47c3-b37d-01146abf9053 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:38.424471 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a04789-9adc-48e4-8dd9-309be2cbb066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:38.425266 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a04789-9adc-48e4-8dd9-309be2cbb066 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:38.425550 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a04789-9adc-48e4-8dd9-309be2cbb066 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:38.425824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a04789-9adc-48e4-8dd9-309be2cbb066 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:38.427081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a04789-9adc-48e4-8dd9-309be2cbb066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:38.428562 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a04789-9adc-48e4-8dd9-309be2cbb066 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:38.430168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 36/78] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:24:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:38.430921 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a04789-9adc-48e4-8dd9-309be2cbb066 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:38.475698 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4bd0a-3d46-47f5-994a-130c8a9dd79d None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:38.501258 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:38.510293 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f4d48-fdae-4d10-8e22-5c30c1e9dfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:38.511168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f4d48-fdae-4d10-8e22-5c30c1e9dfb2 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:38.511479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f4d48-fdae-4d10-8e22-5c30c1e9dfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:38.511759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f4d48-fdae-4d10-8e22-5c30c1e9dfb2 None admin] PATH_INFO: `/v3/users/0745bfc9958247ec85586308336b6dda` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:38.512939 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f4d48-fdae-4d10-8e22-5c30c1e9dfb2 None admin] RBAC: Authorizing `identity:get_user(user_id=0745bfc9958247ec85586308336b6dda)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:38.514396 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f4d48-fdae-4d10-8e22-5c30c1e9dfb2 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:38.516184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 43/79] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:24:38 2022] GET /identity/v3/users/0745bfc9958247ec85586308336b6dda => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:38.516782 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f4d48-fdae-4d10-8e22-5c30c1e9dfb2 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:38.532980 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a04789-9adc-48e4-8dd9-309be2cbb066 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:38.560365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:38.566868 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8bed4-01df-4b0b-b2e1-325f4bb6958b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:38.568108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8bed4-01df-4b0b-b2e1-325f4bb6958b None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:38.568482 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8bed4-01df-4b0b-b2e1-325f4bb6958b None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:38.568763 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8bed4-01df-4b0b-b2e1-325f4bb6958b None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:38.569499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8bed4-01df-4b0b-b2e1-325f4bb6958b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:38.569809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8bed4-01df-4b0b-b2e1-325f4bb6958b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:38.571167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8bed4-01df-4b0b-b2e1-325f4bb6958b None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:38.579263 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 37/80] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:24:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:38.580063 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8bed4-01df-4b0b-b2e1-325f4bb6958b None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:38.613336 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f4d48-fdae-4d10-8e22-5c30c1e9dfb2 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:38.646561 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce1fb8-31a4-48d0-9583-7c056ce4f1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:38.647214 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce1fb8-31a4-48d0-9583-7c056ce4f1cc None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:38.647592 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce1fb8-31a4-48d0-9583-7c056ce4f1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:38.647865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce1fb8-31a4-48d0-9583-7c056ce4f1cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:38.676450 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8bed4-01df-4b0b-b2e1-325f4bb6958b None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:38.707345 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:38.710048 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6021d-2804-4ff8-a658-dd06c01eefac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:38.711010 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6021d-2804-4ff8-a658-dd06c01eefac None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:38.711322 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6021d-2804-4ff8-a658-dd06c01eefac None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:38.711601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6021d-2804-4ff8-a658-dd06c01eefac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:38.714142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce1fb8-31a4-48d0-9583-7c056ce4f1cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:38.715664 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce1fb8-31a4-48d0-9583-7c056ce4f1cc None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:38.721472 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6021d-2804-4ff8-a658-dd06c01eefac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:38.729170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-60f6021d-2804-4ff8-a658-dd06c01eefac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:24:38.729170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:38.729170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:38.729170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:38.729170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:38.729170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:38.729170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:38.729170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:38.729170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:38.729170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:38.729170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:38.729170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:38.729170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:38.729170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:38.729170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:38.729170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:38.729979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:38.729979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:38.729979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:38.729979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:38.729979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:38.729979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:38.729979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:38.729979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:38.729979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:38.729979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:38.729979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:38.729979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:24:38.729979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:38.729979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:38.729979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:38.729979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:38.730718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:38.730718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:38.730718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:38.730718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:38.730718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:38.730718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:38.730718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:38.730718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:38.730718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:38.730718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:38.730718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:24:38.730718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:24:38.730718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 38/81] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:24:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:38.731351 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6021d-2804-4ff8-a658-dd06c01eefac None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:38.783164 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:38.816147 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 44/82] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:24:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:24:38.816983 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce1fb8-31a4-48d0-9583-7c056ce4f1cc None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:38.832639 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6021d-2804-4ff8-a658-dd06c01eefac None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:38.870866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49844b9-38dc-4e03-aa7b-7a220d0d7a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:38.871568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49844b9-38dc-4e03-aa7b-7a220d0d7a7c None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:38.871860 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49844b9-38dc-4e03-aa7b-7a220d0d7a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:38.872135 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49844b9-38dc-4e03-aa7b-7a220d0d7a7c None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:38.872843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49844b9-38dc-4e03-aa7b-7a220d0d7a7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:38.874288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49844b9-38dc-4e03-aa7b-7a220d0d7a7c None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:38.899335 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 39/83] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 09:24:38 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:24:38.900147 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49844b9-38dc-4e03-aa7b-7a220d0d7a7c None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:38.927221 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:38.935746 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce1fb8-31a4-48d0-9583-7c056ce4f1cc None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:38.973434 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f10917-e874-4a5a-8361-35806d0e9eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:38.974698 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f10917-e874-4a5a-8361-35806d0e9eee None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:38.974988 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f10917-e874-4a5a-8361-35806d0e9eee None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:38.975296 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f10917-e874-4a5a-8361-35806d0e9eee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:39.029775 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49844b9-38dc-4e03-aa7b-7a220d0d7a7c None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:39.045973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:39.051089 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f10917-e874-4a5a-8361-35806d0e9eee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:39.052641 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f10917-e874-4a5a-8361-35806d0e9eee None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:39.079801 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2474976-384b-4b35-a59f-d1d91b54ad5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:39.080690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2474976-384b-4b35-a59f-d1d91b54ad5c None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:39.080977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2474976-384b-4b35-a59f-d1d91b54ad5c None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:39.081256 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2474976-384b-4b35-a59f-d1d91b54ad5c None admin] PATH_INFO: `/v3/users/8f51d7d2041048b4af85b1c48e527498` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:39.082480 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2474976-384b-4b35-a59f-d1d91b54ad5c None admin] RBAC: Authorizing `identity:get_user(user_id=8f51d7d2041048b4af85b1c48e527498)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:39.084566 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2474976-384b-4b35-a59f-d1d91b54ad5c None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:39.086358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 40/84] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:24:38 2022] GET /identity/v3/users/8f51d7d2041048b4af85b1c48e527498 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:39.086952 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2474976-384b-4b35-a59f-d1d91b54ad5c None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:39.170153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:39.181031 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 45/85] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:24:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:24:39.181868 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f10917-e874-4a5a-8361-35806d0e9eee None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:39.224083 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2474976-384b-4b35-a59f-d1d91b54ad5c None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:39.266829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba699a6b-d8d2-480b-8b65-58e516f82b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:39.267550 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba699a6b-d8d2-480b-8b65-58e516f82b87 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:39.267839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba699a6b-d8d2-480b-8b65-58e516f82b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:39.268116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba699a6b-d8d2-480b-8b65-58e516f82b87 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:39.268859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba699a6b-d8d2-480b-8b65-58e516f82b87 None admin] RBAC: Adding query filter params (name=member) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:39.269171 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba699a6b-d8d2-480b-8b65-58e516f82b87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:39.270561 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba699a6b-d8d2-480b-8b65-58e516f82b87 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:39.283078 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 41/86] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:24:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:39.284025 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba699a6b-d8d2-480b-8b65-58e516f82b87 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:39.321344 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f10917-e874-4a5a-8361-35806d0e9eee None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:39.330952 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:39.370678 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f4c19-be76-41b1-b2bc-0cdc2d2fb87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:39.371619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f4c19-be76-41b1-b2bc-0cdc2d2fb87c None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:39.372349 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f4c19-be76-41b1-b2bc-0cdc2d2fb87c None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:39.372643 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f4c19-be76-41b1-b2bc-0cdc2d2fb87c None admin] PATH_INFO: `/v3/projects/9af9b910687447d4b7b9285bfc31988e` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:39.374290 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f4c19-be76-41b1-b2bc-0cdc2d2fb87c None admin] RBAC: Authorizing `identity:get_project(project_id=9af9b910687447d4b7b9285bfc31988e)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:39.376079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f4c19-be76-41b1-b2bc-0cdc2d2fb87c None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:39.378578 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 46/87] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:24:39 2022] GET /identity/v3/projects/9af9b910687447d4b7b9285bfc31988e => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:39.382368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f4c19-be76-41b1-b2bc-0cdc2d2fb87c None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:39.412438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba699a6b-d8d2-480b-8b65-58e516f82b87 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:39.452377 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:39.468071 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98880c8f-e3a1-4ee0-a396-4bdade3fa569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:39.468820 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98880c8f-e3a1-4ee0-a396-4bdade3fa569 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:39.469112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98880c8f-e3a1-4ee0-a396-4bdade3fa569 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:39.469397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98880c8f-e3a1-4ee0-a396-4bdade3fa569 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:39.509794 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f4c19-be76-41b1-b2bc-0cdc2d2fb87c None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:39.550981 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98880c8f-e3a1-4ee0-a396-4bdade3fa569 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:39.553320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98880c8f-e3a1-4ee0-a396-4bdade3fa569 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:39.563246 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c63be-6e40-4b38-a037-c83ac98150a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:39.564146 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c63be-6e40-4b38-a037-c83ac98150a6 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:39.564430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c63be-6e40-4b38-a037-c83ac98150a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:39.564732 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c63be-6e40-4b38-a037-c83ac98150a6 None admin] PATH_INFO: `/v3/projects/9af9b910687447d4b7b9285bfc31988e` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:39.566375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c63be-6e40-4b38-a037-c83ac98150a6 None admin] RBAC: Authorizing `identity:get_project(project_id=9af9b910687447d4b7b9285bfc31988e)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:39.569842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c63be-6e40-4b38-a037-c83ac98150a6 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:39.572969 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 47/88] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:24:39 2022] GET /identity/v3/projects/9af9b910687447d4b7b9285bfc31988e => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:39.573768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c63be-6e40-4b38-a037-c83ac98150a6 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:39.597962 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:39.679429 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 42/89] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:24:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:24:39.680616 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98880c8f-e3a1-4ee0-a396-4bdade3fa569 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:39.698803 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c63be-6e40-4b38-a037-c83ac98150a6 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:39.736898 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:39.743211 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891f99b-b686-4e70-b575-7958369f1ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:39.744270 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891f99b-b686-4e70-b575-7958369f1ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:39.744561 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891f99b-b686-4e70-b575-7958369f1ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:39.744838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891f99b-b686-4e70-b575-7958369f1ed3 None admin] PATH_INFO: `/v3/users/8f51d7d2041048b4af85b1c48e527498` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:39.746590 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891f99b-b686-4e70-b575-7958369f1ed3 None admin] RBAC: Authorizing `identity:get_user(user_id=8f51d7d2041048b4af85b1c48e527498)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:39.748248 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891f99b-b686-4e70-b575-7958369f1ed3 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:39.750775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 48/90] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:24:39 2022] GET /identity/v3/users/8f51d7d2041048b4af85b1c48e527498 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:39.751661 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891f99b-b686-4e70-b575-7958369f1ed3 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:39.790975 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98880c8f-e3a1-4ee0-a396-4bdade3fa569 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:39.826798 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ad6a9-5683-466d-acb0-4916588b3745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:39.828498 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ad6a9-5683-466d-acb0-4916588b3745 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:39.828992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ad6a9-5683-466d-acb0-4916588b3745 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:39.829602 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ad6a9-5683-466d-acb0-4916588b3745 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:39.831004 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ad6a9-5683-466d-acb0-4916588b3745 None admin] RBAC: Adding query filter params (role.id=207b29fd2d8344ceb403e1c2e9d91ac2, scope.project.id=9af9b910687447d4b7b9285bfc31988e, user.id=8f51d7d2041048b4af85b1c48e527498) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:39.831772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ad6a9-5683-466d-acb0-4916588b3745 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:39.834017 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ad6a9-5683-466d-acb0-4916588b3745 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:39.848689 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 43/91] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:24:39 2022] GET /identity/v3/role_assignments?user.id=8f51d7d2041048b4af85b1c48e527498&scope.project.id=9af9b910687447d4b7b9285bfc31988e&role.id=207b29fd2d8344ceb403e1c2e9d91ac2 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:39.850283 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ad6a9-5683-466d-acb0-4916588b3745 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:39.859337 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:39.905156 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891f99b-b686-4e70-b575-7958369f1ed3 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:39.988085 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f795556-072a-4b8e-af5d-2419dc7b41ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:39.988748 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f795556-072a-4b8e-af5d-2419dc7b41ec None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:39.989034 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f795556-072a-4b8e-af5d-2419dc7b41ec None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:39.989320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f795556-072a-4b8e-af5d-2419dc7b41ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:39.990222 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f795556-072a-4b8e-af5d-2419dc7b41ec None admin] RBAC: Adding query filter params (role.id=bb6c5483d9be4a16ac64750536c5e2e2, scope.project.id=9af9b910687447d4b7b9285bfc31988e, user.id=0745bfc9958247ec85586308336b6dda) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:39.991039 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f795556-072a-4b8e-af5d-2419dc7b41ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:39.992093 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f795556-072a-4b8e-af5d-2419dc7b41ec None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:40.007257 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 49/92] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:24:39 2022] GET /identity/v3/role_assignments?user.id=0745bfc9958247ec85586308336b6dda&scope.project.id=9af9b910687447d4b7b9285bfc31988e&role.id=bb6c5483d9be4a16ac64750536c5e2e2 => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:40.008180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f795556-072a-4b8e-af5d-2419dc7b41ec None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:40.030261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ad6a9-5683-466d-acb0-4916588b3745 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:40.081838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571f725-6b83-4144-9f5d-a74b4bb35381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:40.083059 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571f725-6b83-4144-9f5d-a74b4bb35381 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:40.084142 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571f725-6b83-4144-9f5d-a74b4bb35381 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:40.084607 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571f725-6b83-4144-9f5d-a74b4bb35381 None admin] PATH_INFO: `/v3/projects/9af9b910687447d4b7b9285bfc31988e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:40.090742 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571f725-6b83-4144-9f5d-a74b4bb35381 None admin] RBAC: Authorizing `identity:get_project(project_id=9af9b910687447d4b7b9285bfc31988e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:40.092652 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571f725-6b83-4144-9f5d-a74b4bb35381 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:40.095086 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 44/93] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:24:39 2022] GET /identity/v3/projects/9af9b910687447d4b7b9285bfc31988e => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:40.103010 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571f725-6b83-4144-9f5d-a74b4bb35381 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:40.165145 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:40.191716 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:40.229815 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571f725-6b83-4144-9f5d-a74b4bb35381 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:40.273555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1d178-4dd4-42c6-96b7-9c718beaf487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:40.274961 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1d178-4dd4-42c6-96b7-9c718beaf487 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:40.275485 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1d178-4dd4-42c6-96b7-9c718beaf487 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:40.275975 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1d178-4dd4-42c6-96b7-9c718beaf487 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:40.276998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1d178-4dd4-42c6-96b7-9c718beaf487 None admin] RBAC: Adding query filter params (role.id=580d60e140704327b90a80fc59a2165c, scope.project.id=9af9b910687447d4b7b9285bfc31988e, user.id=8f51d7d2041048b4af85b1c48e527498) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:40.277502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1d178-4dd4-42c6-96b7-9c718beaf487 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:40.279158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1d178-4dd4-42c6-96b7-9c718beaf487 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:40.285572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 45/94] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:24:40 2022] GET /identity/v3/role_assignments?user.id=8f51d7d2041048b4af85b1c48e527498&scope.project.id=9af9b910687447d4b7b9285bfc31988e&role.id=580d60e140704327b90a80fc59a2165c => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:40.295679 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f795556-072a-4b8e-af5d-2419dc7b41ec None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:40.339724 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dd7b6-e3a9-4c92-922c-af454374d898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:40.340366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dd7b6-e3a9-4c92-922c-af454374d898 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:40.340661 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dd7b6-e3a9-4c92-922c-af454374d898 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:40.340939 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dd7b6-e3a9-4c92-922c-af454374d898 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:40.446994 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146dd7b6-e3a9-4c92-922c-af454374d898 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:40.448557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146dd7b6-e3a9-4c92-922c-af454374d898 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:40.539350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:40.581474 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 50/95] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:24:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:24:40.587182 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1d178-4dd4-42c6-96b7-9c718beaf487 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:40.719004 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1d178-4dd4-42c6-96b7-9c718beaf487 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:40.755062 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df402575-4a5d-4e3d-9edc-3900dd469c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:40.756192 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df402575-4a5d-4e3d-9edc-3900dd469c66 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:40.756638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df402575-4a5d-4e3d-9edc-3900dd469c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:40.757051 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df402575-4a5d-4e3d-9edc-3900dd469c66 None admin] PATH_INFO: `/v3/projects/dec6aca401c5481e98425f78acf33e39` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:40.758382 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df402575-4a5d-4e3d-9edc-3900dd469c66 None admin] RBAC: Authorizing `identity:get_project(project_id=dec6aca401c5481e98425f78acf33e39)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:40.759984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df402575-4a5d-4e3d-9edc-3900dd469c66 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:40.761806 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 46/96] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:24:40 2022] GET /identity/v3/projects/dec6aca401c5481e98425f78acf33e39 => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:40.767835 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dd7b6-e3a9-4c92-922c-af454374d898 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:40.917755 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dd7b6-e3a9-4c92-922c-af454374d898 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:40.952060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af559c5-c7ba-4d06-9ff8-177982c78351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:40.952729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af559c5-c7ba-4d06-9ff8-177982c78351 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:40.953015 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af559c5-c7ba-4d06-9ff8-177982c78351 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:40.953295 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af559c5-c7ba-4d06-9ff8-177982c78351 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:40.954130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af559c5-c7ba-4d06-9ff8-177982c78351 None admin] RBAC: Adding query filter params (role.id=207b29fd2d8344ceb403e1c2e9d91ac2, scope.project.id=dec6aca401c5481e98425f78acf33e39, user.id=8f51d7d2041048b4af85b1c48e527498) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:40.954445 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af559c5-c7ba-4d06-9ff8-177982c78351 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:40.955945 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af559c5-c7ba-4d06-9ff8-177982c78351 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:40.966422 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 51/97] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:24:40 2022] GET /identity/v3/role_assignments?user.id=8f51d7d2041048b4af85b1c48e527498&scope.project.id=dec6aca401c5481e98425f78acf33e39&role.id=207b29fd2d8344ceb403e1c2e9d91ac2 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:41.653378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e690f74-8e31-40f9-befc-c5ffc6a755a3 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:41.654477 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e690f74-8e31-40f9-befc-c5ffc6a755a3 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:41.654970 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e690f74-8e31-40f9-befc-c5ffc6a755a3 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:41.656853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 47/98] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:41.662678 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178cc63-cd48-4959-8d18-813e1d2582a9 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:41.663116 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178cc63-cd48-4959-8d18-813e1d2582a9 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:41.663327 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178cc63-cd48-4959-8d18-813e1d2582a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:41.683830 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-4178cc63-cd48-4959-8d18-813e1d2582a9 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:41.685050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-4178cc63-cd48-4959-8d18-813e1d2582a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:41.716034 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:41.789557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 52/99] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:41.836911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e690f74-8e31-40f9-befc-c5ffc6a755a3 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:41.841622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:41.998318 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e690f74-8e31-40f9-befc-c5ffc6a755a3 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:42.041005 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f9a76-6516-4a61-976b-197145d2645f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:42.041824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f9a76-6516-4a61-976b-197145d2645f None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:42.042110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f9a76-6516-4a61-976b-197145d2645f None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:42.042385 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f9a76-6516-4a61-976b-197145d2645f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:42.043601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f9a76-6516-4a61-976b-197145d2645f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:42.045042 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f9a76-6516-4a61-976b-197145d2645f None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:42.046815 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 48/100] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:24:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:42.053572 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178cc63-cd48-4959-8d18-813e1d2582a9 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:42.238125 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178cc63-cd48-4959-8d18-813e1d2582a9 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:42.263343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ba637-0190-4f7e-96cc-5889e12fb3e2 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:42.263599 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ba637-0190-4f7e-96cc-5889e12fb3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:42.263833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ba637-0190-4f7e-96cc-5889e12fb3e2 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:42.265193 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 49/101] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:24:42.272952 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aff664-dede-40a3-bc24-2ea6f8c04450 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:42.273243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aff664-dede-40a3-bc24-2ea6f8c04450 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:42.273523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aff664-dede-40a3-bc24-2ea6f8c04450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:42.306537 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e8779-3416-4b49-b4ab-65569dc3f153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:42.307620 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e8779-3416-4b49-b4ab-65569dc3f153 None admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:42.310923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e8779-3416-4b49-b4ab-65569dc3f153 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:42.311464 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e8779-3416-4b49-b4ab-65569dc3f153 None admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:42.312403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e8779-3416-4b49-b4ab-65569dc3f153 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:42.316720 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e8779-3416-4b49-b4ab-65569dc3f153 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:42.317935 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-b3aff664-dede-40a3-bc24-2ea6f8c04450 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:42.320786 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-b3aff664-dede-40a3-bc24-2ea6f8c04450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:42.387593 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 53/102] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 09:24:42 2022] POST /identity/v3/projects => generated 302 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:24:42.436099 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:42.443190 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 50/103] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:42.480860 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e8779-3416-4b49-b4ab-65569dc3f153 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:42.500409 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:42.616726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e8779-3416-4b49-b4ab-65569dc3f153 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:42.658697 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d95bd-7494-47d9-815c-6972c75a5fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:42.659542 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d95bd-7494-47d9-815c-6972c75a5fbb None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:42.659833 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d95bd-7494-47d9-815c-6972c75a5fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:42.660122 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d95bd-7494-47d9-815c-6972c75a5fbb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:42.680432 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d95bd-7494-47d9-815c-6972c75a5fbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:42.688540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-e62d95bd-7494-47d9-815c-6972c75a5fbb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:24:42.688540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:42.688540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:42.688540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:42.688540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:42.688540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:42.688540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:42.688540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:42.688540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:42.688540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:42.688540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:42.688540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:42.688540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:42.688540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:42.688540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:42.688540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:42.689455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:42.689455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:42.689455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:42.689455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:42.689455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:42.689455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:42.689455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:42.689455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:42.689455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:42.689455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:42.689455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:42.689455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:24:42.689455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:42.689455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:42.689455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:42.689455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:42.690229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:42.690229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:42.690229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:42.690229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:42.690229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:42.690229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:42.690229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:42.690229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:42.690229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:42.690229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:42.690229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:24:42.690229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:24:42.690229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 54/104] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:24:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:42.695937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aff664-dede-40a3-bc24-2ea6f8c04450 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:42.855995 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aff664-dede-40a3-bc24-2ea6f8c04450 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:42.906136 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957dbd42-d407-4542-b308-a95b33b63f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:42.906742 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957dbd42-d407-4542-b308-a95b33b63f1d None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:42.907032 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957dbd42-d407-4542-b308-a95b33b63f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:42.907333 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957dbd42-d407-4542-b308-a95b33b63f1d None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:42.908086 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957dbd42-d407-4542-b308-a95b33b63f1d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:42.908398 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957dbd42-d407-4542-b308-a95b33b63f1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:42.909782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957dbd42-d407-4542-b308-a95b33b63f1d None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:42.922780 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 51/105] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:24:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:42.928783 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d95bd-7494-47d9-815c-6972c75a5fbb None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:43.029985 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:43.062345 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d95bd-7494-47d9-815c-6972c75a5fbb None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:43.106709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34773a2f-de29-409b-bd86-2bf07b86d152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:43.107627 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34773a2f-de29-409b-bd86-2bf07b86d152 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:43.107911 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34773a2f-de29-409b-bd86-2bf07b86d152 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:43.108191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34773a2f-de29-409b-bd86-2bf07b86d152 None admin] PATH_INFO: `/v3/users/c3984ecb89054bf1a186c3606cf1300e` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:43.131996 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34773a2f-de29-409b-bd86-2bf07b86d152 None admin] RBAC: Authorizing `identity:get_user(user_id=c3984ecb89054bf1a186c3606cf1300e)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:43.133500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34773a2f-de29-409b-bd86-2bf07b86d152 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:43.135225 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 55/106] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:24:42 2022] GET /identity/v3/users/c3984ecb89054bf1a186c3606cf1300e => generated 289 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:43.140975 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957dbd42-d407-4542-b308-a95b33b63f1d None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:43.238297 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:43.282589 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957dbd42-d407-4542-b308-a95b33b63f1d None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:43.332933 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b80823-de4f-47c2-b6ec-98b5622eda52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:43.333807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b80823-de4f-47c2-b6ec-98b5622eda52 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:43.334110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b80823-de4f-47c2-b6ec-98b5622eda52 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:43.334445 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b80823-de4f-47c2-b6ec-98b5622eda52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:43.434679 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b80823-de4f-47c2-b6ec-98b5622eda52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:43.436204 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b80823-de4f-47c2-b6ec-98b5622eda52 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:43.453157 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dbcbf-9e0c-4b97-afa5-9b5c695fd095 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:43.453445 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dbcbf-9e0c-4b97-afa5-9b5c695fd095 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:43.453726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dbcbf-9e0c-4b97-afa5-9b5c695fd095 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:43.455266 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 56/107] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:43.465921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7865306-74b9-4745-8eb8-f01fbd54a5fd None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:43.466208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7865306-74b9-4745-8eb8-f01fbd54a5fd None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:43.466486 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7865306-74b9-4745-8eb8-f01fbd54a5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:43.500387 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-f7865306-74b9-4745-8eb8-f01fbd54a5fd None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:43.501522 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f7865306-74b9-4745-8eb8-f01fbd54a5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:43.518475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:43.566445 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 52/108] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:24:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:24:43.568842 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3691362-38a9-42fe-a8eb-fc2e763aa400 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:43.569335 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3691362-38a9-42fe-a8eb-fc2e763aa400 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:43.569791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3691362-38a9-42fe-a8eb-fc2e763aa400 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:43.571331 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 53/109] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:43.572985 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3691362-38a9-42fe-a8eb-fc2e763aa400 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:43.656869 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 57/110] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 27 09:24:43.658188 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab804661-7037-44ae-8661-8a32be0bec9c None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:43.658314 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab804661-7037-44ae-8661-8a32be0bec9c None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:43.658547 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab804661-7037-44ae-8661-8a32be0bec9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:43.684983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3691362-38a9-42fe-a8eb-fc2e763aa400 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:43.692329 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-ab804661-7037-44ae-8661-8a32be0bec9c None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:43.693591 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-ab804661-7037-44ae-8661-8a32be0bec9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:43.722675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e78770-3a62-4345-98db-ff1c00f46902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:43.724768 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e78770-3a62-4345-98db-ff1c00f46902 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:43.725287 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e78770-3a62-4345-98db-ff1c00f46902 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:43.725740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e78770-3a62-4345-98db-ff1c00f46902 None admin] PATH_INFO: `/v3/projects/9af9b910687447d4b7b9285bfc31988e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:43.727175 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e78770-3a62-4345-98db-ff1c00f46902 None admin] RBAC: Authorizing `identity:get_project(project_id=9af9b910687447d4b7b9285bfc31988e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:43.728929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e78770-3a62-4345-98db-ff1c00f46902 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:43.731015 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 54/111] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:24:43 2022] GET /identity/v3/projects/9af9b910687447d4b7b9285bfc31988e => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:43.732072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e78770-3a62-4345-98db-ff1c00f46902 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:43.766195 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:43.777715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:43.800151 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 58/112] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:43.803793 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab804661-7037-44ae-8661-8a32be0bec9c None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:43.858752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e78770-3a62-4345-98db-ff1c00f46902 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:43.900560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91a854-6952-49f1-b528-30bfe257ca07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:43.901667 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91a854-6952-49f1-b528-30bfe257ca07 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:43.902139 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91a854-6952-49f1-b528-30bfe257ca07 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:43.902597 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91a854-6952-49f1-b528-30bfe257ca07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:43.915738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91a854-6952-49f1-b528-30bfe257ca07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:43.923946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-ad91a854-6952-49f1-b528-30bfe257ca07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:43.923946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:43.923946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:43.923946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:43.923946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:43.923946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:43.923946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:43.923946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:43.923946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:43.923946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:43.923946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:43.923946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:43.923946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:43.923946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:43.923946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:43.923946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:43.924797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:43.924797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:43.924797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:43.924797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:43.924797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:43.924797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:43.924797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:43.924797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:43.924797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:43.924797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:43.924797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:43.924797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:24:43.924797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:43.924797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:43.924797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:43.924797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:43.925547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:43.925547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:43.925547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:43.925547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:43.925547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:43.925547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:43.925547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:43.925547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:43.925547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:43.925547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:43.925547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:43.925547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:24:43.928334 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 55/113] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:24:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:43.929819 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61885c16-4547-4017-8908-bffa3f76e53e None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:43.930248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61885c16-4547-4017-8908-bffa3f76e53e None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:43.930667 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61885c16-4547-4017-8908-bffa3f76e53e None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:43.930788 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab804661-7037-44ae-8661-8a32be0bec9c None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:43.932209 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 56/114] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:43.933030 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61885c16-4547-4017-8908-bffa3f76e53e None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:43.972104 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27a297-be20-4243-9a94-97eafb784ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:43.972771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a297-be20-4243-9a94-97eafb784ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:43.973055 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a297-be20-4243-9a94-97eafb784ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:43.973335 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a297-be20-4243-9a94-97eafb784ff6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:43.974830 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27a297-be20-4243-9a94-97eafb784ff6 None admin] RBAC: Adding query filter params (role.id=2ed814d9cd4844f5b4ddfc8627b8fc6a, scope.project.id=9af9b910687447d4b7b9285bfc31988e, user.id=c3984ecb89054bf1a186c3606cf1300e) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:43.975151 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27a297-be20-4243-9a94-97eafb784ff6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:43.976699 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27a297-be20-4243-9a94-97eafb784ff6 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:43.982715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 59/115] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:24:43 2022] GET /identity/v3/role_assignments?user.id=c3984ecb89054bf1a186c3606cf1300e&scope.project.id=9af9b910687447d4b7b9285bfc31988e&role.id=2ed814d9cd4844f5b4ddfc8627b8fc6a => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:43.992894 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665543fb-fbb6-4420-88dd-bd70639c52aa None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:43.993183 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665543fb-fbb6-4420-88dd-bd70639c52aa None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:43.993467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665543fb-fbb6-4420-88dd-bd70639c52aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:44.028633 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-665543fb-fbb6-4420-88dd-bd70639c52aa None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:44.030189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-665543fb-fbb6-4420-88dd-bd70639c52aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:44.055163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:44.064339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61885c16-4547-4017-8908-bffa3f76e53e None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:44.109080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4ac6e-bc21-4f81-bf48-13cd7aa8a563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:44.109976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4ac6e-bc21-4f81-bf48-13cd7aa8a563 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:44.110266 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4ac6e-bc21-4f81-bf48-13cd7aa8a563 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:44.110549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4ac6e-bc21-4f81-bf48-13cd7aa8a563 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:44.125010 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4ac6e-bc21-4f81-bf48-13cd7aa8a563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:44.139738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-92a4ac6e-bc21-4f81-bf48-13cd7aa8a563 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:24:44.139738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:44.139738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:44.139738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:44.139738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:44.139738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:44.139738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:44.139738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:44.139738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:44.139738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:44.139738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:44.139738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:44.139738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:44.139738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:44.139738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:44.139738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:44.140638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:44.140638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:44.140638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:44.140638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:44.140638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:44.140638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:44.140638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:44.140638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:44.140638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:44.140638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:44.140638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:44.140638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:24:44.140638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:44.140638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:44.140638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:44.140638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:44.141404 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:44.141404 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:44.141404 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:44.141404 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:44.141404 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:44.141404 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:44.141404 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:44.141404 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:44.141404 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:44.141404 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:44.141404 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:24:44.141404 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:24:44.141404 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 57/116] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:24:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:44.142036 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4ac6e-bc21-4f81-bf48-13cd7aa8a563 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:44.196907 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:44.223423 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 60/117] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:44.224192 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665543fb-fbb6-4420-88dd-bd70639c52aa None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:44.279144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4ac6e-bc21-4f81-bf48-13cd7aa8a563 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:44.325651 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97173f-ad25-4458-b736-3b7f67bd22fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:44.326846 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97173f-ad25-4458-b736-3b7f67bd22fb None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:44.327262 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97173f-ad25-4458-b736-3b7f67bd22fb None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:44.327573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97173f-ad25-4458-b736-3b7f67bd22fb None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:44.328565 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97173f-ad25-4458-b736-3b7f67bd22fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:44.328879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97173f-ad25-4458-b736-3b7f67bd22fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:44.330973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97173f-ad25-4458-b736-3b7f67bd22fb None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:44.336239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665543fb-fbb6-4420-88dd-bd70639c52aa None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:44.341742 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 58/118] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:24:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:44.347543 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ca5cb-6738-49ef-b281-542116ec9320 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:44.347839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ca5cb-6738-49ef-b281-542116ec9320 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:44.348121 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ca5cb-6738-49ef-b281-542116ec9320 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:44.349985 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 59/119] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:44.350761 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ca5cb-6738-49ef-b281-542116ec9320 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:44.367497 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:44.384268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a006f-fd22-43ea-9273-2e5a11b39d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:44.385040 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a006f-fd22-43ea-9273-2e5a11b39d7c None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:44.385332 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a006f-fd22-43ea-9273-2e5a11b39d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:44.385613 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a006f-fd22-43ea-9273-2e5a11b39d7c None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:44.386463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a006f-fd22-43ea-9273-2e5a11b39d7c None admin] RBAC: Adding query filter params (name=member) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:44.386778 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a006f-fd22-43ea-9273-2e5a11b39d7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:44.388214 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a006f-fd22-43ea-9273-2e5a11b39d7c None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:44.397688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 61/120] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:24:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:44.398719 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a006f-fd22-43ea-9273-2e5a11b39d7c None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:44.448156 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:44.465335 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ca5cb-6738-49ef-b281-542116ec9320 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:44.505741 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22305425-7682-4127-a62b-bbb88dc2753a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:44.506658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22305425-7682-4127-a62b-bbb88dc2753a None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:44.506950 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22305425-7682-4127-a62b-bbb88dc2753a None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:44.507457 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22305425-7682-4127-a62b-bbb88dc2753a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:44.510416 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a006f-fd22-43ea-9273-2e5a11b39d7c None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:44.518901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22305425-7682-4127-a62b-bbb88dc2753a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:44.527686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-22305425-7682-4127-a62b-bbb88dc2753a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:24:44.527686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:44.527686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:44.527686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:44.527686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:44.527686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:44.527686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:44.527686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:44.527686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:44.527686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:44.527686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:44.527686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:44.527686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:44.527686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:44.527686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:44.527686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:44.528682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:44.528682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:44.528682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:44.528682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:44.528682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:44.528682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:44.528682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:44.528682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:44.528682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:44.528682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:44.528682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:44.528682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:24:44.528682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:44.528682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:44.528682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:44.528682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:44.529612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:44.529612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:44.529612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:44.529612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:44.529612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:44.529612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:44.529612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:44.529612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:44.529612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:44.529612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:44.529612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:24:44.529612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:24:44.529612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 60/121] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 09:24:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:44.530242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1260119-aa22-4f1b-b7c0-081f765bc102 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:44.530562 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1260119-aa22-4f1b-b7c0-081f765bc102 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:44.530771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1260119-aa22-4f1b-b7c0-081f765bc102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:44.549819 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-b1260119-aa22-4f1b-b7c0-081f765bc102 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:44.550210 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8d221-09c8-4d47-9215-5085698328f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:44.551075 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-b1260119-aa22-4f1b-b7c0-081f765bc102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:44.551505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8d221-09c8-4d47-9215-5085698328f0 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:44.552536 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8d221-09c8-4d47-9215-5085698328f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:44.553007 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8d221-09c8-4d47-9215-5085698328f0 None admin] PATH_INFO: `/v3/users/0745bfc9958247ec85586308336b6dda` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:44.554529 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8d221-09c8-4d47-9215-5085698328f0 None admin] RBAC: Authorizing `identity:get_user(user_id=0745bfc9958247ec85586308336b6dda)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:44.556323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8d221-09c8-4d47-9215-5085698328f0 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:44.558452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 62/122] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:24:44 2022] GET /identity/v3/users/0745bfc9958247ec85586308336b6dda => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:44.563751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8d221-09c8-4d47-9215-5085698328f0 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:44.624389 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 61/123] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:44.625091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1260119-aa22-4f1b-b7c0-081f765bc102 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:44.627405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:44.672290 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8d221-09c8-4d47-9215-5085698328f0 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:44.687623 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:44.714431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a3e1c-a4db-4767-a15b-639e86c66427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:44.714431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a3e1c-a4db-4767-a15b-639e86c66427 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:44.715118 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a3e1c-a4db-4767-a15b-639e86c66427 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:44.719294 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a3e1c-a4db-4767-a15b-639e86c66427 None admin] PATH_INFO: `/v3/users/8f51d7d2041048b4af85b1c48e527498` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:44.719294 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a3e1c-a4db-4767-a15b-639e86c66427 None admin] RBAC: Authorizing `identity:get_user(user_id=8f51d7d2041048b4af85b1c48e527498)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:44.719294 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a3e1c-a4db-4767-a15b-639e86c66427 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:44.720836 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 63/124] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:24:44 2022] GET /identity/v3/users/8f51d7d2041048b4af85b1c48e527498 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:44.721951 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a3e1c-a4db-4767-a15b-639e86c66427 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:44.730837 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1260119-aa22-4f1b-b7c0-081f765bc102 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:44.768329 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d2e4c-a913-4dc7-b067-4b4931428274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:44.769010 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d2e4c-a913-4dc7-b067-4b4931428274 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:44.769466 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d2e4c-a913-4dc7-b067-4b4931428274 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:44.769753 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d2e4c-a913-4dc7-b067-4b4931428274 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:44.771861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d2e4c-a913-4dc7-b067-4b4931428274 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:44.772183 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d2e4c-a913-4dc7-b067-4b4931428274 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:44.773594 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d2e4c-a913-4dc7-b067-4b4931428274 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:44.783639 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 62/125] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:24:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:44.784295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d2e4c-a913-4dc7-b067-4b4931428274 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:44.846097 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a3e1c-a4db-4767-a15b-639e86c66427 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:44.857415 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:44.885122 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3dcd2-6fde-4756-b0c0-336739e81dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:44.886053 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3dcd2-6fde-4756-b0c0-336739e81dbe None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:44.886346 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3dcd2-6fde-4756-b0c0-336739e81dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:44.886655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3dcd2-6fde-4756-b0c0-336739e81dbe None admin] PATH_INFO: `/v3/projects/9af9b910687447d4b7b9285bfc31988e` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:44.888025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe3dcd2-6fde-4756-b0c0-336739e81dbe None admin] RBAC: Authorizing `identity:get_project(project_id=9af9b910687447d4b7b9285bfc31988e)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:44.889634 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe3dcd2-6fde-4756-b0c0-336739e81dbe None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:44.891660 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 64/126] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:24:44 2022] GET /identity/v3/projects/9af9b910687447d4b7b9285bfc31988e => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:44.892377 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3dcd2-6fde-4756-b0c0-336739e81dbe None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:44.900049 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d2e4c-a913-4dc7-b067-4b4931428274 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:44.936620 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2656c-56d9-4927-bca5-c17bd6ddd38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:44.937531 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2656c-56d9-4927-bca5-c17bd6ddd38f None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:44.937828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2656c-56d9-4927-bca5-c17bd6ddd38f None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:44.938104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2656c-56d9-4927-bca5-c17bd6ddd38f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:44.947650 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:44.950193 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2656c-56d9-4927-bca5-c17bd6ddd38f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:44.958760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-2ff2656c-56d9-4927-bca5-c17bd6ddd38f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:24:44.958760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:44.958760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:44.958760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:44.958760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:44.958760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:44.958760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:44.958760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:44.958760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:44.958760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:44.958760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:44.958760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:44.958760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:44.958760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:44.958760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:44.958760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:44.960217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:44.960217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:44.960217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:44.960217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:44.960217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:44.960217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:44.960217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:44.960217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:44.960217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:44.960217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:44.960217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:44.960217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:24:44.960217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:44.960217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:44.960217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:44.960217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:44.962064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:44.962064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:44.962064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:44.962064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:44.962064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:44.962064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:44.962064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:44.962064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:44.962064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:44.962064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:44.962064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:24:44.962064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:24:44.962064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 63/127] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:24:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:44.962064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2656c-56d9-4927-bca5-c17bd6ddd38f None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:45.005700 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3dcd2-6fde-4756-b0c0-336739e81dbe None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:45.043530 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c256a-aa2e-4969-a7a4-144165881a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:45.044390 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c256a-aa2e-4969-a7a4-144165881a25 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:45.044744 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c256a-aa2e-4969-a7a4-144165881a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:45.045032 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c256a-aa2e-4969-a7a4-144165881a25 None admin] PATH_INFO: `/v3/projects/9af9b910687447d4b7b9285bfc31988e` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:45.046276 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c256a-aa2e-4969-a7a4-144165881a25 None admin] RBAC: Authorizing `identity:get_project(project_id=9af9b910687447d4b7b9285bfc31988e)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:45.047811 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c256a-aa2e-4969-a7a4-144165881a25 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:45.049794 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 65/128] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:24:44 2022] GET /identity/v3/projects/9af9b910687447d4b7b9285bfc31988e => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:45.050625 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c256a-aa2e-4969-a7a4-144165881a25 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:45.078985 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2656c-56d9-4927-bca5-c17bd6ddd38f None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:45.104322 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:45.116387 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f5e0d-d558-4bee-8a3c-ff4d25b6df3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:45.117422 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f5e0d-d558-4bee-8a3c-ff4d25b6df3c None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:45.118061 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f5e0d-d558-4bee-8a3c-ff4d25b6df3c None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:45.118675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f5e0d-d558-4bee-8a3c-ff4d25b6df3c None admin] PATH_INFO: `/v3/users/8f51d7d2041048b4af85b1c48e527498` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:45.120305 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f5e0d-d558-4bee-8a3c-ff4d25b6df3c None admin] RBAC: Authorizing `identity:get_user(user_id=8f51d7d2041048b4af85b1c48e527498)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:45.122023 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f5e0d-d558-4bee-8a3c-ff4d25b6df3c None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:45.127558 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 64/129] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:24:44 2022] GET /identity/v3/users/8f51d7d2041048b4af85b1c48e527498 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:45.128608 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f5e0d-d558-4bee-8a3c-ff4d25b6df3c None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:45.167626 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c256a-aa2e-4969-a7a4-144165881a25 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:45.185922 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:45.206788 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664a1c5-4436-4a35-96ed-4627f8e7c24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:45.208131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664a1c5-4436-4a35-96ed-4627f8e7c24e None admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:45.208661 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664a1c5-4436-4a35-96ed-4627f8e7c24e None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:45.209117 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664a1c5-4436-4a35-96ed-4627f8e7c24e None admin] PATH_INFO: `/v3/projects/9af9b910687447d4b7b9285bfc31988e/users/0745bfc9958247ec85586308336b6dda/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:45.211513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664a1c5-4436-4a35-96ed-4627f8e7c24e None admin] RBAC: Authorizing `identity:create_grant(project_id=9af9b910687447d4b7b9285bfc31988e, user_id=0745bfc9958247ec85586308336b6dda, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:45.213222 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664a1c5-4436-4a35-96ed-4627f8e7c24e None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:45.233196 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 66/130] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:24:45 2022] PUT /identity/v3/projects/9af9b910687447d4b7b9285bfc31988e/users/0745bfc9958247ec85586308336b6dda/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:24:45.234745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664a1c5-4436-4a35-96ed-4627f8e7c24e None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:45.259924 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f5e0d-d558-4bee-8a3c-ff4d25b6df3c None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:45.298872 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283054be-e612-4742-bb7a-5802fe3bde7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:45.299841 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283054be-e612-4742-bb7a-5802fe3bde7b None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:45.300287 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283054be-e612-4742-bb7a-5802fe3bde7b None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:45.300707 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283054be-e612-4742-bb7a-5802fe3bde7b None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:45.301730 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283054be-e612-4742-bb7a-5802fe3bde7b None admin] RBAC: Adding query filter params (name=member) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:45.302763 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283054be-e612-4742-bb7a-5802fe3bde7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:45.304448 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283054be-e612-4742-bb7a-5802fe3bde7b None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:45.314486 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 65/131] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:24:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:45.315598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283054be-e612-4742-bb7a-5802fe3bde7b None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:45.362132 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664a1c5-4436-4a35-96ed-4627f8e7c24e None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:45.383652 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:45.399897 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f57bb-88fd-47d7-b67a-ad21bb0498c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:45.400825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f57bb-88fd-47d7-b67a-ad21bb0498c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:45.401116 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f57bb-88fd-47d7-b67a-ad21bb0498c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:45.401403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f57bb-88fd-47d7-b67a-ad21bb0498c3 None admin] PATH_INFO: `/v3/projects/9af9b910687447d4b7b9285bfc31988e/users/8f51d7d2041048b4af85b1c48e527498/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:45.403547 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f57bb-88fd-47d7-b67a-ad21bb0498c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9af9b910687447d4b7b9285bfc31988e, user_id=8f51d7d2041048b4af85b1c48e527498, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:45.405197 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f57bb-88fd-47d7-b67a-ad21bb0498c3 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:45.439060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 67/132] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:24:45 2022] PUT /identity/v3/projects/9af9b910687447d4b7b9285bfc31988e/users/8f51d7d2041048b4af85b1c48e527498/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:24:45.439680 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283054be-e612-4742-bb7a-5802fe3bde7b None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:45.444221 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f57bb-88fd-47d7-b67a-ad21bb0498c3 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:45.482934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d6035-5836-4b61-888a-0679751eb6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:45.484095 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d6035-5836-4b61-888a-0679751eb6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:45.484523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d6035-5836-4b61-888a-0679751eb6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:45.485373 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d6035-5836-4b61-888a-0679751eb6a3 None admin] PATH_INFO: `/v3/projects/9af9b910687447d4b7b9285bfc31988e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:45.487045 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d6035-5836-4b61-888a-0679751eb6a3 None admin] RBAC: Authorizing `identity:get_project(project_id=9af9b910687447d4b7b9285bfc31988e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:45.488935 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d6035-5836-4b61-888a-0679751eb6a3 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:45.491897 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 66/133] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:24:45 2022] GET /identity/v3/projects/9af9b910687447d4b7b9285bfc31988e => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:45.498288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d6035-5836-4b61-888a-0679751eb6a3 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:45.524556 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:45.621348 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f57bb-88fd-47d7-b67a-ad21bb0498c3 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:45.637316 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d6035-5836-4b61-888a-0679751eb6a3 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:45.669423 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:45.680065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703446aa-e8e2-4e64-b6b1-18c0a921f018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:45.680985 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703446aa-e8e2-4e64-b6b1-18c0a921f018 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:45.681280 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703446aa-e8e2-4e64-b6b1-18c0a921f018 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:45.681567 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703446aa-e8e2-4e64-b6b1-18c0a921f018 None admin] PATH_INFO: `/v3/users/8f51d7d2041048b4af85b1c48e527498` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:45.683863 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f06fe-825f-45c2-8eae-fcc108838eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:45.685003 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f06fe-825f-45c2-8eae-fcc108838eb4 None admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:45.685508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f06fe-825f-45c2-8eae-fcc108838eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:45.686003 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f06fe-825f-45c2-8eae-fcc108838eb4 None admin] PATH_INFO: `/v3/projects/9af9b910687447d4b7b9285bfc31988e/users/8f51d7d2041048b4af85b1c48e527498/roles/580d60e140704327b90a80fc59a2165c` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:45.688130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703446aa-e8e2-4e64-b6b1-18c0a921f018 None admin] RBAC: Authorizing `identity:get_user(user_id=8f51d7d2041048b4af85b1c48e527498)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:45.688830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f06fe-825f-45c2-8eae-fcc108838eb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=9af9b910687447d4b7b9285bfc31988e, user_id=8f51d7d2041048b4af85b1c48e527498, role_id=580d60e140704327b90a80fc59a2165c)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:45.689652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703446aa-e8e2-4e64-b6b1-18c0a921f018 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:45.690670 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f06fe-825f-45c2-8eae-fcc108838eb4 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:45.691486 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 68/134] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:24:45 2022] GET /identity/v3/users/8f51d7d2041048b4af85b1c48e527498 => generated 275 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:45.703868 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703446aa-e8e2-4e64-b6b1-18c0a921f018 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:45.725351 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 67/135] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:24:45 2022] PUT /identity/v3/projects/9af9b910687447d4b7b9285bfc31988e/users/8f51d7d2041048b4af85b1c48e527498/roles/580d60e140704327b90a80fc59a2165c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:24:45.827947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703446aa-e8e2-4e64-b6b1-18c0a921f018 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:45.831896 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:45.868924 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64271a07-3b46-4bb9-8ff5-081267d40e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:45.870194 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64271a07-3b46-4bb9-8ff5-081267d40e9a None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:45.870683 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64271a07-3b46-4bb9-8ff5-081267d40e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:45.871170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64271a07-3b46-4bb9-8ff5-081267d40e9a None admin] PATH_INFO: `/v3/projects/dec6aca401c5481e98425f78acf33e39` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:45.872740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64271a07-3b46-4bb9-8ff5-081267d40e9a None admin] RBAC: Authorizing `identity:get_project(project_id=dec6aca401c5481e98425f78acf33e39)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:45.874422 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64271a07-3b46-4bb9-8ff5-081267d40e9a None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:45.876412 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 69/136] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:24:45 2022] GET /identity/v3/projects/dec6aca401c5481e98425f78acf33e39 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:45.882701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f06fe-825f-45c2-8eae-fcc108838eb4 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:45.897156 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e1d9e-e063-44f4-8bd6-29512df847c9 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:45.897456 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e1d9e-e063-44f4-8bd6-29512df847c9 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:45.897725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e1d9e-e063-44f4-8bd6-29512df847c9 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:45.899127 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 70/137] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:45.904739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634313d-ebdb-48c1-b343-e4c758861bea None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:45.905025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634313d-ebdb-48c1-b343-e4c758861bea None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:45.905312 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634313d-ebdb-48c1-b343-e4c758861bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:45.932535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-c634313d-ebdb-48c1-b343-e4c758861bea None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:45.935146 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-c634313d-ebdb-48c1-b343-e4c758861bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:46.048410 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 71/138] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:24:46.055039 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f06fe-825f-45c2-8eae-fcc108838eb4 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:46.074593 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634313d-ebdb-48c1-b343-e4c758861bea None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:46.096515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af2647-afe8-4a2e-a08f-682897764dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:46.097635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af2647-afe8-4a2e-a08f-682897764dc7 None admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:46.097926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af2647-afe8-4a2e-a08f-682897764dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:46.098209 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af2647-afe8-4a2e-a08f-682897764dc7 None admin] PATH_INFO: `/v3/projects/dec6aca401c5481e98425f78acf33e39/users/8f51d7d2041048b4af85b1c48e527498/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:46.100947 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af2647-afe8-4a2e-a08f-682897764dc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=dec6aca401c5481e98425f78acf33e39, user_id=8f51d7d2041048b4af85b1c48e527498, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:46.102413 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af2647-afe8-4a2e-a08f-682897764dc7 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:46.118535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 68/139] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:24:45 2022] PUT /identity/v3/projects/dec6aca401c5481e98425f78acf33e39/users/8f51d7d2041048b4af85b1c48e527498/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:24:46.185744 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634313d-ebdb-48c1-b343-e4c758861bea None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:46.187357 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:46.233571 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89000f7c-1db4-4003-a704-f74f65f9a0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:46.234413 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89000f7c-1db4-4003-a704-f74f65f9a0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:46.234699 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89000f7c-1db4-4003-a704-f74f65f9a0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:46.234978 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89000f7c-1db4-4003-a704-f74f65f9a0a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:46.236621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89000f7c-1db4-4003-a704-f74f65f9a0a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:46.238175 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89000f7c-1db4-4003-a704-f74f65f9a0a2 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:46.240687 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 72/140] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:24:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:46.246256 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af2647-afe8-4a2e-a08f-682897764dc7 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:46.307897 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:46.375266 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af2647-afe8-4a2e-a08f-682897764dc7 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:46.410371 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3f5a3-c1a0-4c6b-ac1d-e9e63e67416d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:46.411051 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3f5a3-c1a0-4c6b-ac1d-e9e63e67416d None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:46.411361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3f5a3-c1a0-4c6b-ac1d-e9e63e67416d None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:46.412002 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3f5a3-c1a0-4c6b-ac1d-e9e63e67416d None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:46.412728 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3f5a3-c1a0-4c6b-ac1d-e9e63e67416d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:46.414459 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3f5a3-c1a0-4c6b-ac1d-e9e63e67416d None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:46.437696 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 69/141] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 09:24:46 2022] POST /identity/v3/users => generated 283 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:24:46.773403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8c8e8-54fc-435a-b816-2b51a8726915 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:46.774075 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8c8e8-54fc-435a-b816-2b51a8726915 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:46.774554 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8c8e8-54fc-435a-b816-2b51a8726915 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:46.776149 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 73/142] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:46.781601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf6615-82e0-4356-a89b-61e4c382a895 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:46.782093 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf6615-82e0-4356-a89b-61e4c382a895 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:46.782516 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf6615-82e0-4356-a89b-61e4c382a895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:46.807434 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-cfaf6615-82e0-4356-a89b-61e4c382a895 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:46.808852 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-cfaf6615-82e0-4356-a89b-61e4c382a895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:46.888577 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 70/143] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:46.910603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8c8e8-54fc-435a-b816-2b51a8726915 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:47.056026 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8c8e8-54fc-435a-b816-2b51a8726915 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:47.111985 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd6d74-b2ad-421e-8277-a24a2e77036e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:47.112791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd6d74-b2ad-421e-8277-a24a2e77036e None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:47.113072 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd6d74-b2ad-421e-8277-a24a2e77036e None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:47.113347 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd6d74-b2ad-421e-8277-a24a2e77036e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:47.129510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd6d74-b2ad-421e-8277-a24a2e77036e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:47.141820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-1dbd6d74-b2ad-421e-8277-a24a2e77036e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:24:47.141820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:47.141820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:47.141820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:47.141820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:47.141820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:47.141820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:47.141820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:47.141820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:47.141820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:47.141820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:47.141820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:47.141820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:47.141820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:47.141820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:47.141820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:47.142759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:47.142759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:47.142759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:47.142759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:47.142759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:47.142759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:47.142759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:47.142759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:47.142759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:47.142759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:47.142759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:47.142759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:24:47.142759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:47.142759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:47.142759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:47.142759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:47.143603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:47.143603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:47.143603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:47.143603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:47.143603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:47.143603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:47.143603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:47.143603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:47.143603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:47.143603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:47.143603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:24:47.143603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:24:47.143603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 74/144] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:24:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:47.149348 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf6615-82e0-4356-a89b-61e4c382a895 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:47.203429 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:47.292555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf6615-82e0-4356-a89b-61e4c382a895 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:47.333537 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d378cc6-15ef-4a0e-9755-9a2930a296ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:47.334544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d378cc6-15ef-4a0e-9755-9a2930a296ec None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:47.335042 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d378cc6-15ef-4a0e-9755-9a2930a296ec None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:47.335543 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d378cc6-15ef-4a0e-9755-9a2930a296ec None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:47.336497 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d378cc6-15ef-4a0e-9755-9a2930a296ec None admin] RBAC: Adding query filter params (name=reader) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:47.337000 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d378cc6-15ef-4a0e-9755-9a2930a296ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:47.338596 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d378cc6-15ef-4a0e-9755-9a2930a296ec None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:47.350093 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 71/145] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:24:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:47.356376 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd6d74-b2ad-421e-8277-a24a2e77036e None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:47.403766 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:47.480196 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd6d74-b2ad-421e-8277-a24a2e77036e None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:47.526285 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af599e23-437b-4733-b0c1-38bdb62160fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:47.527147 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af599e23-437b-4733-b0c1-38bdb62160fd None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:47.527455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af599e23-437b-4733-b0c1-38bdb62160fd None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:47.527734 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af599e23-437b-4733-b0c1-38bdb62160fd None admin] PATH_INFO: `/v3/users/c3984ecb89054bf1a186c3606cf1300e` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:47.528935 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af599e23-437b-4733-b0c1-38bdb62160fd None admin] RBAC: Authorizing `identity:get_user(user_id=c3984ecb89054bf1a186c3606cf1300e)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:47.530420 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af599e23-437b-4733-b0c1-38bdb62160fd None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:47.532052 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 75/146] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:24:47 2022] GET /identity/v3/users/c3984ecb89054bf1a186c3606cf1300e => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:47.537591 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d378cc6-15ef-4a0e-9755-9a2930a296ec None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:47.683929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d378cc6-15ef-4a0e-9755-9a2930a296ec None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:47.703322 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:47.731625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dc43a-e698-48ec-969c-e5261e8d9673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:47.732980 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dc43a-e698-48ec-969c-e5261e8d9673 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:47.733465 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dc43a-e698-48ec-969c-e5261e8d9673 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:47.733945 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dc43a-e698-48ec-969c-e5261e8d9673 None admin] PATH_INFO: `/v3/projects/9af9b910687447d4b7b9285bfc31988e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:47.735945 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48dc43a-e698-48ec-969c-e5261e8d9673 None admin] RBAC: Authorizing `identity:get_project(project_id=9af9b910687447d4b7b9285bfc31988e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:47.737616 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48dc43a-e698-48ec-969c-e5261e8d9673 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:47.744137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 72/147] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:24:47 2022] GET /identity/v3/projects/9af9b910687447d4b7b9285bfc31988e => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:47.749643 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af599e23-437b-4733-b0c1-38bdb62160fd None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:47.873360 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:47.883588 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af599e23-437b-4733-b0c1-38bdb62160fd None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:47.924559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5da271-abb2-4166-8994-7e320de51e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:47.925461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5da271-abb2-4166-8994-7e320de51e00 None admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:47.925744 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5da271-abb2-4166-8994-7e320de51e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:47.926020 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5da271-abb2-4166-8994-7e320de51e00 None admin] PATH_INFO: `/v3/projects/9af9b910687447d4b7b9285bfc31988e/users/c3984ecb89054bf1a186c3606cf1300e/roles/2ed814d9cd4844f5b4ddfc8627b8fc6a` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:47.928620 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5da271-abb2-4166-8994-7e320de51e00 None admin] RBAC: Authorizing `identity:create_grant(project_id=9af9b910687447d4b7b9285bfc31988e, user_id=c3984ecb89054bf1a186c3606cf1300e, role_id=2ed814d9cd4844f5b4ddfc8627b8fc6a)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:47.930146 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5da271-abb2-4166-8994-7e320de51e00 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:47.956460 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 76/148] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:24:47 2022] PUT /identity/v3/projects/9af9b910687447d4b7b9285bfc31988e/users/c3984ecb89054bf1a186c3606cf1300e/roles/2ed814d9cd4844f5b4ddfc8627b8fc6a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:24:48.614981 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd40524-d490-4d71-98e0-01f14a69f4bc None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:48.616026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd40524-d490-4d71-98e0-01f14a69f4bc None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:48.616518 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd40524-d490-4d71-98e0-01f14a69f4bc None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:48.618378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 73/149] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:48.623641 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886d0f9-a283-4f39-bdd2-6cbaab8b0752 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:48.624169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886d0f9-a283-4f39-bdd2-6cbaab8b0752 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:48.624648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886d0f9-a283-4f39-bdd2-6cbaab8b0752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:48.649258 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-b886d0f9-a283-4f39-bdd2-6cbaab8b0752 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:48.650827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-b886d0f9-a283-4f39-bdd2-6cbaab8b0752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:48.761195 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 77/150] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:48.829145 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd40524-d490-4d71-98e0-01f14a69f4bc None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:48.960221 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd40524-d490-4d71-98e0-01f14a69f4bc None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:48.997024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0cf8b-3489-4d8b-9a6f-232d3a3e1280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:48.998186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0cf8b-3489-4d8b-9a6f-232d3a3e1280 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:48.998671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0cf8b-3489-4d8b-9a6f-232d3a3e1280 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:48.999147 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0cf8b-3489-4d8b-9a6f-232d3a3e1280 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:49.019196 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0cf8b-3489-4d8b-9a6f-232d3a3e1280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:49.028303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-60e0cf8b-3489-4d8b-9a6f-232d3a3e1280 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:49.028303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:49.028303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:49.028303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:49.028303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:49.028303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:49.028303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:49.028303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:49.028303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:49.028303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:49.028303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:49.028303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:49.028303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:49.028303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:49.028303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:49.028303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:49.029243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:49.029243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:49.029243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:49.029243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:49.029243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:49.029243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:49.029243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:49.029243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:49.029243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:49.029243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:49.029243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:49.029243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:24:49.029243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:49.029243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:49.029243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:49.029243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:49.029996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:49.029996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:49.029996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:49.029996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:49.029996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:49.029996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:49.029996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:49.029996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:49.029996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:49.029996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:49.029996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:49.029996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:24:49.036121 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 74/151] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:24:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:49.046811 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886d0f9-a283-4f39-bdd2-6cbaab8b0752 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:49.196022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:49.217202 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886d0f9-a283-4f39-bdd2-6cbaab8b0752 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:49.260491 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956d1aa-4589-4e9d-baca-8c645a94b955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:49.261526 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956d1aa-4589-4e9d-baca-8c645a94b955 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:49.262014 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956d1aa-4589-4e9d-baca-8c645a94b955 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:49.262493 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956d1aa-4589-4e9d-baca-8c645a94b955 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:49.263527 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956d1aa-4589-4e9d-baca-8c645a94b955 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:49.264116 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956d1aa-4589-4e9d-baca-8c645a94b955 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:49.265728 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956d1aa-4589-4e9d-baca-8c645a94b955 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:49.275839 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 78/152] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:24:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:49.281470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0cf8b-3489-4d8b-9a6f-232d3a3e1280 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:49.315965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:49.406119 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0cf8b-3489-4d8b-9a6f-232d3a3e1280 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:49.447032 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4d923-9d9b-4566-9b40-6db06438f014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:49.447961 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4d923-9d9b-4566-9b40-6db06438f014 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:49.448233 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4d923-9d9b-4566-9b40-6db06438f014 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:49.448509 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4d923-9d9b-4566-9b40-6db06438f014 None admin] PATH_INFO: `/v3/users/0745bfc9958247ec85586308336b6dda` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:49.449718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4d923-9d9b-4566-9b40-6db06438f014 None admin] RBAC: Authorizing `identity:get_user(user_id=0745bfc9958247ec85586308336b6dda)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:49.451171 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4d923-9d9b-4566-9b40-6db06438f014 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:49.452838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 75/153] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:24:49 2022] GET /identity/v3/users/0745bfc9958247ec85586308336b6dda => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:49.459233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956d1aa-4589-4e9d-baca-8c645a94b955 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:49.534646 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bcad68-daca-43aa-a133-96c8d6dd2bea None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:49.534961 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bcad68-daca-43aa-a133-96c8d6dd2bea None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:49.535209 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bcad68-daca-43aa-a133-96c8d6dd2bea None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:49.537216 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 76/154] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:49.548921 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ce891-d988-4764-bb84-88ece955a20c None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:49.549215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ce891-d988-4764-bb84-88ece955a20c None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:49.549493 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ce891-d988-4764-bb84-88ece955a20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:49.579413 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-738ce891-d988-4764-bb84-88ece955a20c None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:49.580639 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-738ce891-d988-4764-bb84-88ece955a20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:49.631578 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956d1aa-4589-4e9d-baca-8c645a94b955 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:49.669736 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe3108-16e9-4ff4-93fb-bb9278618bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:49.670402 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe3108-16e9-4ff4-93fb-bb9278618bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:49.670691 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe3108-16e9-4ff4-93fb-bb9278618bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:49.670973 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe3108-16e9-4ff4-93fb-bb9278618bb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:49.691619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:49.729690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 77/155] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:24:49.749197 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe3108-16e9-4ff4-93fb-bb9278618bb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:49.750981 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe3108-16e9-4ff4-93fb-bb9278618bb7 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:49.792809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ce891-d988-4764-bb84-88ece955a20c None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:49.831634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:49.861520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 79/156] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:24:49.868602 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe3108-16e9-4ff4-93fb-bb9278618bb7 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:49.937999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:49.944567 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ce891-d988-4764-bb84-88ece955a20c None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:50.015498 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe3108-16e9-4ff4-93fb-bb9278618bb7 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:50.016564 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4c621-4622-42b6-a8da-a6026b6b1a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:50.017385 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4c621-4622-42b6-a8da-a6026b6b1a13 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:50.017663 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4c621-4622-42b6-a8da-a6026b6b1a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:50.017934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4c621-4622-42b6-a8da-a6026b6b1a13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:50.033687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4c621-4622-42b6-a8da-a6026b6b1a13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:50.050688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ba6ef-72c2-4d00-85a5-13b4f8378692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:50.051505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ba6ef-72c2-4d00-85a5-13b4f8378692 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:50.052337 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ba6ef-72c2-4d00-85a5-13b4f8378692 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:50.052621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ba6ef-72c2-4d00-85a5-13b4f8378692 None admin] PATH_INFO: `/v3/projects/9af9b910687447d4b7b9285bfc31988e` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:50.053836 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ba6ef-72c2-4d00-85a5-13b4f8378692 None admin] RBAC: Authorizing `identity:get_project(project_id=9af9b910687447d4b7b9285bfc31988e)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:50.053954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-51a4c621-4622-42b6-a8da-a6026b6b1a13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:24:50.053954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:50.053954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:50.053954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:50.053954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:50.053954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:50.053954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:50.053954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:50.053954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:50.053954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:50.053954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:50.053954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:50.053954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:50.053954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:50.053954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:50.053954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:50.054824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:50.054824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:50.054824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:50.054824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:50.054824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:50.054824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:50.054824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:50.054824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:50.054824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:50.054824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:50.054824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:50.054824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:24:50.054824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:50.054824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:50.054824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:50.054824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:50.056011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:50.056011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:50.056011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:50.056011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:50.056011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:50.056011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:50.056011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:50.056011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:50.056011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:50.056011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:50.056011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:24:50.056011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:24:50.056011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 78/157] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:24:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:50.056702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ba6ef-72c2-4d00-85a5-13b4f8378692 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:50.056779 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffed7db-817e-44c3-80ec-39130a306099 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:50.056779 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffed7db-817e-44c3-80ec-39130a306099 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:50.056911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffed7db-817e-44c3-80ec-39130a306099 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:50.057495 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 80/158] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:24:49 2022] GET /identity/v3/projects/9af9b910687447d4b7b9285bfc31988e => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:50.058338 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 79/159] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:50.063598 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506e13f-51bd-4b7e-97ca-a64ccb173ce3 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:50.063892 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506e13f-51bd-4b7e-97ca-a64ccb173ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:50.064177 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506e13f-51bd-4b7e-97ca-a64ccb173ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:50.075844 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffed7db-817e-44c3-80ec-39130a306099 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:50.085536 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-1506e13f-51bd-4b7e-97ca-a64ccb173ce3 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:50.086802 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-1506e13f-51bd-4b7e-97ca-a64ccb173ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:50.191514 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 81/160] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:50.193425 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506e13f-51bd-4b7e-97ca-a64ccb173ce3 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:50.202823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:50.241151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffed7db-817e-44c3-80ec-39130a306099 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:50.294241 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240edbe-ae71-4758-b165-e47c69fc1fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:50.294923 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240edbe-ae71-4758-b165-e47c69fc1fee None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:50.295204 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240edbe-ae71-4758-b165-e47c69fc1fee None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:50.295577 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240edbe-ae71-4758-b165-e47c69fc1fee None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:50.296321 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240edbe-ae71-4758-b165-e47c69fc1fee None admin] RBAC: Adding query filter params (name=member) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:50.296625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240edbe-ae71-4758-b165-e47c69fc1fee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:50.297281 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:50.298062 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240edbe-ae71-4758-b165-e47c69fc1fee None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:50.332005 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 80/161] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:24:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:50.332648 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240edbe-ae71-4758-b165-e47c69fc1fee None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:50.422933 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506e13f-51bd-4b7e-97ca-a64ccb173ce3 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:50.489923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b69ef4-a9c7-4b7e-81fa-867902c7e2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:50.490938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b69ef4-a9c7-4b7e-81fa-867902c7e2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:50.491454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b69ef4-a9c7-4b7e-81fa-867902c7e2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:50.491955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b69ef4-a9c7-4b7e-81fa-867902c7e2c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:50.493004 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b69ef4-a9c7-4b7e-81fa-867902c7e2c0 None admin] RBAC: Adding query filter params (role.id=bb6c5483d9be4a16ac64750536c5e2e2, scope.project.id=9af9b910687447d4b7b9285bfc31988e, user.id=0745bfc9958247ec85586308336b6dda) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:50.493521 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b69ef4-a9c7-4b7e-81fa-867902c7e2c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:50.495206 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b69ef4-a9c7-4b7e-81fa-867902c7e2c0 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:50.507810 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 82/162] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:24:50 2022] GET /identity/v3/role_assignments?user.id=0745bfc9958247ec85586308336b6dda&scope.project.id=9af9b910687447d4b7b9285bfc31988e&role.id=bb6c5483d9be4a16ac64750536c5e2e2 => generated 608 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:50.509014 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b69ef4-a9c7-4b7e-81fa-867902c7e2c0 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:50.555813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240edbe-ae71-4758-b165-e47c69fc1fee None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:50.648198 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041e264-ef31-4396-8ac3-69a864061fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:50.648948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041e264-ef31-4396-8ac3-69a864061fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:50.649231 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041e264-ef31-4396-8ac3-69a864061fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:50.649503 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041e264-ef31-4396-8ac3-69a864061fe5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:50.666331 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:50.676397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041e264-ef31-4396-8ac3-69a864061fe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:50.693724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-8041e264-ef31-4396-8ac3-69a864061fe5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:24:50.693724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:50.693724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:50.693724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:50.693724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:50.693724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:50.693724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:50.693724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:50.693724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:50.693724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:50.693724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:50.693724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:50.693724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:50.693724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:50.693724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:50.693724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:50.694681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:50.694681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:50.694681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:50.694681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:50.694681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:50.694681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:50.694681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:50.694681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:50.694681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:50.694681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:50.694681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:50.694681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:24:50.694681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:50.694681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:50.694681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:50.694681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:50.697332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:50.697332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:50.697332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:50.697332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:50.697332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:50.697332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:50.697332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:50.697332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:50.697332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:50.697332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:50.697332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:24:50.697332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:24:50.697332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 81/163] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 09:24:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:50.697332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f115b-e0ca-418f-b43f-4087b61fa5e0 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:50.698081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f115b-e0ca-418f-b43f-4087b61fa5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:50.698081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f115b-e0ca-418f-b43f-4087b61fa5e0 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:50.700661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 82/164] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:50.710081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727529e3-4f53-4bce-86d9-c30415c22203 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:50.710081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727529e3-4f53-4bce-86d9-c30415c22203 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:50.710081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727529e3-4f53-4bce-86d9-c30415c22203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:50.736212 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b69ef4-a9c7-4b7e-81fa-867902c7e2c0 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:50.755593 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-727529e3-4f53-4bce-86d9-c30415c22203 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:50.756828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-727529e3-4f53-4bce-86d9-c30415c22203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:50.764183 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:50.823119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a03fc5-343c-4ba7-845f-5ad319ffbfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:50.824060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a03fc5-343c-4ba7-845f-5ad319ffbfd6 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:50.824348 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a03fc5-343c-4ba7-845f-5ad319ffbfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:50.824621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a03fc5-343c-4ba7-845f-5ad319ffbfd6 None admin] PATH_INFO: `/v3/users/8f51d7d2041048b4af85b1c48e527498` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:50.828518 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a03fc5-343c-4ba7-845f-5ad319ffbfd6 None admin] RBAC: Authorizing `identity:get_user(user_id=8f51d7d2041048b4af85b1c48e527498)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:50.830680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a03fc5-343c-4ba7-845f-5ad319ffbfd6 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:50.832485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 83/165] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:24:50 2022] GET /identity/v3/users/8f51d7d2041048b4af85b1c48e527498 => generated 275 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:50.834010 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a03fc5-343c-4ba7-845f-5ad319ffbfd6 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:50.909919 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 83/166] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:24:50.910482 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727529e3-4f53-4bce-86d9-c30415c22203 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:50.960212 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a03fc5-343c-4ba7-845f-5ad319ffbfd6 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:51.003920 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e836b29-870e-4db0-90c6-d2f28b6b3c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:51.004607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e836b29-870e-4db0-90c6-d2f28b6b3c9a None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:51.004931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e836b29-870e-4db0-90c6-d2f28b6b3c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:51.005207 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e836b29-870e-4db0-90c6-d2f28b6b3c9a None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:51.005961 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e836b29-870e-4db0-90c6-d2f28b6b3c9a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:51.006348 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e836b29-870e-4db0-90c6-d2f28b6b3c9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:51.007999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e836b29-870e-4db0-90c6-d2f28b6b3c9a None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:51.017287 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 84/167] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:24:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:51.018210 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e836b29-870e-4db0-90c6-d2f28b6b3c9a None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:51.053988 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727529e3-4f53-4bce-86d9-c30415c22203 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:51.078067 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:51.093364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:51.110498 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79beaf97-c8da-49f0-aca6-d6292a7ae5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:51.111450 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79beaf97-c8da-49f0-aca6-d6292a7ae5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:51.111739 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79beaf97-c8da-49f0-aca6-d6292a7ae5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:51.112008 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79beaf97-c8da-49f0-aca6-d6292a7ae5a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:51.147796 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e836b29-870e-4db0-90c6-d2f28b6b3c9a None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:51.185022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d5f5f-37b6-4311-b3b9-b19a7b1e48f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:51.185898 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d5f5f-37b6-4311-b3b9-b19a7b1e48f9 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:51.186190 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d5f5f-37b6-4311-b3b9-b19a7b1e48f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:51.186572 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d5f5f-37b6-4311-b3b9-b19a7b1e48f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:51.195495 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79beaf97-c8da-49f0-aca6-d6292a7ae5a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:51.196977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79beaf97-c8da-49f0-aca6-d6292a7ae5a0 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:51.199668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d5f5f-37b6-4311-b3b9-b19a7b1e48f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:51.207821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-0d1d5f5f-37b6-4311-b3b9-b19a7b1e48f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:24:51.207821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:51.207821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:51.207821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:51.207821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:51.207821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:51.207821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:51.207821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:51.207821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:51.207821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:51.207821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:51.207821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:51.207821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:51.207821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:51.207821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:51.207821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:51.209286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:51.209286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:51.209286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:51.209286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:51.209286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:51.209286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:51.209286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:51.209286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:51.209286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:51.209286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:51.209286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:51.209286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:24:51.209286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:51.209286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:51.209286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:51.209286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:51.211676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:51.211676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:51.211676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:51.211676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:51.211676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:51.211676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:51.211676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:51.211676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:51.211676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:51.211676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:51.211676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:24:51.211676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:24:51.211676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 85/168] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:24:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:51.211676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d5f5f-37b6-4311-b3b9-b19a7b1e48f9 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:51.326346 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d5f5f-37b6-4311-b3b9-b19a7b1e48f9 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:51.327885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:51.348623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 84/169] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:24:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:24:51.349258 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79beaf97-c8da-49f0-aca6-d6292a7ae5a0 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:51.366778 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c88a07-d6f9-4359-a3c0-59789d6733a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:51.367695 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c88a07-d6f9-4359-a3c0-59789d6733a6 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:51.367980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c88a07-d6f9-4359-a3c0-59789d6733a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:51.368255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c88a07-d6f9-4359-a3c0-59789d6733a6 None admin] PATH_INFO: `/v3/users/8f51d7d2041048b4af85b1c48e527498` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:51.369463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c88a07-d6f9-4359-a3c0-59789d6733a6 None admin] RBAC: Authorizing `identity:get_user(user_id=8f51d7d2041048b4af85b1c48e527498)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:51.371073 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c88a07-d6f9-4359-a3c0-59789d6733a6 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:51.372909 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 86/170] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:24:51 2022] GET /identity/v3/users/8f51d7d2041048b4af85b1c48e527498 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:51.373736 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c88a07-d6f9-4359-a3c0-59789d6733a6 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:51.400317 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:51.488114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c88a07-d6f9-4359-a3c0-59789d6733a6 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:51.526512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f6cc3-0ba2-47cf-a5ba-472552a2f64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:51.527513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f6cc3-0ba2-47cf-a5ba-472552a2f64e None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:51.527802 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f6cc3-0ba2-47cf-a5ba-472552a2f64e None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:51.528082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f6cc3-0ba2-47cf-a5ba-472552a2f64e None admin] PATH_INFO: `/v3/projects/9af9b910687447d4b7b9285bfc31988e` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:51.529347 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f6cc3-0ba2-47cf-a5ba-472552a2f64e None admin] RBAC: Authorizing `identity:get_project(project_id=9af9b910687447d4b7b9285bfc31988e)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:51.530892 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f6cc3-0ba2-47cf-a5ba-472552a2f64e None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:51.532608 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 87/171] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:24:51 2022] GET /identity/v3/projects/9af9b910687447d4b7b9285bfc31988e => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:51.533378 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f6cc3-0ba2-47cf-a5ba-472552a2f64e None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:51.568384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79beaf97-c8da-49f0-aca6-d6292a7ae5a0 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:51.577341 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:51.624989 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5363d-5b00-4e80-9941-3203ab2211c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:51.625674 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5363d-5b00-4e80-9941-3203ab2211c7 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:51.625955 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5363d-5b00-4e80-9941-3203ab2211c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:51.626228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5363d-5b00-4e80-9941-3203ab2211c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:51.626977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5363d-5b00-4e80-9941-3203ab2211c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:51.627360 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5363d-5b00-4e80-9941-3203ab2211c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:51.628677 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5363d-5b00-4e80-9941-3203ab2211c7 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:51.642943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 85/172] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:24:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:51.643804 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5363d-5b00-4e80-9941-3203ab2211c7 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:51.647441 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f6cc3-0ba2-47cf-a5ba-472552a2f64e None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:51.684928 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dd53c-bfea-4234-bdfc-d8de2cd1f3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:51.685741 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dd53c-bfea-4234-bdfc-d8de2cd1f3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:51.686082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dd53c-bfea-4234-bdfc-d8de2cd1f3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:51.686365 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dd53c-bfea-4234-bdfc-d8de2cd1f3f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:51.764164 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dd53c-bfea-4234-bdfc-d8de2cd1f3f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:51.765576 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dd53c-bfea-4234-bdfc-d8de2cd1f3f8 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:51.802362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:51.810913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:51.822958 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5363d-5b00-4e80-9941-3203ab2211c7 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:51.881940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 88/173] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:24:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:24:51.883026 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dd53c-bfea-4234-bdfc-d8de2cd1f3f8 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:51.908712 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f78966-05aa-441b-a9f9-1334fac018bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:51.909295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f78966-05aa-441b-a9f9-1334fac018bd None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:51.909580 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f78966-05aa-441b-a9f9-1334fac018bd None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:51.909850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f78966-05aa-441b-a9f9-1334fac018bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:51.910685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f78966-05aa-441b-a9f9-1334fac018bd None admin] RBAC: Adding query filter params (role.id=207b29fd2d8344ceb403e1c2e9d91ac2, scope.project.id=9af9b910687447d4b7b9285bfc31988e, user.id=8f51d7d2041048b4af85b1c48e527498) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:51.915323 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f78966-05aa-441b-a9f9-1334fac018bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:51.915323 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f78966-05aa-441b-a9f9-1334fac018bd None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:51.925609 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 86/174] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:24:51 2022] GET /identity/v3/role_assignments?user.id=8f51d7d2041048b4af85b1c48e527498&scope.project.id=9af9b910687447d4b7b9285bfc31988e&role.id=207b29fd2d8344ceb403e1c2e9d91ac2 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:51.927509 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3cddb-b5df-4b2f-a0bf-4678d57772e3 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:51.927794 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3cddb-b5df-4b2f-a0bf-4678d57772e3 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:51.928066 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3cddb-b5df-4b2f-a0bf-4678d57772e3 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:51.929534 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 87/175] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:51.930253 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3cddb-b5df-4b2f-a0bf-4678d57772e3 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:52.048910 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dd53c-bfea-4234-bdfc-d8de2cd1f3f8 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:52.138708 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4d651-8044-4cf2-821a-609d6a8e8290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:52.139636 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4d651-8044-4cf2-821a-609d6a8e8290 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:52.139952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4d651-8044-4cf2-821a-609d6a8e8290 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:52.141161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4d651-8044-4cf2-821a-609d6a8e8290 None admin] PATH_INFO: `/v3/users/8f51d7d2041048b4af85b1c48e527498` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:52.141815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4d651-8044-4cf2-821a-609d6a8e8290 None admin] RBAC: Authorizing `identity:get_user(user_id=8f51d7d2041048b4af85b1c48e527498)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:52.143513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4d651-8044-4cf2-821a-609d6a8e8290 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:52.145608 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 89/176] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:24:51 2022] GET /identity/v3/users/8f51d7d2041048b4af85b1c48e527498 => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:52.146961 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b279a30-4da6-4579-8d45-0109f3667039 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:52.147250 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b279a30-4da6-4579-8d45-0109f3667039 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:52.147683 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b279a30-4da6-4579-8d45-0109f3667039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:52.169692 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:52.171390 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3cddb-b5df-4b2f-a0bf-4678d57772e3 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:52.178973 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-9b279a30-4da6-4579-8d45-0109f3667039 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:52.180487 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-9b279a30-4da6-4579-8d45-0109f3667039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:52.246653 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f730be-3364-48e6-8714-a6a5d51b4fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:52.247643 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f730be-3364-48e6-8714-a6a5d51b4fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:52.247876 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f730be-3364-48e6-8714-a6a5d51b4fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:52.248150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f730be-3364-48e6-8714-a6a5d51b4fd7 None admin] PATH_INFO: `/v3/projects/9af9b910687447d4b7b9285bfc31988e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:52.249384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f730be-3364-48e6-8714-a6a5d51b4fd7 None admin] RBAC: Authorizing `identity:get_project(project_id=9af9b910687447d4b7b9285bfc31988e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:52.250927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f730be-3364-48e6-8714-a6a5d51b4fd7 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:52.253001 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 88/177] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:24:51 2022] GET /identity/v3/projects/9af9b910687447d4b7b9285bfc31988e => generated 298 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:52.253774 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f730be-3364-48e6-8714-a6a5d51b4fd7 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:52.255948 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 90/178] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:52.257713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265231c5-7098-498e-8214-3e3fb20a65d7 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:52.258239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265231c5-7098-498e-8214-3e3fb20a65d7 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:52.258753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265231c5-7098-498e-8214-3e3fb20a65d7 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:52.260287 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 91/179] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:52.264719 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265231c5-7098-498e-8214-3e3fb20a65d7 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:52.287943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:52.399360 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f730be-3364-48e6-8714-a6a5d51b4fd7 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:52.407887 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265231c5-7098-498e-8214-3e3fb20a65d7 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:52.437895 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6203f1-9518-4c0c-b776-a43ee6fbad98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:52.439107 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6203f1-9518-4c0c-b776-a43ee6fbad98 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:52.439626 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6203f1-9518-4c0c-b776-a43ee6fbad98 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:52.440145 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6203f1-9518-4c0c-b776-a43ee6fbad98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:52.453490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3610f2-46ee-469a-83ee-bc3b17df6316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:52.454145 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3610f2-46ee-469a-83ee-bc3b17df6316 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:52.454440 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3610f2-46ee-469a-83ee-bc3b17df6316 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:52.454711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3610f2-46ee-469a-83ee-bc3b17df6316 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:52.455589 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3610f2-46ee-469a-83ee-bc3b17df6316 None admin] RBAC: Adding query filter params (role.id=580d60e140704327b90a80fc59a2165c, scope.project.id=9af9b910687447d4b7b9285bfc31988e, user.id=8f51d7d2041048b4af85b1c48e527498) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:52.455904 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3610f2-46ee-469a-83ee-bc3b17df6316 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:52.458278 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3610f2-46ee-469a-83ee-bc3b17df6316 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:52.462047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:52.467943 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 92/180] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:24:52 2022] GET /identity/v3/role_assignments?user.id=8f51d7d2041048b4af85b1c48e527498&scope.project.id=9af9b910687447d4b7b9285bfc31988e&role.id=580d60e140704327b90a80fc59a2165c => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:52.469284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c16dd3-bcb9-4f6c-a203-649b91530480 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:52.469575 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c16dd3-bcb9-4f6c-a203-649b91530480 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:52.469853 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c16dd3-bcb9-4f6c-a203-649b91530480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:52.493965 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-08c16dd3-bcb9-4f6c-a203-649b91530480 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:52.495198 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-08c16dd3-bcb9-4f6c-a203-649b91530480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:52.558022 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6203f1-9518-4c0c-b776-a43ee6fbad98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:52.559991 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6203f1-9518-4c0c-b776-a43ee6fbad98 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:52.584612 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 93/181] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:52.588899 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c16dd3-bcb9-4f6c-a203-649b91530480 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:52.606902 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:52.704169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c16dd3-bcb9-4f6c-a203-649b91530480 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:52.709212 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 89/182] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:24:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:24:52.710365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac7c32-e9e5-4a3b-9db3-33606d168732 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:52.710630 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac7c32-e9e5-4a3b-9db3-33606d168732 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:52.710905 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac7c32-e9e5-4a3b-9db3-33606d168732 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:52.712320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 90/183] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:52.713255 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323f41c-32dc-4bda-a87d-5d07e232eb77 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:52.713534 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323f41c-32dc-4bda-a87d-5d07e232eb77 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:52.713809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323f41c-32dc-4bda-a87d-5d07e232eb77 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:52.715180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 91/184] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:52.716009 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323f41c-32dc-4bda-a87d-5d07e232eb77 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:52.739435 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:52.751656 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b2711-2758-4ff7-bd0a-1442cfe257ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:52.752835 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b2711-2758-4ff7-bd0a-1442cfe257ce None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:52.753282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b2711-2758-4ff7-bd0a-1442cfe257ce None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:52.753564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b2711-2758-4ff7-bd0a-1442cfe257ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:52.765076 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b2711-2758-4ff7-bd0a-1442cfe257ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:52.774178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-ff5b2711-2758-4ff7-bd0a-1442cfe257ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:52.774178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:52.774178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:52.774178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:52.774178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:52.774178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:52.774178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:52.774178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:52.774178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:52.774178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:52.774178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:52.774178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:52.774178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:52.774178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:52.774178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:52.774178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:52.775095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:52.775095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:52.775095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:52.775095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:52.775095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:52.775095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:52.775095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:52.775095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:52.775095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:52.775095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:52.775095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:52.775095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:24:52.775095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:52.775095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:52.775095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:52.775095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:52.776128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:52.776128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:52.776128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:52.776128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:52.776128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:52.776128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:52.776128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:52.776128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:52.776128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:52.776128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:52.776128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:52.776128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:24:52.776128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 94/185] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:24:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:52.776771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be846cf9-111d-43e1-a842-108dd71f567d None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:52.777081 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be846cf9-111d-43e1-a842-108dd71f567d None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:52.777298 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be846cf9-111d-43e1-a842-108dd71f567d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:52.793607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-be846cf9-111d-43e1-a842-108dd71f567d None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:52.794772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-be846cf9-111d-43e1-a842-108dd71f567d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:52.830793 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323f41c-32dc-4bda-a87d-5d07e232eb77 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:52.853341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:52.861463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 95/186] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:52.862283 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be846cf9-111d-43e1-a842-108dd71f567d None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:52.864869 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70916a6f-1ba5-472f-934b-24d777e6a83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:52.865696 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70916a6f-1ba5-472f-934b-24d777e6a83b None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:52.865981 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70916a6f-1ba5-472f-934b-24d777e6a83b None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:52.866253 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70916a6f-1ba5-472f-934b-24d777e6a83b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:52.867440 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70916a6f-1ba5-472f-934b-24d777e6a83b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:52.868885 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70916a6f-1ba5-472f-934b-24d777e6a83b None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:52.874672 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 92/187] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:24:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:52.874672 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebf423-31ad-451e-a936-461c04ccaed6 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:52.874672 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebf423-31ad-451e-a936-461c04ccaed6 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:52.874672 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebf423-31ad-451e-a936-461c04ccaed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:52.888986 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-75ebf423-31ad-451e-a936-461c04ccaed6 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:52.890154 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-75ebf423-31ad-451e-a936-461c04ccaed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:52.955467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 93/188] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:52.960215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebf423-31ad-451e-a936-461c04ccaed6 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:52.961911 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be846cf9-111d-43e1-a842-108dd71f567d None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:52.982587 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:52.997099 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a08c72-3706-441b-a7ae-73589a62713d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:52.997958 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a08c72-3706-441b-a7ae-73589a62713d None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:52.998238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a08c72-3706-441b-a7ae-73589a62713d None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:52.998514 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a08c72-3706-441b-a7ae-73589a62713d None admin] PATH_INFO: `/v3/projects/dec6aca401c5481e98425f78acf33e39` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:52.999718 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a08c72-3706-441b-a7ae-73589a62713d None admin] RBAC: Authorizing `identity:get_project(project_id=dec6aca401c5481e98425f78acf33e39)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:53.001221 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a08c72-3706-441b-a7ae-73589a62713d None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:53.003142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 96/189] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:24:52 2022] GET /identity/v3/projects/dec6aca401c5481e98425f78acf33e39 => generated 312 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:53.003695 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a08c72-3706-441b-a7ae-73589a62713d None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:53.077357 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebf423-31ad-451e-a936-461c04ccaed6 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:53.097633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:53.111524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a08c72-3706-441b-a7ae-73589a62713d None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:53.113082 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc868e9-57ce-43fc-b371-f4afc40e1ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:53.113883 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc868e9-57ce-43fc-b371-f4afc40e1ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:53.114689 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc868e9-57ce-43fc-b371-f4afc40e1ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:53.114968 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc868e9-57ce-43fc-b371-f4afc40e1ba8 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:53.115740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc868e9-57ce-43fc-b371-f4afc40e1ba8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:53.116047 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc868e9-57ce-43fc-b371-f4afc40e1ba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:53.117418 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc868e9-57ce-43fc-b371-f4afc40e1ba8 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:53.125312 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 94/190] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:24:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:53.126085 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc868e9-57ce-43fc-b371-f4afc40e1ba8 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:53.145217 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81b55e-7855-44c4-8d5d-bf5786137e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:53.145874 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81b55e-7855-44c4-8d5d-bf5786137e53 None admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:53.146152 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81b55e-7855-44c4-8d5d-bf5786137e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:53.146425 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81b55e-7855-44c4-8d5d-bf5786137e53 None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:53.147128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81b55e-7855-44c4-8d5d-bf5786137e53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:53.148588 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81b55e-7855-44c4-8d5d-bf5786137e53 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:53.167791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 97/191] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 09:24:53 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:24:53.168601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81b55e-7855-44c4-8d5d-bf5786137e53 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:53.219214 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:53.247914 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc868e9-57ce-43fc-b371-f4afc40e1ba8 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:53.282659 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81b55e-7855-44c4-8d5d-bf5786137e53 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:53.284925 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc668a-c093-4269-86b3-d9e74998d3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:53.285745 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc668a-c093-4269-86b3-d9e74998d3dc None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:53.286067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc668a-c093-4269-86b3-d9e74998d3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:53.286342 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc668a-c093-4269-86b3-d9e74998d3dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:53.298067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc668a-c093-4269-86b3-d9e74998d3dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:53.306823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-01fc668a-c093-4269-86b3-d9e74998d3dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:24:53.306823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:53.306823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:53.306823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:53.306823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:53.306823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:53.306823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:53.306823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:53.306823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:53.306823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:53.306823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:53.306823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:53.306823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:53.306823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:53.306823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:53.306823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:53.307998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:53.307998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:53.307998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:53.307998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:53.307998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:53.307998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:53.307998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:53.307998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:53.307998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:53.307998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:53.307998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:53.307998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:24:53.307998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:53.307998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:53.307998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:53.307998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:53.308805 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:53.308805 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:53.308805 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:53.308805 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:53.308805 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:53.308805 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:53.308805 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:53.308805 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:53.308805 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:53.308805 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:53.308805 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:24:53.308805 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:24:53.308805 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 95/192] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:24:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:53.309440 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc668a-c093-4269-86b3-d9e74998d3dc None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:53.327159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc69fe8-f0b6-4a18-b082-226dc65145ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:53.328071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc69fe8-f0b6-4a18-b082-226dc65145ec None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:53.328362 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc69fe8-f0b6-4a18-b082-226dc65145ec None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:53.328644 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc69fe8-f0b6-4a18-b082-226dc65145ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:53.340799 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc69fe8-f0b6-4a18-b082-226dc65145ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:53.349993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-6cc69fe8-f0b6-4a18-b082-226dc65145ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:24:53.349993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:53.349993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:53.349993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:53.349993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:53.349993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:53.349993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:53.349993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:53.349993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:53.349993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:53.349993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:53.349993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:53.349993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:53.349993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:53.349993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:53.349993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:53.350926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:53.350926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:53.350926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:53.350926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:53.350926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:53.350926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:53.350926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:53.350926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:53.350926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:53.350926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:53.350926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:53.350926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:24:53.350926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:53.350926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:53.350926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:53.350926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:53.351740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:53.351740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:53.351740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:53.351740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:53.351740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:53.351740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:53.351740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:53.351740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:53.351740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:53.351740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:53.351740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:24:53.351740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:24:53.351740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 98/193] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 09:24:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:53.352375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc69fe8-f0b6-4a18-b082-226dc65145ec None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:53.381524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:53.451174 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc668a-c093-4269-86b3-d9e74998d3dc None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:53.490055 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc69fe8-f0b6-4a18-b082-226dc65145ec None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:53.494082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:53.495224 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a869830-d9b0-43d8-84a3-793e0a07ee48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:53.495995 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a869830-d9b0-43d8-84a3-793e0a07ee48 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:53.496350 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a869830-d9b0-43d8-84a3-793e0a07ee48 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:53.496629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a869830-d9b0-43d8-84a3-793e0a07ee48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:53.497502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a869830-d9b0-43d8-84a3-793e0a07ee48 None admin] RBAC: Adding query filter params (role.id=207b29fd2d8344ceb403e1c2e9d91ac2, scope.project.id=dec6aca401c5481e98425f78acf33e39, user.id=8f51d7d2041048b4af85b1c48e527498) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:53.497825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a869830-d9b0-43d8-84a3-793e0a07ee48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:53.500264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a869830-d9b0-43d8-84a3-793e0a07ee48 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:53.505951 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 96/194] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:24:53 2022] GET /identity/v3/role_assignments?user.id=8f51d7d2041048b4af85b1c48e527498&scope.project.id=dec6aca401c5481e98425f78acf33e39&role.id=207b29fd2d8344ceb403e1c2e9d91ac2 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:53.506577 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a869830-d9b0-43d8-84a3-793e0a07ee48 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:53.535148 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5dc35-3a77-4e67-8a2c-e7e052bb529a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:53.536892 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5dc35-3a77-4e67-8a2c-e7e052bb529a None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:53.537421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5dc35-3a77-4e67-8a2c-e7e052bb529a None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:53.537846 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5dc35-3a77-4e67-8a2c-e7e052bb529a None admin] PATH_INFO: `/v3/users/6499026e824744d98faf14bc61ee4bc5` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:53.555723 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5dc35-3a77-4e67-8a2c-e7e052bb529a None admin] RBAC: Authorizing `identity:get_user(user_id=6499026e824744d98faf14bc61ee4bc5)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:53.557560 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5dc35-3a77-4e67-8a2c-e7e052bb529a None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:53.559639 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 99/195] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:24:53 2022] GET /identity/v3/users/6499026e824744d98faf14bc61ee4bc5 => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:53.560672 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5dc35-3a77-4e67-8a2c-e7e052bb529a None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:53.624086 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a869830-d9b0-43d8-84a3-793e0a07ee48 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:53.632070 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:53.664041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4da2a1-a0c0-498b-ac32-640256996aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:53.664734 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4da2a1-a0c0-498b-ac32-640256996aac None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:53.665071 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4da2a1-a0c0-498b-ac32-640256996aac None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:53.665352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4da2a1-a0c0-498b-ac32-640256996aac None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:53.666117 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4da2a1-a0c0-498b-ac32-640256996aac None admin] RBAC: Adding query filter params (name=reader) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:53.666432 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4da2a1-a0c0-498b-ac32-640256996aac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:53.667923 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4da2a1-a0c0-498b-ac32-640256996aac None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:53.678102 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 97/196] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:24:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:53.679018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4da2a1-a0c0-498b-ac32-640256996aac None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:53.686070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5dc35-3a77-4e67-8a2c-e7e052bb529a None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:53.726801 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714e691-80c1-42da-8811-0a8b2c0ecd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:53.727747 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714e691-80c1-42da-8811-0a8b2c0ecd36 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:53.728205 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714e691-80c1-42da-8811-0a8b2c0ecd36 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:53.728732 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714e691-80c1-42da-8811-0a8b2c0ecd36 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:53.729727 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714e691-80c1-42da-8811-0a8b2c0ecd36 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:53.730181 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714e691-80c1-42da-8811-0a8b2c0ecd36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:53.731756 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714e691-80c1-42da-8811-0a8b2c0ecd36 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:53.743220 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 100/197] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:24:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:53.744439 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714e691-80c1-42da-8811-0a8b2c0ecd36 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:53.778231 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:53.789759 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4da2a1-a0c0-498b-ac32-640256996aac None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:53.825756 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569745ea-5c80-494b-9cf8-f9f9d54c6cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:53.826378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569745ea-5c80-494b-9cf8-f9f9d54c6cec None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:53.826659 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569745ea-5c80-494b-9cf8-f9f9d54c6cec None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:53.826928 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569745ea-5c80-494b-9cf8-f9f9d54c6cec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:53.865697 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:53.868436 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714e691-80c1-42da-8811-0a8b2c0ecd36 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:53.902925 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569745ea-5c80-494b-9cf8-f9f9d54c6cec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:53.904441 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569745ea-5c80-494b-9cf8-f9f9d54c6cec None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:53.907964 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2de78-cc78-4791-baff-a9257b16bcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:53.909019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2de78-cc78-4791-baff-a9257b16bcf7 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:53.909447 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2de78-cc78-4791-baff-a9257b16bcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:53.909881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2de78-cc78-4791-baff-a9257b16bcf7 None admin] PATH_INFO: `/v3/users/c3984ecb89054bf1a186c3606cf1300e` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:53.911873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2de78-cc78-4791-baff-a9257b16bcf7 None admin] RBAC: Authorizing `identity:get_user(user_id=c3984ecb89054bf1a186c3606cf1300e)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:53.913522 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2de78-cc78-4791-baff-a9257b16bcf7 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:53.915573 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 101/198] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:24:53 2022] GET /identity/v3/users/c3984ecb89054bf1a186c3606cf1300e => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:53.916608 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2de78-cc78-4791-baff-a9257b16bcf7 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:54.008124 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 98/199] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:24:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:24:54.008884 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569745ea-5c80-494b-9cf8-f9f9d54c6cec None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:54.021069 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:54.035583 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2de78-cc78-4791-baff-a9257b16bcf7 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:54.084597 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126f431-eec7-4203-bd72-9c879176ef00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:54.086051 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126f431-eec7-4203-bd72-9c879176ef00 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:54.086897 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126f431-eec7-4203-bd72-9c879176ef00 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:54.087701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126f431-eec7-4203-bd72-9c879176ef00 None admin] PATH_INFO: `/v3/users/6499026e824744d98faf14bc61ee4bc5` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:54.092390 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126f431-eec7-4203-bd72-9c879176ef00 None admin] RBAC: Authorizing `identity:get_user(user_id=6499026e824744d98faf14bc61ee4bc5)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:54.094431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126f431-eec7-4203-bd72-9c879176ef00 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:54.097244 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:54.098423 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 102/200] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:24:53 2022] GET /identity/v3/users/6499026e824744d98faf14bc61ee4bc5 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:54.104262 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126f431-eec7-4203-bd72-9c879176ef00 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:54.145698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569745ea-5c80-494b-9cf8-f9f9d54c6cec None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:54.188351 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83203b8a-3f9e-44b5-ac12-1bc1aa8c25f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:54.189012 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83203b8a-3f9e-44b5-ac12-1bc1aa8c25f6 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:54.189287 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83203b8a-3f9e-44b5-ac12-1bc1aa8c25f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:54.189621 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83203b8a-3f9e-44b5-ac12-1bc1aa8c25f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:54.245871 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126f431-eec7-4203-bd72-9c879176ef00 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:54.264270 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83203b8a-3f9e-44b5-ac12-1bc1aa8c25f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:54.265684 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83203b8a-3f9e-44b5-ac12-1bc1aa8c25f6 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:54.294849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613301c-b4ed-4dfe-ac2d-ec41d7ad2c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:54.295759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613301c-b4ed-4dfe-ac2d-ec41d7ad2c5a None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:54.296037 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613301c-b4ed-4dfe-ac2d-ec41d7ad2c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:54.296311 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613301c-b4ed-4dfe-ac2d-ec41d7ad2c5a None admin] PATH_INFO: `/v3/projects/b5242eba374f433f9faf5bc522321dd1` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:54.297586 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613301c-b4ed-4dfe-ac2d-ec41d7ad2c5a None admin] RBAC: Authorizing `identity:get_project(project_id=b5242eba374f433f9faf5bc522321dd1)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:54.299044 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613301c-b4ed-4dfe-ac2d-ec41d7ad2c5a None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:54.300921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 103/201] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:24:54 2022] GET /identity/v3/projects/b5242eba374f433f9faf5bc522321dd1 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:54.302103 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613301c-b4ed-4dfe-ac2d-ec41d7ad2c5a None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:54.339975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:54.347345 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:54.393477 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 99/202] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:24:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:24:54.394634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83203b8a-3f9e-44b5-ac12-1bc1aa8c25f6 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:54.424099 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613301c-b4ed-4dfe-ac2d-ec41d7ad2c5a None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:54.471116 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c16cc-1bde-49fb-83c9-33bfb6f98211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:54.472160 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c16cc-1bde-49fb-83c9-33bfb6f98211 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:54.472711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c16cc-1bde-49fb-83c9-33bfb6f98211 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:54.473191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c16cc-1bde-49fb-83c9-33bfb6f98211 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:54.521803 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83203b8a-3f9e-44b5-ac12-1bc1aa8c25f6 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:54.547806 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c16cc-1bde-49fb-83c9-33bfb6f98211 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:54.549626 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c16cc-1bde-49fb-83c9-33bfb6f98211 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:54.560456 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12fb55-cad0-45b2-8717-b8917e6337a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:54.560992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12fb55-cad0-45b2-8717-b8917e6337a0 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:54.561278 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12fb55-cad0-45b2-8717-b8917e6337a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:54.561553 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12fb55-cad0-45b2-8717-b8917e6337a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:54.562464 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12fb55-cad0-45b2-8717-b8917e6337a0 None admin] RBAC: Adding query filter params (role.id=bb6c5483d9be4a16ac64750536c5e2e2, scope.project.id=b5242eba374f433f9faf5bc522321dd1, user.id=6499026e824744d98faf14bc61ee4bc5) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:54.563022 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12fb55-cad0-45b2-8717-b8917e6337a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:54.564302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12fb55-cad0-45b2-8717-b8917e6337a0 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:54.571205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 100/203] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:24:54 2022] GET /identity/v3/role_assignments?user.id=6499026e824744d98faf14bc61ee4bc5&scope.project.id=b5242eba374f433f9faf5bc522321dd1&role.id=bb6c5483d9be4a16ac64750536c5e2e2 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:54.572159 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12fb55-cad0-45b2-8717-b8917e6337a0 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:54.580958 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:54.611080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:54.663796 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 104/204] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:24:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:24:54.673587 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c16cc-1bde-49fb-83c9-33bfb6f98211 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:54.703456 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12fb55-cad0-45b2-8717-b8917e6337a0 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:54.793994 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e534c20-d513-45c1-b4d0-442a40d91c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:54.794804 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e534c20-d513-45c1-b4d0-442a40d91c4d None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:54.795086 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e534c20-d513-45c1-b4d0-442a40d91c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:54.795387 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e534c20-d513-45c1-b4d0-442a40d91c4d None admin] PATH_INFO: `/v3/projects/9af9b910687447d4b7b9285bfc31988e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:54.796935 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e534c20-d513-45c1-b4d0-442a40d91c4d None admin] RBAC: Authorizing `identity:get_project(project_id=9af9b910687447d4b7b9285bfc31988e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:54.798453 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e534c20-d513-45c1-b4d0-442a40d91c4d None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:54.800648 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 101/205] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:24:54 2022] GET /identity/v3/projects/9af9b910687447d4b7b9285bfc31988e => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:54.811343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e534c20-d513-45c1-b4d0-442a40d91c4d None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:54.885423 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c16cc-1bde-49fb-83c9-33bfb6f98211 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:54.915332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:54.918661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e534c20-d513-45c1-b4d0-442a40d91c4d None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:54.956278 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:54.958496 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1d1d5-e924-4719-aa0b-b7ee8bf85f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:54.959213 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1d1d5-e924-4719-aa0b-b7ee8bf85f90 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:54.959526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1d1d5-e924-4719-aa0b-b7ee8bf85f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:54.959801 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1d1d5-e924-4719-aa0b-b7ee8bf85f90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:54.960634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1d1d5-e924-4719-aa0b-b7ee8bf85f90 None admin] RBAC: Adding query filter params (role.id=2ed814d9cd4844f5b4ddfc8627b8fc6a, scope.project.id=9af9b910687447d4b7b9285bfc31988e, user.id=c3984ecb89054bf1a186c3606cf1300e) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:54.960947 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1d1d5-e924-4719-aa0b-b7ee8bf85f90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:54.962550 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1d1d5-e924-4719-aa0b-b7ee8bf85f90 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:54.969274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 102/206] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:24:54 2022] GET /identity/v3/role_assignments?user.id=c3984ecb89054bf1a186c3606cf1300e&scope.project.id=9af9b910687447d4b7b9285bfc31988e&role.id=2ed814d9cd4844f5b4ddfc8627b8fc6a => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:54.981457 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdc1d0-955d-4cca-84ff-857cf855d56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:54.982357 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdc1d0-955d-4cca-84ff-857cf855d56b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:54.982637 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdc1d0-955d-4cca-84ff-857cf855d56b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:54.982909 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdc1d0-955d-4cca-84ff-857cf855d56b None admin] PATH_INFO: `/v3/projects/b5242eba374f433f9faf5bc522321dd1` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:54.988244 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccdc1d0-955d-4cca-84ff-857cf855d56b None admin] RBAC: Authorizing `identity:get_project(project_id=b5242eba374f433f9faf5bc522321dd1)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:54.989842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccdc1d0-955d-4cca-84ff-857cf855d56b None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:54.991751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 105/207] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:24:54 2022] GET /identity/v3/projects/b5242eba374f433f9faf5bc522321dd1 => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:54.997702 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1d1d5-e924-4719-aa0b-b7ee8bf85f90 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:55.151702 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1d1d5-e924-4719-aa0b-b7ee8bf85f90 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:55.189890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac76aba-d0a7-4760-bef1-d8dacc844e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:55.190612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac76aba-d0a7-4760-bef1-d8dacc844e72 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:55.190900 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac76aba-d0a7-4760-bef1-d8dacc844e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:55.191176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac76aba-d0a7-4760-bef1-d8dacc844e72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:55.192679 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac76aba-d0a7-4760-bef1-d8dacc844e72 None admin] RBAC: Adding query filter params (role.id=580d60e140704327b90a80fc59a2165c, scope.project.id=b5242eba374f433f9faf5bc522321dd1, user.id=6499026e824744d98faf14bc61ee4bc5) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:55.193001 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac76aba-d0a7-4760-bef1-d8dacc844e72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:55.194443 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac76aba-d0a7-4760-bef1-d8dacc844e72 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:55.200549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 103/208] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:24:54 2022] GET /identity/v3/role_assignments?user.id=6499026e824744d98faf14bc61ee4bc5&scope.project.id=b5242eba374f433f9faf5bc522321dd1&role.id=580d60e140704327b90a80fc59a2165c => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:55.825770 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407a1a4-7cbb-4543-a09a-10cdc4b1e556 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:55.826779 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407a1a4-7cbb-4543-a09a-10cdc4b1e556 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:55.827263 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407a1a4-7cbb-4543-a09a-10cdc4b1e556 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:55.829103 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 106/209] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:55.835155 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bb024-41b5-426c-b360-3a2b165887b6 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:55.835472 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bb024-41b5-426c-b360-3a2b165887b6 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:55.835856 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bb024-41b5-426c-b360-3a2b165887b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:55.842233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632f2bf-b4b7-4316-8931-e00ccfb9a125 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:55.842523 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632f2bf-b4b7-4316-8931-e00ccfb9a125 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:55.842799 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632f2bf-b4b7-4316-8931-e00ccfb9a125 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:55.844474 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 107/210] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:24:55.850163 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87647ae6-2d2b-4fe3-9be7-070f3dc197a6 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:55.850454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87647ae6-2d2b-4fe3-9be7-070f3dc197a6 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:55.850736 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87647ae6-2d2b-4fe3-9be7-070f3dc197a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:55.858328 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-8d8bb024-41b5-426c-b360-3a2b165887b6 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:55.859728 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-8d8bb024-41b5-426c-b360-3a2b165887b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:55.868494 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-87647ae6-2d2b-4fe3-9be7-070f3dc197a6 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:55.869893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-87647ae6-2d2b-4fe3-9be7-070f3dc197a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:55.884600 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:55.935454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 104/211] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:55.958757 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bb024-41b5-426c-b360-3a2b165887b6 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:55.962792 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 108/212] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:24:55.989036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87647ae6-2d2b-4fe3-9be7-070f3dc197a6 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:56.072460 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bb024-41b5-426c-b360-3a2b165887b6 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:56.109661 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87647ae6-2d2b-4fe3-9be7-070f3dc197a6 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:56.117999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb6008-a674-4895-9a73-0d79cd3065eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:56.119119 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb6008-a674-4895-9a73-0d79cd3065eb None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:56.119966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb6008-a674-4895-9a73-0d79cd3065eb None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:56.120355 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb6008-a674-4895-9a73-0d79cd3065eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:56.134381 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb6008-a674-4895-9a73-0d79cd3065eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:56.144064 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5530fe-dfda-4352-97e0-0c5e4a44b41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:56.144600 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-91eb6008-a674-4895-9a73-0d79cd3065eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:24:56.144600 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:56.144600 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:56.144600 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:56.144600 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:56.144600 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:56.144600 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:56.144600 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:56.144600 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:56.144600 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:56.144600 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:56.144600 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:56.144600 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:56.144600 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:56.144600 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:56.144600 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:56.146101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:56.146101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:56.146101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:56.146101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:56.146101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:56.146101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:56.146101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:56.146101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:56.146101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:56.146101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:56.146101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:56.146101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:24:56.146101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:56.146101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:56.146101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:56.146101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:56.146865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:56.146865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:56.146865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:56.146865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:56.146865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:56.146865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:56.146865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:56.146865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:56.146865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:56.146865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:56.146865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:24:56.146865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:24:56.148343 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5530fe-dfda-4352-97e0-0c5e4a44b41f None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:56.148831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5530fe-dfda-4352-97e0-0c5e4a44b41f None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:56.149300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5530fe-dfda-4352-97e0-0c5e4a44b41f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:56.151347 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 105/213] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:24:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:56.151597 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:56.152498 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5530fe-dfda-4352-97e0-0c5e4a44b41f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:56.153980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5530fe-dfda-4352-97e0-0c5e4a44b41f None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:56.155715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 109/214] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:24:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:56.160069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb6008-a674-4895-9a73-0d79cd3065eb None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:56.161607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5530fe-dfda-4352-97e0-0c5e4a44b41f None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:56.181015 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:56.263219 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5530fe-dfda-4352-97e0-0c5e4a44b41f None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:56.270658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb6008-a674-4895-9a73-0d79cd3065eb None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:56.300575 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d961388-0d8a-4fc1-be26-e7e3ffc71f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:56.301584 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d961388-0d8a-4fc1-be26-e7e3ffc71f88 None admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:56.302059 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d961388-0d8a-4fc1-be26-e7e3ffc71f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:56.302525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d961388-0d8a-4fc1-be26-e7e3ffc71f88 None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:56.303464 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d961388-0d8a-4fc1-be26-e7e3ffc71f88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:56.305095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d961388-0d8a-4fc1-be26-e7e3ffc71f88 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:56.305198 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1175f78-23a2-460e-afd6-6ecf57b199c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:56.305860 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1175f78-23a2-460e-afd6-6ecf57b199c3 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:56.306145 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1175f78-23a2-460e-afd6-6ecf57b199c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:56.306426 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1175f78-23a2-460e-afd6-6ecf57b199c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:56.307266 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1175f78-23a2-460e-afd6-6ecf57b199c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:56.307620 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1175f78-23a2-460e-afd6-6ecf57b199c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:56.308981 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1175f78-23a2-460e-afd6-6ecf57b199c3 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:56.322585 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 106/215] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:24:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:56.323930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1175f78-23a2-460e-afd6-6ecf57b199c3 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:56.330961 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 110/216] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 09:24:56 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:24:56.420433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:56.440010 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1175f78-23a2-460e-afd6-6ecf57b199c3 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:56.477913 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce1b9f-4500-43d6-a361-64a7958bc32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:56.478808 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce1b9f-4500-43d6-a361-64a7958bc32c None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:56.479098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce1b9f-4500-43d6-a361-64a7958bc32c None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:56.479406 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce1b9f-4500-43d6-a361-64a7958bc32c None admin] PATH_INFO: `/v3/users/05e29a5c7cb84df6ab010e17ed84d19b` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:56.495447 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce1b9f-4500-43d6-a361-64a7958bc32c None admin] RBAC: Authorizing `identity:get_user(user_id=05e29a5c7cb84df6ab010e17ed84d19b)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:56.496929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce1b9f-4500-43d6-a361-64a7958bc32c None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:56.503348 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 107/217] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:24:56 2022] GET /identity/v3/users/05e29a5c7cb84df6ab010e17ed84d19b => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:56.506908 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d961388-0d8a-4fc1-be26-e7e3ffc71f88 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:56.568092 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:56.619801 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d961388-0d8a-4fc1-be26-e7e3ffc71f88 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:56.656188 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e23c0-0354-4450-a092-4afb92afc002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:56.656849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e23c0-0354-4450-a092-4afb92afc002 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:56.657135 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e23c0-0354-4450-a092-4afb92afc002 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:56.657412 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e23c0-0354-4450-a092-4afb92afc002 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:56.730121 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e23c0-0354-4450-a092-4afb92afc002 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:56.731566 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e23c0-0354-4450-a092-4afb92afc002 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:56.783518 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:56.839612 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 111/218] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:24:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:24:56.845412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce1b9f-4500-43d6-a361-64a7958bc32c None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:56.964918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce1b9f-4500-43d6-a361-64a7958bc32c None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:57.010074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45583d50-e626-4ca7-b66b-2c3c8591cc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:57.010868 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45583d50-e626-4ca7-b66b-2c3c8591cc16 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:57.011156 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45583d50-e626-4ca7-b66b-2c3c8591cc16 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:57.011467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45583d50-e626-4ca7-b66b-2c3c8591cc16 None admin] PATH_INFO: `/v3/projects/b5242eba374f433f9faf5bc522321dd1` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:57.012664 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45583d50-e626-4ca7-b66b-2c3c8591cc16 None admin] RBAC: Authorizing `identity:get_project(project_id=b5242eba374f433f9faf5bc522321dd1)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:57.014120 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45583d50-e626-4ca7-b66b-2c3c8591cc16 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:57.016321 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 108/219] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:24:56 2022] GET /identity/v3/projects/b5242eba374f433f9faf5bc522321dd1 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:57.021981 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e23c0-0354-4450-a092-4afb92afc002 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:57.138354 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fca72b-1ea2-4bec-8277-3dbb3bf4c932 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:57.138638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fca72b-1ea2-4bec-8277-3dbb3bf4c932 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:57.139151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fca72b-1ea2-4bec-8277-3dbb3bf4c932 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:57.141223 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 109/220] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:24:57.152943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205639ca-0a9a-4272-b643-ebf44a8f595a None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:57.153466 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205639ca-0a9a-4272-b643-ebf44a8f595a None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:57.153911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205639ca-0a9a-4272-b643-ebf44a8f595a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:57.173136 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:57.188374 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e23c0-0354-4450-a092-4afb92afc002 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:57.189565 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-205639ca-0a9a-4272-b643-ebf44a8f595a None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:57.192275 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-205639ca-0a9a-4272-b643-ebf44a8f595a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:57.249971 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3baf2-7388-4d0b-b619-64a9902a9810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:57.250872 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3baf2-7388-4d0b-b619-64a9902a9810 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:57.251167 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3baf2-7388-4d0b-b619-64a9902a9810 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:57.251474 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3baf2-7388-4d0b-b619-64a9902a9810 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:57.252318 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3baf2-7388-4d0b-b619-64a9902a9810 None admin] RBAC: Adding query filter params (role.id=207b29fd2d8344ceb403e1c2e9d91ac2, scope.project.id=b5242eba374f433f9faf5bc522321dd1, user.id=05e29a5c7cb84df6ab010e17ed84d19b) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:57.252633 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3baf2-7388-4d0b-b619-64a9902a9810 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:57.254099 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3baf2-7388-4d0b-b619-64a9902a9810 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:57.268775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 112/221] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:24:57 2022] GET /identity/v3/role_assignments?user.id=05e29a5c7cb84df6ab010e17ed84d19b&scope.project.id=b5242eba374f433f9faf5bc522321dd1&role.id=207b29fd2d8344ceb403e1c2e9d91ac2 => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:57.297047 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 110/222] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:24:57.347130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3baf2-7388-4d0b-b619-64a9902a9810 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:57.372304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:57.489575 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3baf2-7388-4d0b-b619-64a9902a9810 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:57.532101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a7c8e-8b88-41d0-a79a-dfe0447d035e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:57.532855 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a7c8e-8b88-41d0-a79a-dfe0447d035e None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:57.533144 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a7c8e-8b88-41d0-a79a-dfe0447d035e None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:57.533424 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a7c8e-8b88-41d0-a79a-dfe0447d035e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:57.542381 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ab615-ca48-44e6-a674-e7bebfd61184 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:57.542920 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ab615-ca48-44e6-a674-e7bebfd61184 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:57.543391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ab615-ca48-44e6-a674-e7bebfd61184 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:57.545881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a7c8e-8b88-41d0-a79a-dfe0447d035e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:57.546091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 111/223] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:57.549810 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d37d8-093c-4f57-baff-603823d66468 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:57.550249 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d37d8-093c-4f57-baff-603823d66468 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:57.550666 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d37d8-093c-4f57-baff-603823d66468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:57.554713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-de3a7c8e-8b88-41d0-a79a-dfe0447d035e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:57.554713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:57.554713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:57.554713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:57.554713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:57.554713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:57.554713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:57.554713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:57.554713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:57.554713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:57.554713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:57.554713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:57.554713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:57.554713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:57.554713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:57.554713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:57.555804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:57.555804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:57.555804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:57.555804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:57.555804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:57.555804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:57.555804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:57.555804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:57.555804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:57.555804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:57.555804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:57.555804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:24:57.555804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:57.555804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:57.555804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:57.555804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:57.556789 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:57.556789 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:57.556789 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:57.556789 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:57.556789 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:57.556789 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:57.556789 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:57.556789 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:57.556789 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:57.556789 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:57.556789 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:24:57.556789 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:24:57.556789 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 113/224] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:24:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:57.562167 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a7c8e-8b88-41d0-a79a-dfe0447d035e None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:57.588414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-f52d37d8-093c-4f57-baff-603823d66468 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:57.590666 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f52d37d8-093c-4f57-baff-603823d66468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:57.713300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:57.718187 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 112/225] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:24:57.746710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a7c8e-8b88-41d0-a79a-dfe0447d035e None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:57.768338 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d37d8-093c-4f57-baff-603823d66468 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:57.807097 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e10e8-9ce0-42c1-8b47-e8593f7f8eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:57.807719 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e10e8-9ce0-42c1-8b47-e8593f7f8eaa None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:57.808010 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e10e8-9ce0-42c1-8b47-e8593f7f8eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:57.808288 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e10e8-9ce0-42c1-8b47-e8593f7f8eaa None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:57.809038 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e10e8-9ce0-42c1-8b47-e8593f7f8eaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:57.809348 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e10e8-9ce0-42c1-8b47-e8593f7f8eaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:57.810757 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e10e8-9ce0-42c1-8b47-e8593f7f8eaa None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:57.820318 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 114/226] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:24:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:57.826220 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e10e8-9ce0-42c1-8b47-e8593f7f8eaa None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:57.900153 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:57.942972 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d37d8-093c-4f57-baff-603823d66468 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:57.979596 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95eba4-b03d-4f02-8fab-564a651f00e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:57.981267 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95eba4-b03d-4f02-8fab-564a651f00e6 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:57.981755 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95eba4-b03d-4f02-8fab-564a651f00e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:57.982226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95eba4-b03d-4f02-8fab-564a651f00e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:58.011209 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95eba4-b03d-4f02-8fab-564a651f00e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:58.020864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-7f95eba4-b03d-4f02-8fab-564a651f00e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:24:58.020864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:58.020864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:58.020864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:58.020864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:58.020864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:58.020864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:58.020864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:58.020864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:58.020864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:58.020864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:58.020864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:58.020864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:58.020864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:58.020864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:58.020864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:58.021787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:58.021787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:58.021787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:58.021787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:58.021787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:58.021787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:58.021787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:58.021787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:58.021787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:58.021787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:58.021787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:58.021787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:24:58.021787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:58.021787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:58.021787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:58.021787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:58.022560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:58.022560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:58.022560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:58.022560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:58.022560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:58.022560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:58.022560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:58.022560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:58.022560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:58.022560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:58.022560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:24:58.022560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:24:58.025290 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 113/227] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 09:24:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:24:58.033022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e10e8-9ce0-42c1-8b47-e8593f7f8eaa None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:58.041724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95eba4-b03d-4f02-8fab-564a651f00e6 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:58.141865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d8976-9795-42b3-9c01-c20410724c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:58.142764 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d8976-9795-42b3-9c01-c20410724c4c None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:58.143047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d8976-9795-42b3-9c01-c20410724c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:58.143354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d8976-9795-42b3-9c01-c20410724c4c None admin] PATH_INFO: `/v3/users/6499026e824744d98faf14bc61ee4bc5` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:58.144577 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d8976-9795-42b3-9c01-c20410724c4c None admin] RBAC: Authorizing `identity:get_user(user_id=6499026e824744d98faf14bc61ee4bc5)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:58.146137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d8976-9795-42b3-9c01-c20410724c4c None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:58.147790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 115/228] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:24:57 2022] GET /identity/v3/users/6499026e824744d98faf14bc61ee4bc5 => generated 283 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:58.153333 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d8976-9795-42b3-9c01-c20410724c4c None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:58.163622 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:58.170429 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95eba4-b03d-4f02-8fab-564a651f00e6 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:58.199298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:58.213739 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d3f65-da8c-4bb3-8284-2ae6fc27931d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:58.214628 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d3f65-da8c-4bb3-8284-2ae6fc27931d None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:58.216172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d3f65-da8c-4bb3-8284-2ae6fc27931d None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:58.216619 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d3f65-da8c-4bb3-8284-2ae6fc27931d None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:58.217513 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d3f65-da8c-4bb3-8284-2ae6fc27931d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:24:58.219446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d3f65-da8c-4bb3-8284-2ae6fc27931d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:58.220972 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d3f65-da8c-4bb3-8284-2ae6fc27931d None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:58.240989 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 114/229] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:24:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:58.248007 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d3f65-da8c-4bb3-8284-2ae6fc27931d None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:58.337779 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d8976-9795-42b3-9c01-c20410724c4c None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:58.374707 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffd65d-8b14-4e64-b424-38f93c0d0a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:58.375969 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffd65d-8b14-4e64-b424-38f93c0d0a18 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:58.376401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffd65d-8b14-4e64-b424-38f93c0d0a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:58.376846 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffd65d-8b14-4e64-b424-38f93c0d0a18 None admin] PATH_INFO: `/v3/projects/b5242eba374f433f9faf5bc522321dd1` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:58.378407 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffd65d-8b14-4e64-b424-38f93c0d0a18 None admin] RBAC: Authorizing `identity:get_project(project_id=b5242eba374f433f9faf5bc522321dd1)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:58.380519 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffd65d-8b14-4e64-b424-38f93c0d0a18 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:58.382896 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 116/230] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:24:58 2022] GET /identity/v3/projects/b5242eba374f433f9faf5bc522321dd1 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:58.390588 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffd65d-8b14-4e64-b424-38f93c0d0a18 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:58.458923 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d3f65-da8c-4bb3-8284-2ae6fc27931d None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:58.467746 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:58.494374 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffd65d-8b14-4e64-b424-38f93c0d0a18 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:58.519443 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1192b5c-f2fe-430b-8df6-d970ad8a4ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:58.521359 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1192b5c-f2fe-430b-8df6-d970ad8a4ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:58.523424 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1192b5c-f2fe-430b-8df6-d970ad8a4ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:58.523969 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1192b5c-f2fe-430b-8df6-d970ad8a4ac6 None admin] PATH_INFO: `/v3/users/6499026e824744d98faf14bc61ee4bc5` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:58.531919 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1192b5c-f2fe-430b-8df6-d970ad8a4ac6 None admin] RBAC: Authorizing `identity:get_user(user_id=6499026e824744d98faf14bc61ee4bc5)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:58.533447 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1192b5c-f2fe-430b-8df6-d970ad8a4ac6 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:58.535254 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 115/231] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:24:58 2022] GET /identity/v3/users/6499026e824744d98faf14bc61ee4bc5 => generated 283 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:58.540063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcb922-eca0-41f3-8f0d-c0472a07aa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:58.541315 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcb922-eca0-41f3-8f0d-c0472a07aa2f None admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:58.541796 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcb922-eca0-41f3-8f0d-c0472a07aa2f None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:58.542269 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcb922-eca0-41f3-8f0d-c0472a07aa2f None admin] PATH_INFO: `/v3/projects/b5242eba374f433f9faf5bc522321dd1/users/6499026e824744d98faf14bc61ee4bc5/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:58.544476 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1192b5c-f2fe-430b-8df6-d970ad8a4ac6 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:58.544802 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcb922-eca0-41f3-8f0d-c0472a07aa2f None admin] RBAC: Authorizing `identity:create_grant(project_id=b5242eba374f433f9faf5bc522321dd1, user_id=6499026e824744d98faf14bc61ee4bc5, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:58.546457 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcb922-eca0-41f3-8f0d-c0472a07aa2f None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:58.568591 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 117/232] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:24:58 2022] PUT /identity/v3/projects/b5242eba374f433f9faf5bc522321dd1/users/6499026e824744d98faf14bc61ee4bc5/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:24:58.641114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:58.702375 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1192b5c-f2fe-430b-8df6-d970ad8a4ac6 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:58.756957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4925af9-88b0-449d-8599-90c4ec63fde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:58.758258 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4925af9-88b0-449d-8599-90c4ec63fde6 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:58.758740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4925af9-88b0-449d-8599-90c4ec63fde6 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:58.759225 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4925af9-88b0-449d-8599-90c4ec63fde6 None admin] PATH_INFO: `/v3/projects/b5242eba374f433f9faf5bc522321dd1` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:58.760685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4925af9-88b0-449d-8599-90c4ec63fde6 None admin] RBAC: Authorizing `identity:get_project(project_id=b5242eba374f433f9faf5bc522321dd1)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:58.762356 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4925af9-88b0-449d-8599-90c4ec63fde6 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:58.764286 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 116/233] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:24:58 2022] GET /identity/v3/projects/b5242eba374f433f9faf5bc522321dd1 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:24:58.770944 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcb922-eca0-41f3-8f0d-c0472a07aa2f None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:58.892725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcb922-eca0-41f3-8f0d-c0472a07aa2f None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:58.923310 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:58.929397 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ebd42-3292-4d81-be68-cee8f16220ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:58.930298 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ebd42-3292-4d81-be68-cee8f16220ab None admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:58.930579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ebd42-3292-4d81-be68-cee8f16220ab None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:58.930865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ebd42-3292-4d81-be68-cee8f16220ab None admin] PATH_INFO: `/v3/projects/b5242eba374f433f9faf5bc522321dd1/users/6499026e824744d98faf14bc61ee4bc5/roles/580d60e140704327b90a80fc59a2165c` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:58.933333 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ebd42-3292-4d81-be68-cee8f16220ab None admin] RBAC: Authorizing `identity:create_grant(project_id=b5242eba374f433f9faf5bc522321dd1, user_id=6499026e824744d98faf14bc61ee4bc5, role_id=580d60e140704327b90a80fc59a2165c)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:58.935010 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ebd42-3292-4d81-be68-cee8f16220ab None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:58.950957 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 118/234] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:24:58 2022] PUT /identity/v3/projects/b5242eba374f433f9faf5bc522321dd1/users/6499026e824744d98faf14bc61ee4bc5/roles/580d60e140704327b90a80fc59a2165c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:24:59.317837 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bae97-b34c-4356-bfd7-f709f537d9f6 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:59.318841 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bae97-b34c-4356-bfd7-f709f537d9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:59.319358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bae97-b34c-4356-bfd7-f709f537d9f6 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:59.320956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 117/235] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:59.326628 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0839fac-d150-456e-908e-5cf624295b1c None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:59.327560 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0839fac-d150-456e-908e-5cf624295b1c None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:59.328042 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0839fac-d150-456e-908e-5cf624295b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:59.352158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-f0839fac-d150-456e-908e-5cf624295b1c None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:59.353344 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f0839fac-d150-456e-908e-5cf624295b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:59.374666 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76702d-a72c-4e4b-9d4f-42d218c9d14d None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:59.374966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76702d-a72c-4e4b-9d4f-42d218c9d14d None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:59.375229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76702d-a72c-4e4b-9d4f-42d218c9d14d None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:59.376954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 118/236] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:59.382261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8a083-4c73-4602-843e-1a119a08aa75 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:59.382553 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8a083-4c73-4602-843e-1a119a08aa75 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:59.382886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8a083-4c73-4602-843e-1a119a08aa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:59.420322 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-43e8a083-4c73-4602-843e-1a119a08aa75 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:59.421557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-43e8a083-4c73-4602-843e-1a119a08aa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:24:59.423329 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 119/237] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:24:59.448793 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0839fac-d150-456e-908e-5cf624295b1c None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:59.542502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 119/238] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:24:59.585303 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0839fac-d150-456e-908e-5cf624295b1c None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:59.588631 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8a083-4c73-4602-843e-1a119a08aa75 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:59.640584 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:59.666510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e0859-b2b4-413f-9144-92a25b2d25be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:59.667937 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e0859-b2b4-413f-9144-92a25b2d25be None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:59.668818 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e0859-b2b4-413f-9144-92a25b2d25be None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:59.670047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e0859-b2b4-413f-9144-92a25b2d25be None admin] PATH_INFO: `/v3/domains/default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:59.672540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e0859-b2b4-413f-9144-92a25b2d25be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:59.675027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e0859-b2b4-413f-9144-92a25b2d25be None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:59.679011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 120/239] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:24:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:24:59.685353 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e0859-b2b4-413f-9144-92a25b2d25be None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:59.690920 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:24:59.788789 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8a083-4c73-4602-843e-1a119a08aa75 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:59.836668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e0859-b2b4-413f-9144-92a25b2d25be None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:24:59.847198 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee2d00-077e-43a2-b444-b2fabcc9e39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:59.849397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee2d00-077e-43a2-b444-b2fabcc9e39e None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:59.849893 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee2d00-077e-43a2-b444-b2fabcc9e39e None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:59.850338 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee2d00-077e-43a2-b444-b2fabcc9e39e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:59.865218 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee2d00-077e-43a2-b444-b2fabcc9e39e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:24:59.872893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58a789-a333-4217-8d89-3f2d91694012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:24:59.873653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58a789-a333-4217-8d89-3f2d91694012 None admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:59.874007 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58a789-a333-4217-8d89-3f2d91694012 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:59.874351 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58a789-a333-4217-8d89-3f2d91694012 None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:59.875130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58a789-a333-4217-8d89-3f2d91694012 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:24:59.875746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-8fee2d00-077e-43a2-b444-b2fabcc9e39e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:24:59.875746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:24:59.875746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:24:59.875746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:24:59.875746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:24:59.875746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:24:59.875746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:24:59.875746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:24:59.875746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:24:59.875746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:24:59.875746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:24:59.875746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:24:59.875746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:24:59.875746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:24:59.875746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:24:59.875746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:24:59.876570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:24:59.876570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:24:59.876570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:24:59.876570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:24:59.876570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:24:59.876570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:24:59.876570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:24:59.876570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:24:59.876570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:24:59.876570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:24:59.876570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:24:59.876570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:24:59.876570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:24:59.876570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:24:59.876570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:24:59.876570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:24:59.877341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:24:59.877341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:24:59.877341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:24:59.877341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:24:59.877341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:24:59.877341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:24:59.877341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:24:59.877341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:24:59.877341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:24:59.877341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:24:59.877341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:24:59.877341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:24:59.877954 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58a789-a333-4217-8d89-3f2d91694012 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:24:59.880185 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 120/240] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:24:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:24:59.881644 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d6325-ee7f-4fe9-baa8-be0999f4cda7 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:59.882268 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d6325-ee7f-4fe9-baa8-be0999f4cda7 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:59.882704 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d6325-ee7f-4fe9-baa8-be0999f4cda7 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:59.884179 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 121/241] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:24:59.892579 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d6325-ee7f-4fe9-baa8-be0999f4cda7 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:24:59.915322 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 121/242] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 09:24:59 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:24:59.915322 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c03dd5-b76c-44c2-a6fc-93baab570309 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:24:59.915322 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c03dd5-b76c-44c2-a6fc-93baab570309 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:24:59.915322 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c03dd5-b76c-44c2-a6fc-93baab570309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:24:59.945564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-f3c03dd5-b76c-44c2-a6fc-93baab570309 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:24:59.948322 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f3c03dd5-b76c-44c2-a6fc-93baab570309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:00.044060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:00.103447 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 122/243] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:00.109881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d6325-ee7f-4fe9-baa8-be0999f4cda7 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:00.126380 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c03dd5-b76c-44c2-a6fc-93baab570309 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:00.132261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:00.156052 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac8720-f02d-41ab-9db2-7dca7e710714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:00.156808 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac8720-f02d-41ab-9db2-7dca7e710714 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:00.157093 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac8720-f02d-41ab-9db2-7dca7e710714 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:00.157363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac8720-f02d-41ab-9db2-7dca7e710714 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:00.158123 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac8720-f02d-41ab-9db2-7dca7e710714 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:00.158428 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac8720-f02d-41ab-9db2-7dca7e710714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:00.159871 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac8720-f02d-41ab-9db2-7dca7e710714 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:00.175968 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 122/244] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:24:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:00.182687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac8720-f02d-41ab-9db2-7dca7e710714 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:00.252719 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c03dd5-b76c-44c2-a6fc-93baab570309 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:00.289524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e781360-1243-40be-aded-1a45f2081c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:00.290325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e781360-1243-40be-aded-1a45f2081c2f None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:00.290609 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e781360-1243-40be-aded-1a45f2081c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:00.290883 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e781360-1243-40be-aded-1a45f2081c2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:00.303663 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e781360-1243-40be-aded-1a45f2081c2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:00.304998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac8720-f02d-41ab-9db2-7dca7e710714 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:00.311631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-2e781360-1243-40be-aded-1a45f2081c2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:25:00.311631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:00.311631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:00.311631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:00.311631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:00.311631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:00.311631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:00.311631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:00.311631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:00.311631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:00.311631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:00.311631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:00.311631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:00.311631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:00.311631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:00.311631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:00.312501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:00.312501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:00.312501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:00.312501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:00.312501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:00.312501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:00.312501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:00.312501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:00.312501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:00.312501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:00.312501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:00.312501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:00.312501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:00.312501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:00.312501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:00.312501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:00.313273 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:00.313273 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:00.313273 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:00.313273 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:00.313273 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:00.313273 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:00.313273 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:00.313273 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:00.313273 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:00.313273 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:00.313273 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:25:00.313273 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:00.313273 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 123/245] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:25:00.318795 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e781360-1243-40be-aded-1a45f2081c2f None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:00.346245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e28de-d7ea-4711-bce5-631d4198b90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:00.347828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e28de-d7ea-4711-bce5-631d4198b90e None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:00.348875 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e28de-d7ea-4711-bce5-631d4198b90e None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:00.349476 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e28de-d7ea-4711-bce5-631d4198b90e None admin] PATH_INFO: `/v3/users/7a8916c063d2430dacaca73bd53bb8cd` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:00.357191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:00.367085 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e28de-d7ea-4711-bce5-631d4198b90e None admin] RBAC: Authorizing `identity:get_user(user_id=7a8916c063d2430dacaca73bd53bb8cd)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:00.368941 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e28de-d7ea-4711-bce5-631d4198b90e None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:00.371145 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 123/246] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:25:00 2022] GET /identity/v3/users/7a8916c063d2430dacaca73bd53bb8cd => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:00.376587 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e28de-d7ea-4711-bce5-631d4198b90e None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:00.415499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:00.428701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e781360-1243-40be-aded-1a45f2081c2f None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:00.465415 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716b3a9-b370-4ed7-a6ae-465c86f58371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:00.465415 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716b3a9-b370-4ed7-a6ae-465c86f58371 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:00.465415 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716b3a9-b370-4ed7-a6ae-465c86f58371 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:00.465415 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716b3a9-b370-4ed7-a6ae-465c86f58371 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:00.465829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716b3a9-b370-4ed7-a6ae-465c86f58371 None admin] RBAC: Adding query filter params (name=member) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:00.465829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716b3a9-b370-4ed7-a6ae-465c86f58371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:00.467270 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716b3a9-b370-4ed7-a6ae-465c86f58371 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:00.481343 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 124/247] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:25:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:00.482615 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716b3a9-b370-4ed7-a6ae-465c86f58371 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:00.499704 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e28de-d7ea-4711-bce5-631d4198b90e None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:00.545670 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e75ebe-b133-45b7-b410-70da687e4d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:00.546794 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e75ebe-b133-45b7-b410-70da687e4d76 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:00.547393 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e75ebe-b133-45b7-b410-70da687e4d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:00.547866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e75ebe-b133-45b7-b410-70da687e4d76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:00.589693 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:00.594188 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716b3a9-b370-4ed7-a6ae-465c86f58371 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:00.630546 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3774104-ff26-4506-8704-e06a0505db4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:00.631389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3774104-ff26-4506-8704-e06a0505db4e None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:00.631674 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3774104-ff26-4506-8704-e06a0505db4e None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:00.631947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3774104-ff26-4506-8704-e06a0505db4e None admin] PATH_INFO: `/v3/users/05e29a5c7cb84df6ab010e17ed84d19b` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:00.633172 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3774104-ff26-4506-8704-e06a0505db4e None admin] RBAC: Authorizing `identity:get_user(user_id=05e29a5c7cb84df6ab010e17ed84d19b)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:00.634799 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3774104-ff26-4506-8704-e06a0505db4e None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:00.635741 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e75ebe-b133-45b7-b410-70da687e4d76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:00.637415 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e75ebe-b133-45b7-b410-70da687e4d76 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:00.640960 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 125/248] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:25:00 2022] GET /identity/v3/users/05e29a5c7cb84df6ab010e17ed84d19b => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:00.642182 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3774104-ff26-4506-8704-e06a0505db4e None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:00.679735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:00.795446 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3774104-ff26-4506-8704-e06a0505db4e None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:00.838837 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967656a1-5784-4c66-9d29-8e9a087aec5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:00.839786 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967656a1-5784-4c66-9d29-8e9a087aec5f None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:00.840073 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967656a1-5784-4c66-9d29-8e9a087aec5f None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:00.840352 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967656a1-5784-4c66-9d29-8e9a087aec5f None admin] PATH_INFO: `/v3/projects/b5242eba374f433f9faf5bc522321dd1` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:00.842020 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967656a1-5784-4c66-9d29-8e9a087aec5f None admin] RBAC: Authorizing `identity:get_project(project_id=b5242eba374f433f9faf5bc522321dd1)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:00.843947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967656a1-5784-4c66-9d29-8e9a087aec5f None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:00.849147 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 126/249] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:25:00 2022] GET /identity/v3/projects/b5242eba374f433f9faf5bc522321dd1 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:00.855644 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967656a1-5784-4c66-9d29-8e9a087aec5f None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:00.888130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 124/250] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 09:25:00.896954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e75ebe-b133-45b7-b410-70da687e4d76 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:00.898598 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:00.975512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967656a1-5784-4c66-9d29-8e9a087aec5f None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:01.020814 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f10f1-563e-4956-9d15-fde5962e2266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:01.021764 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f10f1-563e-4956-9d15-fde5962e2266 None admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:01.022055 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f10f1-563e-4956-9d15-fde5962e2266 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:01.022428 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f10f1-563e-4956-9d15-fde5962e2266 None admin] PATH_INFO: `/v3/projects/b5242eba374f433f9faf5bc522321dd1/users/05e29a5c7cb84df6ab010e17ed84d19b/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:01.025627 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f10f1-563e-4956-9d15-fde5962e2266 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5242eba374f433f9faf5bc522321dd1, user_id=05e29a5c7cb84df6ab010e17ed84d19b, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:01.039307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f10f1-563e-4956-9d15-fde5962e2266 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:01.079836 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 127/251] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:25:00 2022] PUT /identity/v3/projects/b5242eba374f433f9faf5bc522321dd1/users/05e29a5c7cb84df6ab010e17ed84d19b/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:25:01.171403 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e75ebe-b133-45b7-b410-70da687e4d76 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:01.236965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a15286-f2b2-44a7-be48-6cd11152c32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:01.237842 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a15286-f2b2-44a7-be48-6cd11152c32d None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:01.238118 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a15286-f2b2-44a7-be48-6cd11152c32d None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:01.238389 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a15286-f2b2-44a7-be48-6cd11152c32d None admin] PATH_INFO: `/v3/projects/b5242eba374f433f9faf5bc522321dd1` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:01.240339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a15286-f2b2-44a7-be48-6cd11152c32d None admin] RBAC: Authorizing `identity:get_project(project_id=b5242eba374f433f9faf5bc522321dd1)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:01.241806 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a15286-f2b2-44a7-be48-6cd11152c32d None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:01.243613 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 125/252] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:25:00 2022] GET /identity/v3/projects/b5242eba374f433f9faf5bc522321dd1 => generated 302 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:01.250655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f10f1-563e-4956-9d15-fde5962e2266 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:01.415304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:01.423917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f10f1-563e-4956-9d15-fde5962e2266 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:01.471303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db54278-6c6b-4b39-8898-34b3fb2a0a4f None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:01.471303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db54278-6c6b-4b39-8898-34b3fb2a0a4f None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:01.471303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db54278-6c6b-4b39-8898-34b3fb2a0a4f None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:01.471964 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 126/253] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:01.479302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887af20b-fdf9-40f4-b07a-eb1b6cdb584b None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:01.479302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887af20b-fdf9-40f4-b07a-eb1b6cdb584b None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:01.479302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887af20b-fdf9-40f4-b07a-eb1b6cdb584b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:01.485374 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:01.491959 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a77fb-23e4-4f57-b6c6-ddceff0f07a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:01.492418 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a77fb-23e4-4f57-b6c6-ddceff0f07a0 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:01.492710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a77fb-23e4-4f57-b6c6-ddceff0f07a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:01.493111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a77fb-23e4-4f57-b6c6-ddceff0f07a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:01.496546 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a77fb-23e4-4f57-b6c6-ddceff0f07a0 None admin] RBAC: Adding query filter params (role.id=2ed814d9cd4844f5b4ddfc8627b8fc6a, scope.project.id=b5242eba374f433f9faf5bc522321dd1, user.id=7a8916c063d2430dacaca73bd53bb8cd) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:01.496546 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a77fb-23e4-4f57-b6c6-ddceff0f07a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:01.500163 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a77fb-23e4-4f57-b6c6-ddceff0f07a0 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:01.509491 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 128/254] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:25:01 2022] GET /identity/v3/role_assignments?user.id=7a8916c063d2430dacaca73bd53bb8cd&scope.project.id=b5242eba374f433f9faf5bc522321dd1&role.id=2ed814d9cd4844f5b4ddfc8627b8fc6a => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:01.515309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-887af20b-fdf9-40f4-b07a-eb1b6cdb584b None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:01.515309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-887af20b-fdf9-40f4-b07a-eb1b6cdb584b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:01.630280 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 127/255] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:01.672466 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a77fb-23e4-4f57-b6c6-ddceff0f07a0 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:01.839374 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a77fb-23e4-4f57-b6c6-ddceff0f07a0 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:01.886746 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2cb010-0074-4d76-8c1c-58c58f0f1340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:01.887593 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cb010-0074-4d76-8c1c-58c58f0f1340 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:01.887879 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cb010-0074-4d76-8c1c-58c58f0f1340 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:01.888154 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cb010-0074-4d76-8c1c-58c58f0f1340 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:01.901073 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2cb010-0074-4d76-8c1c-58c58f0f1340 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:01.908751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-7d2cb010-0074-4d76-8c1c-58c58f0f1340 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:25:01.908751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:01.908751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:01.908751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:01.908751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:01.908751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:01.908751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:01.908751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:01.908751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:01.908751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:01.908751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:01.908751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:01.908751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:01.908751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:01.908751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:01.908751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:01.909607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:01.909607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:01.909607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:01.909607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:01.909607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:01.909607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:01.909607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:01.909607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:01.909607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:01.909607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:01.909607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:01.909607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:01.909607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:01.909607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:01.909607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:01.909607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:01.910381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:01.910381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:01.910381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:01.910381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:01.910381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:01.910381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:01.910381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:01.910381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:01.910381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:01.910381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:01.910381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:25:01.910381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:01.910381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 129/256] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:25:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:01.917507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887af20b-fdf9-40f4-b07a-eb1b6cdb584b None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:01.922691 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a9b82-e388-4e2e-afc3-c89c52057797 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:01.922987 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a9b82-e388-4e2e-afc3-c89c52057797 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:01.923265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a9b82-e388-4e2e-afc3-c89c52057797 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:01.924657 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 130/257] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:01.930244 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9f23a-65df-4c9e-9d4d-f5e05ed599d6 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:01.930724 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9f23a-65df-4c9e-9d4d-f5e05ed599d6 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:01.931175 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9f23a-65df-4c9e-9d4d-f5e05ed599d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:01.968294 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-f4f9f23a-65df-4c9e-9d4d-f5e05ed599d6 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:01.969775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f4f9f23a-65df-4c9e-9d4d-f5e05ed599d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:01.989584 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:02.072936 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887af20b-fdf9-40f4-b07a-eb1b6cdb584b None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:02.105430 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:02.111362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdd152-52e3-4d7c-a9b0-110d5da34552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:02.112206 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdd152-52e3-4d7c-a9b0-110d5da34552 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:02.112635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdd152-52e3-4d7c-a9b0-110d5da34552 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:02.113138 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdd152-52e3-4d7c-a9b0-110d5da34552 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:02.114120 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdd152-52e3-4d7c-a9b0-110d5da34552 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:02.114629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdd152-52e3-4d7c-a9b0-110d5da34552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:02.118296 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdd152-52e3-4d7c-a9b0-110d5da34552 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:02.120033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 131/258] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:25:02.127572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 128/259] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:02.133186 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9f23a-65df-4c9e-9d4d-f5e05ed599d6 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:02.155607 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdd152-52e3-4d7c-a9b0-110d5da34552 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:02.283753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9f23a-65df-4c9e-9d4d-f5e05ed599d6 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:02.369460 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdd152-52e3-4d7c-a9b0-110d5da34552 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:02.372967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bb0f2-ccac-4b79-b47b-9513471e5e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:02.373868 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bb0f2-ccac-4b79-b47b-9513471e5e5e None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:02.374151 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bb0f2-ccac-4b79-b47b-9513471e5e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:02.374430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bb0f2-ccac-4b79-b47b-9513471e5e5e None admin] PATH_INFO: `/v3/users/6499026e824744d98faf14bc61ee4bc5` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:02.377608 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bb0f2-ccac-4b79-b47b-9513471e5e5e None admin] RBAC: Authorizing `identity:get_user(user_id=6499026e824744d98faf14bc61ee4bc5)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:02.379099 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bb0f2-ccac-4b79-b47b-9513471e5e5e None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:02.381527 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 132/260] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:25:02 2022] GET /identity/v3/users/6499026e824744d98faf14bc61ee4bc5 => generated 283 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:02.387427 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bb0f2-ccac-4b79-b47b-9513471e5e5e None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:02.424941 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:02.454450 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29030c5-a0f0-4a34-89c0-61071d1e4c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:02.455299 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29030c5-a0f0-4a34-89c0-61071d1e4c13 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:02.456436 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29030c5-a0f0-4a34-89c0-61071d1e4c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:02.456716 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29030c5-a0f0-4a34-89c0-61071d1e4c13 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:02.492125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29030c5-a0f0-4a34-89c0-61071d1e4c13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:02.501772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-a29030c5-a0f0-4a34-89c0-61071d1e4c13 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:25:02.501772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:02.501772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:02.501772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:02.501772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:02.501772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:02.501772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:02.501772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:02.501772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:02.501772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:02.501772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:02.501772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:02.501772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:02.501772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:02.501772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:02.501772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:02.502737 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:02.502737 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:02.502737 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:02.502737 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:02.502737 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:02.502737 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:02.502737 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:02.502737 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:02.502737 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:02.502737 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:02.502737 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:02.502737 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:02.502737 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:02.502737 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:02.502737 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:02.502737 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:02.503597 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:02.503597 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:02.503597 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:02.503597 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:02.503597 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:02.503597 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:02.503597 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:02.503597 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:02.503597 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:02.503597 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:02.503597 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:25:02.503597 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:02.506084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 129/261] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 09:25:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:25:02.518059 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29030c5-a0f0-4a34-89c0-61071d1e4c13 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:02.576580 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bb0f2-ccac-4b79-b47b-9513471e5e5e None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:02.627697 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:02.630934 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e82976-c212-4bcc-954e-a4e2b33ba8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:02.631892 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e82976-c212-4bcc-954e-a4e2b33ba8b1 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:02.632372 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e82976-c212-4bcc-954e-a4e2b33ba8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:02.632865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e82976-c212-4bcc-954e-a4e2b33ba8b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:02.695863 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29030c5-a0f0-4a34-89c0-61071d1e4c13 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:02.783777 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e82976-c212-4bcc-954e-a4e2b33ba8b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:02.785262 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e82976-c212-4bcc-954e-a4e2b33ba8b1 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:02.787623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c934290-330b-4696-afcc-ebc2c0d3df06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:02.788298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c934290-330b-4696-afcc-ebc2c0d3df06 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:02.788583 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c934290-330b-4696-afcc-ebc2c0d3df06 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:02.788863 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c934290-330b-4696-afcc-ebc2c0d3df06 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:02.789607 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c934290-330b-4696-afcc-ebc2c0d3df06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:02.789916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c934290-330b-4696-afcc-ebc2c0d3df06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:02.791303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c934290-330b-4696-afcc-ebc2c0d3df06 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:02.811635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 130/262] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:02.813348 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c934290-330b-4696-afcc-ebc2c0d3df06 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:02.835482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:03.024490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 133/263] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 09:25:03.030279 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e82976-c212-4bcc-954e-a4e2b33ba8b1 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:03.106028 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c934290-330b-4696-afcc-ebc2c0d3df06 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:03.149534 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:03.214775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e82976-c212-4bcc-954e-a4e2b33ba8b1 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:03.217138 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413fb4c-0b26-4a3f-bca9-8d5b21b1d255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:03.218596 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413fb4c-0b26-4a3f-bca9-8d5b21b1d255 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:03.218596 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413fb4c-0b26-4a3f-bca9-8d5b21b1d255 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:03.218774 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413fb4c-0b26-4a3f-bca9-8d5b21b1d255 None admin] PATH_INFO: `/v3/users/6499026e824744d98faf14bc61ee4bc5` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:03.224346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413fb4c-0b26-4a3f-bca9-8d5b21b1d255 None admin] RBAC: Authorizing `identity:get_user(user_id=6499026e824744d98faf14bc61ee4bc5)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:03.225871 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413fb4c-0b26-4a3f-bca9-8d5b21b1d255 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:03.227841 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 131/264] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:25:02 2022] GET /identity/v3/users/6499026e824744d98faf14bc61ee4bc5 => generated 283 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:03.233303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413fb4c-0b26-4a3f-bca9-8d5b21b1d255 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:03.242224 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:03.256938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e2109-463b-4bb2-b7c4-2b799ee3efd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:03.258151 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e2109-463b-4bb2-b7c4-2b799ee3efd9 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:03.258679 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e2109-463b-4bb2-b7c4-2b799ee3efd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:03.259156 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e2109-463b-4bb2-b7c4-2b799ee3efd9 None admin] PATH_INFO: `/v3/projects/b5242eba374f433f9faf5bc522321dd1` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:03.264658 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e2109-463b-4bb2-b7c4-2b799ee3efd9 None admin] RBAC: Authorizing `identity:get_project(project_id=b5242eba374f433f9faf5bc522321dd1)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:03.266348 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e2109-463b-4bb2-b7c4-2b799ee3efd9 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:03.268305 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 134/265] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:25:03 2022] GET /identity/v3/projects/b5242eba374f433f9faf5bc522321dd1 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:03.273961 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e2109-463b-4bb2-b7c4-2b799ee3efd9 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:03.449609 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e2109-463b-4bb2-b7c4-2b799ee3efd9 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:03.484222 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413fb4c-0b26-4a3f-bca9-8d5b21b1d255 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:03.515212 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e74f0-0e17-437c-b21f-557a2a1affa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:03.515910 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e74f0-0e17-437c-b21f-557a2a1affa7 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:03.516195 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e74f0-0e17-437c-b21f-557a2a1affa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:03.516472 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e74f0-0e17-437c-b21f-557a2a1affa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:03.517301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e74f0-0e17-437c-b21f-557a2a1affa7 None admin] RBAC: Adding query filter params (role.id=bb6c5483d9be4a16ac64750536c5e2e2, scope.project.id=b5242eba374f433f9faf5bc522321dd1, user.id=6499026e824744d98faf14bc61ee4bc5) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:03.517733 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e74f0-0e17-437c-b21f-557a2a1affa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:03.519194 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e74f0-0e17-437c-b21f-557a2a1affa7 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:03.534874 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 135/266] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:25:03 2022] GET /identity/v3/role_assignments?user.id=6499026e824744d98faf14bc61ee4bc5&scope.project.id=b5242eba374f433f9faf5bc522321dd1&role.id=bb6c5483d9be4a16ac64750536c5e2e2 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:03.560887 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e5400-b043-4e8a-8a08-e81c5af4db18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:03.561606 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e5400-b043-4e8a-8a08-e81c5af4db18 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:03.561843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e5400-b043-4e8a-8a08-e81c5af4db18 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:03.562128 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e5400-b043-4e8a-8a08-e81c5af4db18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:03.631887 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:03.657937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e5400-b043-4e8a-8a08-e81c5af4db18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:03.659479 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e5400-b043-4e8a-8a08-e81c5af4db18 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:03.809241 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 132/267] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:25:03.815032 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e74f0-0e17-437c-b21f-557a2a1affa7 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:03.902666 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:03.946963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f00a6-071e-40fa-8a5c-358c2668e32d None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:03.947621 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f00a6-071e-40fa-8a5c-358c2668e32d None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:03.948097 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f00a6-071e-40fa-8a5c-358c2668e32d None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:03.949666 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 133/268] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:25:03.960500 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdbfdb-93da-46da-81f1-d5200e744f16 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:03.961092 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdbfdb-93da-46da-81f1-d5200e744f16 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:03.961567 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdbfdb-93da-46da-81f1-d5200e744f16 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:03.961737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e74f0-0e17-437c-b21f-557a2a1affa7 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:03.963459 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 134/269] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:25:03.967116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562b2a1-1c3b-4166-82e1-d71c72294e25 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:03.967660 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562b2a1-1c3b-4166-82e1-d71c72294e25 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:03.968133 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562b2a1-1c3b-4166-82e1-d71c72294e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:03.994643 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-6562b2a1-1c3b-4166-82e1-d71c72294e25 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:03.996442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-6562b2a1-1c3b-4166-82e1-d71c72294e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:03.996738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14304697-c788-4f6e-aded-a6d7b6d7efd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:03.997676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14304697-c788-4f6e-aded-a6d7b6d7efd4 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:03.997963 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14304697-c788-4f6e-aded-a6d7b6d7efd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:03.998239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14304697-c788-4f6e-aded-a6d7b6d7efd4 None admin] PATH_INFO: `/v3/projects/b5242eba374f433f9faf5bc522321dd1` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:03.999468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14304697-c788-4f6e-aded-a6d7b6d7efd4 None admin] RBAC: Authorizing `identity:get_project(project_id=b5242eba374f433f9faf5bc522321dd1)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:04.000956 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14304697-c788-4f6e-aded-a6d7b6d7efd4 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:04.002871 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 136/270] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:25:03 2022] GET /identity/v3/projects/b5242eba374f433f9faf5bc522321dd1 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:04.006787 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebb5c7-3d0f-4c48-a68f-107f39ed99c0 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:04.007077 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebb5c7-3d0f-4c48-a68f-107f39ed99c0 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:04.007383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebb5c7-3d0f-4c48-a68f-107f39ed99c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:04.025476 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-ebebb5c7-3d0f-4c48-a68f-107f39ed99c0 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:04.026670 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-ebebb5c7-3d0f-4c48-a68f-107f39ed99c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:04.099149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 135/271] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:04.100077 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562b2a1-1c3b-4166-82e1-d71c72294e25 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:04.121112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 137/272] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:04.127910 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebb5c7-3d0f-4c48-a68f-107f39ed99c0 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:04.136821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:04.179128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:04.234732 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562b2a1-1c3b-4166-82e1-d71c72294e25 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:04.235858 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebb5c7-3d0f-4c48-a68f-107f39ed99c0 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:04.272624 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebc778-6f27-4cba-a8b1-3642950b82e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:04.272850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a076a-a290-4238-bfef-f29bd3adfe3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:04.273551 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a076a-a290-4238-bfef-f29bd3adfe3d None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:04.273831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a076a-a290-4238-bfef-f29bd3adfe3d None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:04.274105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a076a-a290-4238-bfef-f29bd3adfe3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:04.274533 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebc778-6f27-4cba-a8b1-3642950b82e7 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:04.274935 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a076a-a290-4238-bfef-f29bd3adfe3d None admin] RBAC: Adding query filter params (role.id=580d60e140704327b90a80fc59a2165c, scope.project.id=b5242eba374f433f9faf5bc522321dd1, user.id=6499026e824744d98faf14bc61ee4bc5) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:04.275233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebc778-6f27-4cba-a8b1-3642950b82e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:04.275424 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a076a-a290-4238-bfef-f29bd3adfe3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:04.275867 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebc778-6f27-4cba-a8b1-3642950b82e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:04.276705 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a076a-a290-4238-bfef-f29bd3adfe3d None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:04.277460 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebc778-6f27-4cba-a8b1-3642950b82e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:04.279097 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebc778-6f27-4cba-a8b1-3642950b82e7 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:04.281286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 138/273] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:04.282383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebc778-6f27-4cba-a8b1-3642950b82e7 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:04.289797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 136/274] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:25:04 2022] GET /identity/v3/role_assignments?user.id=6499026e824744d98faf14bc61ee4bc5&scope.project.id=b5242eba374f433f9faf5bc522321dd1&role.id=580d60e140704327b90a80fc59a2165c => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:04.289797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a076a-a290-4238-bfef-f29bd3adfe3d None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:04.430838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:04.466621 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a076a-a290-4238-bfef-f29bd3adfe3d None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:04.484646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebc778-6f27-4cba-a8b1-3642950b82e7 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:04.501234 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:04.517151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31992e42-976e-4623-bdfa-8a9008b87c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:04.518815 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31992e42-976e-4623-bdfa-8a9008b87c06 None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:04.520687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31992e42-976e-4623-bdfa-8a9008b87c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:04.521192 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31992e42-976e-4623-bdfa-8a9008b87c06 None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:04.522290 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31992e42-976e-4623-bdfa-8a9008b87c06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:04.524044 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31992e42-976e-4623-bdfa-8a9008b87c06 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:04.532882 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfad8f-2549-4eef-a97b-0a9985d75d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:04.534386 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfad8f-2549-4eef-a97b-0a9985d75d31 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:04.535203 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfad8f-2549-4eef-a97b-0a9985d75d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:04.535791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfad8f-2549-4eef-a97b-0a9985d75d31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:04.550562 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 137/275] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 09:25:04 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:25:04.555299 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfad8f-2549-4eef-a97b-0a9985d75d31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:04.555449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00057cd4-43a1-4a51-ac51-f61f1c7c10fd None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:04.555449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00057cd4-43a1-4a51-ac51-f61f1c7c10fd None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:04.555449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00057cd4-43a1-4a51-ac51-f61f1c7c10fd None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:04.555449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 138/276] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:04.563688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-e6bfad8f-2549-4eef-a97b-0a9985d75d31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:25:04.563688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:04.563688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:04.563688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:04.563688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:04.563688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:04.563688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:04.563688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:04.563688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:04.563688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:04.563688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:04.563688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:04.563688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:04.563688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:04.563688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:04.563688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:04.564619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:04.564619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:04.564619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:04.564619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:04.564619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:04.564619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:04.564619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:04.564619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:04.564619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:04.564619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:04.564619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:04.564619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:04.564619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:04.564619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:04.564619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:04.564619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:04.565483 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:04.565483 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:04.565483 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:04.565483 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:04.565483 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:04.565483 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:04.565483 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:04.565483 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:04.565483 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:04.565483 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:04.565483 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:25:04.565483 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:04.565483 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 139/277] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:04.566117 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f0956-f239-45ca-a3cd-1324f6240d1c None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:04.566117 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f0956-f239-45ca-a3cd-1324f6240d1c None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:04.566117 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f0956-f239-45ca-a3cd-1324f6240d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:04.575690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfad8f-2549-4eef-a97b-0a9985d75d31 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:04.590113 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-078f0956-f239-45ca-a3cd-1324f6240d1c None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:04.591461 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-078f0956-f239-45ca-a3cd-1324f6240d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:04.686703 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 139/278] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:04.711964 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f0956-f239-45ca-a3cd-1324f6240d1c None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:04.734720 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfad8f-2549-4eef-a97b-0a9985d75d31 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:04.782328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbfb3f-9bf1-4050-9f04-d8c8721cd582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:04.782922 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbfb3f-9bf1-4050-9f04-d8c8721cd582 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:04.783214 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbfb3f-9bf1-4050-9f04-d8c8721cd582 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:04.786940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbfb3f-9bf1-4050-9f04-d8c8721cd582 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:04.787641 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbfb3f-9bf1-4050-9f04-d8c8721cd582 None admin] RBAC: Adding query filter params (name=member) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:04.787960 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbfb3f-9bf1-4050-9f04-d8c8721cd582 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:04.789373 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbfb3f-9bf1-4050-9f04-d8c8721cd582 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:04.798394 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:04.798603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 140/279] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:25:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:04.805964 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbfb3f-9bf1-4050-9f04-d8c8721cd582 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:04.845716 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f0956-f239-45ca-a3cd-1324f6240d1c None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:04.859902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:04.890070 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25f4ef-6579-4a79-994d-dab069a5452c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:04.890882 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25f4ef-6579-4a79-994d-dab069a5452c None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:04.891164 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25f4ef-6579-4a79-994d-dab069a5452c None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:04.891522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25f4ef-6579-4a79-994d-dab069a5452c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:04.902772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25f4ef-6579-4a79-994d-dab069a5452c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:04.911831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-8d25f4ef-6579-4a79-994d-dab069a5452c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:25:04.911831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:04.911831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:04.911831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:04.911831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:04.911831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:04.911831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:04.911831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:04.911831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:04.911831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:04.911831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:04.911831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:04.911831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:04.911831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:04.911831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:04.911831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:04.912743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:04.912743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:04.912743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:04.912743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:04.912743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:04.912743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:04.912743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:04.912743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:04.912743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:04.912743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:04.912743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:04.912743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:04.912743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:04.912743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:04.912743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:04.912743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:04.913505 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:04.913505 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:04.913505 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:04.913505 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:04.913505 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:04.913505 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:04.913505 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:04.913505 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:04.913505 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:04.913505 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:04.913505 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:25:04.913505 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:04.917911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 140/280] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:04.919446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895b3f1-b02a-4f96-bb4e-889f618ca60d None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:04.919628 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895b3f1-b02a-4f96-bb4e-889f618ca60d None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:04.919898 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895b3f1-b02a-4f96-bb4e-889f618ca60d None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:04.921779 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 141/281] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:04.923475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895b3f1-b02a-4f96-bb4e-889f618ca60d None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:04.936701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbfb3f-9bf1-4050-9f04-d8c8721cd582 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:04.985127 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32dd250-4c47-4f97-8d4d-1721920ae016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:04.986202 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32dd250-4c47-4f97-8d4d-1721920ae016 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:04.986484 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32dd250-4c47-4f97-8d4d-1721920ae016 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:04.986757 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32dd250-4c47-4f97-8d4d-1721920ae016 None admin] PATH_INFO: `/v3/users/ee5d5d7846764faf872f8d70ee173cba` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:05.001409 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32dd250-4c47-4f97-8d4d-1721920ae016 None admin] RBAC: Authorizing `identity:get_user(user_id=ee5d5d7846764faf872f8d70ee173cba)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:05.002904 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32dd250-4c47-4f97-8d4d-1721920ae016 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:05.005031 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 141/282] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:25:04 2022] GET /identity/v3/users/ee5d5d7846764faf872f8d70ee173cba => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:05.006173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f4b64-bb88-45e1-b640-bbc408f10b19 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:05.006464 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f4b64-bb88-45e1-b640-bbc408f10b19 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:05.006742 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f4b64-bb88-45e1-b640-bbc408f10b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:05.028609 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-486f4b64-bb88-45e1-b640-bbc408f10b19 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:05.029871 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-486f4b64-bb88-45e1-b640-bbc408f10b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:05.078576 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895b3f1-b02a-4f96-bb4e-889f618ca60d None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:05.104820 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:05.117324 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb19a9-c4af-4614-87eb-6913ba347ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:05.118005 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb19a9-c4af-4614-87eb-6913ba347ecc None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:05.118288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb19a9-c4af-4614-87eb-6913ba347ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:05.118562 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb19a9-c4af-4614-87eb-6913ba347ecc None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:05.119329 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb19a9-c4af-4614-87eb-6913ba347ecc None admin] RBAC: Adding query filter params (name=member) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:05.119644 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb19a9-c4af-4614-87eb-6913ba347ecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:05.121334 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb19a9-c4af-4614-87eb-6913ba347ecc None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:05.127726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 142/283] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:05.128700 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f4b64-bb88-45e1-b640-bbc408f10b19 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:05.142424 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 142/284] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:25:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:05.151636 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb19a9-c4af-4614-87eb-6913ba347ecc None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:05.169444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:05.248297 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f4b64-bb88-45e1-b640-bbc408f10b19 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:05.261886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb19a9-c4af-4614-87eb-6913ba347ecc None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:05.284189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79cd14-651a-4392-b0f3-c51560fd626b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:05.285211 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79cd14-651a-4392-b0f3-c51560fd626b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:05.286248 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79cd14-651a-4392-b0f3-c51560fd626b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:05.286722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79cd14-651a-4392-b0f3-c51560fd626b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:05.287778 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79cd14-651a-4392-b0f3-c51560fd626b None admin] RBAC: Adding query filter params (role.id=207b29fd2d8344ceb403e1c2e9d91ac2, user.id=ee5d5d7846764faf872f8d70ee173cba, scope.system=all) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:05.288331 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79cd14-651a-4392-b0f3-c51560fd626b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:05.289991 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79cd14-651a-4392-b0f3-c51560fd626b None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:05.295551 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 143/285] 10.222.0.41 () {56 vars in 1308 bytes} [Fri May 27 09:25:05 2022] GET /identity/v3/role_assignments?user.id=ee5d5d7846764faf872f8d70ee173cba&scope.system=all&role.id=207b29fd2d8344ceb403e1c2e9d91ac2 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:05.296713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79cd14-651a-4392-b0f3-c51560fd626b None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:05.299750 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef18a4-5259-4dd8-bbaf-04a6d8cc42af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:05.301580 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef18a4-5259-4dd8-bbaf-04a6d8cc42af None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:05.301580 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef18a4-5259-4dd8-bbaf-04a6d8cc42af None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:05.301580 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef18a4-5259-4dd8-bbaf-04a6d8cc42af None admin] PATH_INFO: `/v3/users/05e29a5c7cb84df6ab010e17ed84d19b` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:05.302810 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef18a4-5259-4dd8-bbaf-04a6d8cc42af None admin] RBAC: Authorizing `identity:get_user(user_id=05e29a5c7cb84df6ab010e17ed84d19b)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:05.304328 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef18a4-5259-4dd8-bbaf-04a6d8cc42af None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:05.310607 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 143/286] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:25:05 2022] GET /identity/v3/users/05e29a5c7cb84df6ab010e17ed84d19b => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:05.313500 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef18a4-5259-4dd8-bbaf-04a6d8cc42af None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:05.425628 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:05.431490 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:05.447879 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79cd14-651a-4392-b0f3-c51560fd626b None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:05.502939 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e83ae-d84d-4884-bad1-d906eb9996fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:05.504752 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e83ae-d84d-4884-bad1-d906eb9996fe None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:05.505037 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e83ae-d84d-4884-bad1-d906eb9996fe None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:05.505312 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e83ae-d84d-4884-bad1-d906eb9996fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:05.516637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef18a4-5259-4dd8-bbaf-04a6d8cc42af None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:05.519452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e83ae-d84d-4884-bad1-d906eb9996fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:05.530444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-3c7e83ae-d84d-4884-bad1-d906eb9996fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:25:05.530444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:05.530444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:05.530444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:05.530444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:05.530444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:05.530444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:05.530444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:05.530444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:05.530444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:05.530444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:05.530444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:05.530444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:05.530444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:05.530444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:05.530444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:05.531379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:05.531379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:05.531379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:05.531379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:05.531379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:05.531379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:05.531379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:05.531379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:05.531379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:05.531379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:05.531379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:05.531379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:05.531379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:05.531379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:05.531379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:05.531379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:05.532173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:05.532173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:05.532173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:05.532173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:05.532173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:05.532173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:05.532173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:05.532173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:05.532173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:05.532173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:05.532173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:25:05.532173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:05.532173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 144/287] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:05.539785 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e83ae-d84d-4884-bad1-d906eb9996fe None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:05.584566 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3565f-35aa-415e-a5c5-2e85dfc7883b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:05.585249 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3565f-35aa-415e-a5c5-2e85dfc7883b None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:05.585485 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3565f-35aa-415e-a5c5-2e85dfc7883b None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:05.585752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3565f-35aa-415e-a5c5-2e85dfc7883b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:05.705407 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e83ae-d84d-4884-bad1-d906eb9996fe None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:05.741933 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3565f-35aa-415e-a5c5-2e85dfc7883b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:05.743438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3565f-35aa-415e-a5c5-2e85dfc7883b None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:05.805435 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:05.808544 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a2efd-7c35-4e83-8ff2-11331e28f521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:05.809248 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a2efd-7c35-4e83-8ff2-11331e28f521 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:05.809535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a2efd-7c35-4e83-8ff2-11331e28f521 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:05.809821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a2efd-7c35-4e83-8ff2-11331e28f521 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:05.810581 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a2efd-7c35-4e83-8ff2-11331e28f521 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:05.810895 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a2efd-7c35-4e83-8ff2-11331e28f521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:05.812459 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a2efd-7c35-4e83-8ff2-11331e28f521 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:05.841533 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 145/288] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:25:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:05.847202 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a2efd-7c35-4e83-8ff2-11331e28f521 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:05.855982 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 144/289] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:25:05.865672 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3565f-35aa-415e-a5c5-2e85dfc7883b None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:05.883506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:06.009230 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a2efd-7c35-4e83-8ff2-11331e28f521 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:06.070795 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3565f-35aa-415e-a5c5-2e85dfc7883b None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:06.090876 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ed5a9-91c0-424b-9644-774a7d964a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:06.091797 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ed5a9-91c0-424b-9644-774a7d964a43 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:06.092083 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ed5a9-91c0-424b-9644-774a7d964a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:06.092363 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ed5a9-91c0-424b-9644-774a7d964a43 None admin] PATH_INFO: `/v3/users/7a8916c063d2430dacaca73bd53bb8cd` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:06.094388 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ed5a9-91c0-424b-9644-774a7d964a43 None admin] RBAC: Authorizing `identity:get_user(user_id=7a8916c063d2430dacaca73bd53bb8cd)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:06.099302 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ed5a9-91c0-424b-9644-774a7d964a43 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:06.101266 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 146/290] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:25:05 2022] GET /identity/v3/users/7a8916c063d2430dacaca73bd53bb8cd => generated 297 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:06.107668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ed5a9-91c0-424b-9644-774a7d964a43 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:06.128397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0121e2-cb7f-45f8-8d07-eaa98f18eae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:06.129385 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0121e2-cb7f-45f8-8d07-eaa98f18eae5 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:06.129665 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0121e2-cb7f-45f8-8d07-eaa98f18eae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:06.129938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0121e2-cb7f-45f8-8d07-eaa98f18eae5 None admin] PATH_INFO: `/v3/projects/b5242eba374f433f9faf5bc522321dd1` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:06.131113 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0121e2-cb7f-45f8-8d07-eaa98f18eae5 None admin] RBAC: Authorizing `identity:get_project(project_id=b5242eba374f433f9faf5bc522321dd1)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:06.132689 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0121e2-cb7f-45f8-8d07-eaa98f18eae5 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:06.144072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 145/291] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:25:05 2022] GET /identity/v3/projects/b5242eba374f433f9faf5bc522321dd1 => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:06.149911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0121e2-cb7f-45f8-8d07-eaa98f18eae5 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:06.191040 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:06.202411 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:06.231234 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ed5a9-91c0-424b-9644-774a7d964a43 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:06.303879 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3ca86-5d05-4288-b8f2-0fbff740d8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:06.304745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3ca86-5d05-4288-b8f2-0fbff740d8ae None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:06.305029 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3ca86-5d05-4288-b8f2-0fbff740d8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:06.305304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3ca86-5d05-4288-b8f2-0fbff740d8ae None admin] PATH_INFO: `/v3/projects/b5242eba374f433f9faf5bc522321dd1` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:06.308679 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3ca86-5d05-4288-b8f2-0fbff740d8ae None admin] RBAC: Authorizing `identity:get_project(project_id=b5242eba374f433f9faf5bc522321dd1)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:06.310163 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3ca86-5d05-4288-b8f2-0fbff740d8ae None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:06.311888 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 147/292] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:25:06 2022] GET /identity/v3/projects/b5242eba374f433f9faf5bc522321dd1 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:06.318426 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3ca86-5d05-4288-b8f2-0fbff740d8ae None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:06.358943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0121e2-cb7f-45f8-8d07-eaa98f18eae5 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:06.429652 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e20d4e-214b-47cf-86d3-dd482501b18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:06.430309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e20d4e-214b-47cf-86d3-dd482501b18f None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:06.430590 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e20d4e-214b-47cf-86d3-dd482501b18f None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:06.430864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e20d4e-214b-47cf-86d3-dd482501b18f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:06.431727 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e20d4e-214b-47cf-86d3-dd482501b18f None admin] RBAC: Adding query filter params (role.id=207b29fd2d8344ceb403e1c2e9d91ac2, scope.project.id=b5242eba374f433f9faf5bc522321dd1, user.id=05e29a5c7cb84df6ab010e17ed84d19b) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:06.432039 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e20d4e-214b-47cf-86d3-dd482501b18f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:06.433473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e20d4e-214b-47cf-86d3-dd482501b18f None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:06.445721 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 146/293] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:25:06 2022] GET /identity/v3/role_assignments?user.id=05e29a5c7cb84df6ab010e17ed84d19b&scope.project.id=b5242eba374f433f9faf5bc522321dd1&role.id=207b29fd2d8344ceb403e1c2e9d91ac2 => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:06.517162 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3ca86-5d05-4288-b8f2-0fbff740d8ae None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:06.588499 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a50e6-ff8c-441f-9d62-40abc558c2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:06.589335 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a50e6-ff8c-441f-9d62-40abc558c2ba None admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:06.589617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a50e6-ff8c-441f-9d62-40abc558c2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:06.589893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a50e6-ff8c-441f-9d62-40abc558c2ba None admin] PATH_INFO: `/v3/projects/b5242eba374f433f9faf5bc522321dd1/users/7a8916c063d2430dacaca73bd53bb8cd/roles/2ed814d9cd4844f5b4ddfc8627b8fc6a` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:06.596945 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a50e6-ff8c-441f-9d62-40abc558c2ba None admin] RBAC: Authorizing `identity:create_grant(project_id=b5242eba374f433f9faf5bc522321dd1, user_id=7a8916c063d2430dacaca73bd53bb8cd, role_id=2ed814d9cd4844f5b4ddfc8627b8fc6a)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:06.599113 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a50e6-ff8c-441f-9d62-40abc558c2ba None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:06.633925 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 148/294] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:25:06 2022] PUT /identity/v3/projects/b5242eba374f433f9faf5bc522321dd1/users/7a8916c063d2430dacaca73bd53bb8cd/roles/2ed814d9cd4844f5b4ddfc8627b8fc6a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:25:07.243041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a96d1f-32d9-49af-b7a6-deab1c516c71 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:07.243576 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a96d1f-32d9-49af-b7a6-deab1c516c71 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:07.243845 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a96d1f-32d9-49af-b7a6-deab1c516c71 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:07.245180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 147/295] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:07.250482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f4fde-a316-4b4d-8c7b-f2f733b20c51 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:07.251009 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f4fde-a316-4b4d-8c7b-f2f733b20c51 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:07.251506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f4fde-a316-4b4d-8c7b-f2f733b20c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:07.268668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:07.275360 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-038f4fde-a316-4b4d-8c7b-f2f733b20c51 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:07.276800 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-038f4fde-a316-4b4d-8c7b-f2f733b20c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:07.334470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e12f7-3a12-401b-bc39-fe6d37e7bbee None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:07.334749 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e12f7-3a12-401b-bc39-fe6d37e7bbee None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:07.334932 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e12f7-3a12-401b-bc39-fe6d37e7bbee None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:07.337293 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 148/296] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:25:07.342071 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bff295-2bd4-4af5-9307-88c644f36e8f None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:07.342356 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bff295-2bd4-4af5-9307-88c644f36e8f None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:07.342634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bff295-2bd4-4af5-9307-88c644f36e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:07.355268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 149/297] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:07.360250 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-f6bff295-2bd4-4af5-9307-88c644f36e8f None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:07.361903 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f6bff295-2bd4-4af5-9307-88c644f36e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:07.378387 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f4fde-a316-4b4d-8c7b-f2f733b20c51 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:07.447869 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 149/298] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:25:07.470081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bff295-2bd4-4af5-9307-88c644f36e8f None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:07.494852 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:07.511922 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f4fde-a316-4b4d-8c7b-f2f733b20c51 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:07.552070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77839c9-ef40-4c78-895a-79693aaf1511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:07.553640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77839c9-ef40-4c78-895a-79693aaf1511 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:07.554058 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77839c9-ef40-4c78-895a-79693aaf1511 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:07.554467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77839c9-ef40-4c78-895a-79693aaf1511 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:07.555812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77839c9-ef40-4c78-895a-79693aaf1511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:07.557725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77839c9-ef40-4c78-895a-79693aaf1511 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:07.564298 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 150/299] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:07.565298 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77839c9-ef40-4c78-895a-79693aaf1511 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:07.569937 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:07.589562 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bff295-2bd4-4af5-9307-88c644f36e8f None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:07.625558 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d1fb8-2f54-484e-9746-4d5e2ec71f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:07.626775 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d1fb8-2f54-484e-9746-4d5e2ec71f8e None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:07.627256 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d1fb8-2f54-484e-9746-4d5e2ec71f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:07.627777 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d1fb8-2f54-484e-9746-4d5e2ec71f8e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:07.638624 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d1fb8-2f54-484e-9746-4d5e2ec71f8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:07.646997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-b28d1fb8-2f54-484e-9746-4d5e2ec71f8e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:25:07.646997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:07.646997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:07.646997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:07.646997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:07.646997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:07.646997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:07.646997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:07.646997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:07.646997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:07.646997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:07.646997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:07.646997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:07.646997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:07.646997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:07.646997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:07.648024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:07.648024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:07.648024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:07.648024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:07.648024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:07.648024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:07.648024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:07.648024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:07.648024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:07.648024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:07.648024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:07.648024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:07.648024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:07.648024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:07.648024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:07.648024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:07.648977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:07.648977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:07.648977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:07.648977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:07.648977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:07.648977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:07.648977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:07.648977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:07.648977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:07.648977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:07.648977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:25:07.648977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:07.655627 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 150/300] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:25:07.656613 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d1fb8-2f54-484e-9746-4d5e2ec71f8e None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:07.673886 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77839c9-ef40-4c78-895a-79693aaf1511 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:07.709709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dc121-c1c6-423b-b9e3-61bbad5b8517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:07.710370 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dc121-c1c6-423b-b9e3-61bbad5b8517 None admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:07.710651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dc121-c1c6-423b-b9e3-61bbad5b8517 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:07.710923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dc121-c1c6-423b-b9e3-61bbad5b8517 None admin] PATH_INFO: `/v3/groups` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:07.712023 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0dc121-c1c6-423b-b9e3-61bbad5b8517 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:07.713233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0dc121-c1c6-423b-b9e3-61bbad5b8517 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:07.728497 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 151/301] 10.222.0.41 () {60 vars in 1134 bytes} [Fri May 27 09:25:07 2022] POST /identity/v3/groups => generated 229 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:25:07.730082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32178029-9955-4e51-beaf-1c5ca77fe553 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:07.730571 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32178029-9955-4e51-beaf-1c5ca77fe553 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:07.731133 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32178029-9955-4e51-beaf-1c5ca77fe553 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:07.732760 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 152/302] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:07.740450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9dcd0-017c-42f7-9dd0-a5535d712ea4 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:07.740745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9dcd0-017c-42f7-9dd0-a5535d712ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:07.741017 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9dcd0-017c-42f7-9dd0-a5535d712ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:07.748919 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:07.762238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-aaa9dcd0-017c-42f7-9dd0-a5535d712ea4 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:07.764186 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-aaa9dcd0-017c-42f7-9dd0-a5535d712ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:07.779463 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d1fb8-2f54-484e-9746-4d5e2ec71f8e None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:07.822980 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61ff07-2993-4264-901f-f2ec3f910c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:07.823702 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61ff07-2993-4264-901f-f2ec3f910c59 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:07.823988 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61ff07-2993-4264-901f-f2ec3f910c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:07.824266 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61ff07-2993-4264-901f-f2ec3f910c59 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:07.825026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61ff07-2993-4264-901f-f2ec3f910c59 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:07.825351 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61ff07-2993-4264-901f-f2ec3f910c59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:07.826759 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61ff07-2993-4264-901f-f2ec3f910c59 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:07.836413 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 151/303] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:25:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:07.842216 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61ff07-2993-4264-901f-f2ec3f910c59 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:07.857099 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:07.874055 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 153/304] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:25:07.898102 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9dcd0-017c-42f7-9dd0-a5535d712ea4 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:07.975178 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61ff07-2993-4264-901f-f2ec3f910c59 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:08.024004 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da44e13-b270-4a94-9d0d-42f0317f7518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:08.025268 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da44e13-b270-4a94-9d0d-42f0317f7518 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:08.025799 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da44e13-b270-4a94-9d0d-42f0317f7518 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:08.026213 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da44e13-b270-4a94-9d0d-42f0317f7518 None admin] PATH_INFO: `/v3/users/3148e56f61fa4073908311ed94c1ba6e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:08.034363 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9dcd0-017c-42f7-9dd0-a5535d712ea4 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:08.041651 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:08.049328 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da44e13-b270-4a94-9d0d-42f0317f7518 None admin] RBAC: Authorizing `identity:get_user(user_id=3148e56f61fa4073908311ed94c1ba6e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:08.051303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da44e13-b270-4a94-9d0d-42f0317f7518 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:08.053625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 152/305] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:25:07 2022] GET /identity/v3/users/3148e56f61fa4073908311ed94c1ba6e => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:08.064248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da44e13-b270-4a94-9d0d-42f0317f7518 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:08.077235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8b029-3c7f-4910-93af-275146204e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:08.078039 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8b029-3c7f-4910-93af-275146204e1e None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:08.078320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8b029-3c7f-4910-93af-275146204e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:08.078590 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8b029-3c7f-4910-93af-275146204e1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:08.092031 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8b029-3c7f-4910-93af-275146204e1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:08.103170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-d8d8b029-3c7f-4910-93af-275146204e1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:25:08.103170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:08.103170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:08.103170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:08.103170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:08.103170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:08.103170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:08.103170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:08.103170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:08.103170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:08.103170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:08.103170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:08.103170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:08.103170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:08.103170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:08.103170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:08.104060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:08.104060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:08.104060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:08.104060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:08.104060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:08.104060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:08.104060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:08.104060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:08.104060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:08.104060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:08.104060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:08.104060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:08.104060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:08.104060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:08.104060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:08.104060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:08.104847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:08.104847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:08.104847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:08.104847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:08.104847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:08.104847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:08.104847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:08.104847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:08.104847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:08.104847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:08.104847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:25:08.104847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:08.104847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 154/306] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:25:08.110011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8b029-3c7f-4910-93af-275146204e1e None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:08.186413 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:08.192628 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da44e13-b270-4a94-9d0d-42f0317f7518 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:08.239962 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8b029-3c7f-4910-93af-275146204e1e None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:08.250849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed26ba8-e856-4461-bbe6-e03f77bae0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:08.251875 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed26ba8-e856-4461-bbe6-e03f77bae0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:08.252263 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed26ba8-e856-4461-bbe6-e03f77bae0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:08.254436 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed26ba8-e856-4461-bbe6-e03f77bae0c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:08.255654 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed26ba8-e856-4461-bbe6-e03f77bae0c2 None admin] RBAC: Adding query filter params (role.id=2ed814d9cd4844f5b4ddfc8627b8fc6a, user.id=3148e56f61fa4073908311ed94c1ba6e, scope.system=all) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:08.255976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed26ba8-e856-4461-bbe6-e03f77bae0c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:08.257509 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed26ba8-e856-4461-bbe6-e03f77bae0c2 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:08.269364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 153/307] 10.222.0.41 () {56 vars in 1308 bytes} [Fri May 27 09:25:08 2022] GET /identity/v3/role_assignments?user.id=3148e56f61fa4073908311ed94c1ba6e&scope.system=all&role.id=2ed814d9cd4844f5b4ddfc8627b8fc6a => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:08.290819 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90627f55-215f-436c-903e-9f26e4d4ddc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:08.291537 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90627f55-215f-436c-903e-9f26e4d4ddc1 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:08.291820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90627f55-215f-436c-903e-9f26e4d4ddc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:08.292094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90627f55-215f-436c-903e-9f26e4d4ddc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:08.292848 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90627f55-215f-436c-903e-9f26e4d4ddc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:08.293155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90627f55-215f-436c-903e-9f26e4d4ddc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:08.294621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90627f55-215f-436c-903e-9f26e4d4ddc1 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:08.304790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 155/308] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:25:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:08.315342 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed26ba8-e856-4461-bbe6-e03f77bae0c2 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:08.385329 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:08.432814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed26ba8-e856-4461-bbe6-e03f77bae0c2 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:08.470375 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d745bc-44d1-4c87-b270-43ecf4e774a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:08.471255 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d745bc-44d1-4c87-b270-43ecf4e774a4 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:08.471565 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d745bc-44d1-4c87-b270-43ecf4e774a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:08.471827 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d745bc-44d1-4c87-b270-43ecf4e774a4 None admin] PATH_INFO: `/v3/users/ee5d5d7846764faf872f8d70ee173cba` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:08.473058 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d745bc-44d1-4c87-b270-43ecf4e774a4 None admin] RBAC: Authorizing `identity:get_user(user_id=ee5d5d7846764faf872f8d70ee173cba)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:08.474481 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d745bc-44d1-4c87-b270-43ecf4e774a4 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:08.476426 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 154/309] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:25:08 2022] GET /identity/v3/users/ee5d5d7846764faf872f8d70ee173cba => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:08.481861 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90627f55-215f-436c-903e-9f26e4d4ddc1 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:08.589935 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90627f55-215f-436c-903e-9f26e4d4ddc1 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:08.609987 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:08.630588 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a0bcb-cb7f-43e7-8dfc-16d5fea99bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:08.631884 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a0bcb-cb7f-43e7-8dfc-16d5fea99bed None admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:08.632373 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a0bcb-cb7f-43e7-8dfc-16d5fea99bed None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:08.632852 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a0bcb-cb7f-43e7-8dfc-16d5fea99bed None admin] PATH_INFO: `/v3/system/users/ee5d5d7846764faf872f8d70ee173cba/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:08.634596 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a0bcb-cb7f-43e7-8dfc-16d5fea99bed None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ee5d5d7846764faf872f8d70ee173cba, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:08.636301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a0bcb-cb7f-43e7-8dfc-16d5fea99bed None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:08.649122 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 156/310] 10.222.0.41 () {58 vars in 1334 bytes} [Fri May 27 09:25:08 2022] PUT /identity/v3/system/users/ee5d5d7846764faf872f8d70ee173cba/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:25:09.026363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ead4d1-ab39-4421-b013-d4abbedb2d78 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:09.026732 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ead4d1-ab39-4421-b013-d4abbedb2d78 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:09.026936 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ead4d1-ab39-4421-b013-d4abbedb2d78 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:09.028345 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 155/311] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:09.033776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735d67f-19ad-4ed1-a479-fe88e2327795 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:09.034329 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735d67f-19ad-4ed1-a479-fe88e2327795 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:09.034807 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735d67f-19ad-4ed1-a479-fe88e2327795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:09.052689 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-4735d67f-19ad-4ed1-a479-fe88e2327795 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:09.054214 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-4735d67f-19ad-4ed1-a479-fe88e2327795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:09.126197 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 157/312] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:09.148731 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ead4d1-ab39-4421-b013-d4abbedb2d78 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:09.259998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ead4d1-ab39-4421-b013-d4abbedb2d78 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:09.288529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:09.297005 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9109944-f4bf-4bc4-acad-e1af4631137d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:09.298031 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9109944-f4bf-4bc4-acad-e1af4631137d None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:09.298510 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9109944-f4bf-4bc4-acad-e1af4631137d None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:09.298980 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9109944-f4bf-4bc4-acad-e1af4631137d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:09.310151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9109944-f4bf-4bc4-acad-e1af4631137d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:09.318598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-e9109944-f4bf-4bc4-acad-e1af4631137d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:25:09.318598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:09.318598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:09.318598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:09.318598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:09.318598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:09.318598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:09.318598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:09.318598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:09.318598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:09.318598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:09.318598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:09.318598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:09.318598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:09.318598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:09.318598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:09.319473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:09.319473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:09.319473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:09.319473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:09.319473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:09.319473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:09.319473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:09.319473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:09.319473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:09.319473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:09.319473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:09.319473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:09.319473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:09.319473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:09.319473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:09.319473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:09.320266 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:09.320266 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:09.320266 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:09.320266 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:09.320266 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:09.320266 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:09.320266 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:09.320266 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:09.320266 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:09.320266 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:09.320266 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:25:09.320266 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:09.322943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 156/313] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:09.328395 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735d67f-19ad-4ed1-a479-fe88e2327795 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:09.433259 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735d67f-19ad-4ed1-a479-fe88e2327795 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:09.448178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:09.471215 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13dbc7-8a6c-4235-9f1b-19d54b69b38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:09.471931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13dbc7-8a6c-4235-9f1b-19d54b69b38f None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:09.472578 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13dbc7-8a6c-4235-9f1b-19d54b69b38f None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:09.473429 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13dbc7-8a6c-4235-9f1b-19d54b69b38f None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:09.474717 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13dbc7-8a6c-4235-9f1b-19d54b69b38f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:09.475029 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13dbc7-8a6c-4235-9f1b-19d54b69b38f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:09.476589 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13dbc7-8a6c-4235-9f1b-19d54b69b38f None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:09.485609 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 158/314] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:25:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:09.491359 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9109944-f4bf-4bc4-acad-e1af4631137d None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:09.602648 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9109944-f4bf-4bc4-acad-e1af4631137d None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:09.638039 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74c9cd-991a-4635-b9c0-eb1b604d9a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:09.638911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74c9cd-991a-4635-b9c0-eb1b604d9a19 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:09.639197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74c9cd-991a-4635-b9c0-eb1b604d9a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:09.639506 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74c9cd-991a-4635-b9c0-eb1b604d9a19 None admin] PATH_INFO: `/v3/users/7a8916c063d2430dacaca73bd53bb8cd` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:09.640709 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74c9cd-991a-4635-b9c0-eb1b604d9a19 None admin] RBAC: Authorizing `identity:get_user(user_id=7a8916c063d2430dacaca73bd53bb8cd)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:09.642157 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74c9cd-991a-4635-b9c0-eb1b604d9a19 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:09.644154 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 157/315] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:25:09 2022] GET /identity/v3/users/7a8916c063d2430dacaca73bd53bb8cd => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:09.652386 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13dbc7-8a6c-4235-9f1b-19d54b69b38f None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:09.759249 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13dbc7-8a6c-4235-9f1b-19d54b69b38f None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:09.795727 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17914131-de33-475e-acd1-1ecae260a1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:09.796390 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17914131-de33-475e-acd1-1ecae260a1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:09.796673 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17914131-de33-475e-acd1-1ecae260a1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:09.796948 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17914131-de33-475e-acd1-1ecae260a1d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:09.844216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:09.867696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17914131-de33-475e-acd1-1ecae260a1d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:09.869165 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17914131-de33-475e-acd1-1ecae260a1d2 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:09.983713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 159/316] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:25:09.989451 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74c9cd-991a-4635-b9c0-eb1b604d9a19 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:10.067692 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:10.099229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74c9cd-991a-4635-b9c0-eb1b604d9a19 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:10.135172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33988037-8b23-4045-ad6b-f8a96d8d8913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:10.135981 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33988037-8b23-4045-ad6b-f8a96d8d8913 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:10.136261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33988037-8b23-4045-ad6b-f8a96d8d8913 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:10.136532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33988037-8b23-4045-ad6b-f8a96d8d8913 None admin] PATH_INFO: `/v3/projects/b5242eba374f433f9faf5bc522321dd1` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:10.137715 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33988037-8b23-4045-ad6b-f8a96d8d8913 None admin] RBAC: Authorizing `identity:get_project(project_id=b5242eba374f433f9faf5bc522321dd1)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:10.139161 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33988037-8b23-4045-ad6b-f8a96d8d8913 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:10.141158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 158/317] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:25:09 2022] GET /identity/v3/projects/b5242eba374f433f9faf5bc522321dd1 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:10.152362 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17914131-de33-475e-acd1-1ecae260a1d2 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:10.157090 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5579f14-d16b-4bd5-a8f1-b7f1e1713513 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:10.157371 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5579f14-d16b-4bd5-a8f1-b7f1e1713513 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:10.157646 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5579f14-d16b-4bd5-a8f1-b7f1e1713513 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:10.159219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 159/318] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:25:10.168510 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708b237-071e-4dcc-ba52-3b9b09ca6c80 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:10.168796 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708b237-071e-4dcc-ba52-3b9b09ca6c80 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:10.169097 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708b237-071e-4dcc-ba52-3b9b09ca6c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:10.194041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-c708b237-071e-4dcc-ba52-3b9b09ca6c80 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:10.195614 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-c708b237-071e-4dcc-ba52-3b9b09ca6c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:10.257326 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:10.292485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17914131-de33-475e-acd1-1ecae260a1d2 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:10.293138 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 160/319] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:10.314763 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708b237-071e-4dcc-ba52-3b9b09ca6c80 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:10.332964 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad142c3-264a-40b7-ab7b-479fde686c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:10.333926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad142c3-264a-40b7-ab7b-479fde686c21 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:10.334352 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad142c3-264a-40b7-ab7b-479fde686c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:10.334767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad142c3-264a-40b7-ab7b-479fde686c21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:10.335874 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad142c3-264a-40b7-ab7b-479fde686c21 None admin] RBAC: Adding query filter params (role.id=2ed814d9cd4844f5b4ddfc8627b8fc6a, scope.project.id=b5242eba374f433f9faf5bc522321dd1, user.id=7a8916c063d2430dacaca73bd53bb8cd) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:10.336330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad142c3-264a-40b7-ab7b-479fde686c21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:10.337926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad142c3-264a-40b7-ab7b-479fde686c21 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:10.344334 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 160/320] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:25:10 2022] GET /identity/v3/role_assignments?user.id=7a8916c063d2430dacaca73bd53bb8cd&scope.project.id=b5242eba374f433f9faf5bc522321dd1&role.id=2ed814d9cd4844f5b4ddfc8627b8fc6a => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:10.383380 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:10.435818 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708b237-071e-4dcc-ba52-3b9b09ca6c80 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:10.479144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd0acf-80e9-42b5-833c-06914398a6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:10.480022 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd0acf-80e9-42b5-833c-06914398a6fe None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:10.480305 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd0acf-80e9-42b5-833c-06914398a6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:10.480578 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd0acf-80e9-42b5-833c-06914398a6fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:10.481869 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd0acf-80e9-42b5-833c-06914398a6fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:10.483395 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd0acf-80e9-42b5-833c-06914398a6fe None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:10.485123 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 161/321] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:10.491304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad142c3-264a-40b7-ab7b-479fde686c21 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:10.609320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad142c3-264a-40b7-ab7b-479fde686c21 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:10.647223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9738f-2a7d-4bee-a329-b270b5fc6364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:10.648217 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9738f-2a7d-4bee-a329-b270b5fc6364 None admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:10.648680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9738f-2a7d-4bee-a329-b270b5fc6364 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:10.649155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9738f-2a7d-4bee-a329-b270b5fc6364 None admin] PATH_INFO: `/v3/groups` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:10.650061 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9738f-2a7d-4bee-a329-b270b5fc6364 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:10.651794 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9738f-2a7d-4bee-a329-b270b5fc6364 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:10.655923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:10.671461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 161/322] 10.222.0.41 () {60 vars in 1134 bytes} [Fri May 27 09:25:10 2022] POST /identity/v3/groups => generated 226 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:25:10.682565 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf7a5f-4386-4076-8c69-a84a007e3b52 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:10.682853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf7a5f-4386-4076-8c69-a84a007e3b52 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:10.683157 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf7a5f-4386-4076-8c69-a84a007e3b52 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:10.684757 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 162/323] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:10.690978 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e69a3-b3e4-4468-9fef-417e7c579a89 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:10.691307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e69a3-b3e4-4468-9fef-417e7c579a89 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:10.692045 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e69a3-b3e4-4468-9fef-417e7c579a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:10.710820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-611e69a3-b3e4-4468-9fef-417e7c579a89 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:10.712171 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-611e69a3-b3e4-4468-9fef-417e7c579a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:10.790294 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 162/324] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:10.812069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf7a5f-4386-4076-8c69-a84a007e3b52 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:10.923861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf7a5f-4386-4076-8c69-a84a007e3b52 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:10.949899 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:10.961877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6725837-81da-4412-af05-7214239c2097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:10.962686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6725837-81da-4412-af05-7214239c2097 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:10.962966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6725837-81da-4412-af05-7214239c2097 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:10.963239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6725837-81da-4412-af05-7214239c2097 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:10.969913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e61fb4-f787-4542-a433-ee9e13596a86 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:10.970199 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e61fb4-f787-4542-a433-ee9e13596a86 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:10.970476 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e61fb4-f787-4542-a433-ee9e13596a86 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:10.972195 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 163/325] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:25:10.977884 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6725837-81da-4412-af05-7214239c2097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:10.979182 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81aafd-08e5-4f63-a7d7-a59d8299a0bc None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:10.979515 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81aafd-08e5-4f63-a7d7-a59d8299a0bc None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:10.979797 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81aafd-08e5-4f63-a7d7-a59d8299a0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:10.986104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-f6725837-81da-4412-af05-7214239c2097 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:25:10.986104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:10.986104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:10.986104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:10.986104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:10.986104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:10.986104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:10.986104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:10.986104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:10.986104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:10.986104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:10.986104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:10.986104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:10.986104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:10.986104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:10.986104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:10.987110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:10.987110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:10.987110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:10.987110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:10.987110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:10.987110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:10.987110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:10.987110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:10.987110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:10.987110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:10.987110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:10.987110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:10.987110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:10.987110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:10.987110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:10.987110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:10.987916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:10.987916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:10.987916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:10.987916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:10.987916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:10.987916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:10.987916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:10.987916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:10.987916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:10.987916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:10.987916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:25:10.987916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:10.987916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 163/326] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:10.994365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6725837-81da-4412-af05-7214239c2097 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:11.007548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-fd81aafd-08e5-4f63-a7d7-a59d8299a0bc None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:11.008767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-fd81aafd-08e5-4f63-a7d7-a59d8299a0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:11.103648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 164/327] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:11.119401 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6725837-81da-4412-af05-7214239c2097 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:11.128757 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81aafd-08e5-4f63-a7d7-a59d8299a0bc None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:11.163181 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2add9c-313a-4ce2-8084-e832875f5e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:11.163926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2add9c-313a-4ce2-8084-e832875f5e6c None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:11.164318 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2add9c-313a-4ce2-8084-e832875f5e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:11.164592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2add9c-313a-4ce2-8084-e832875f5e6c None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:11.165368 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2add9c-313a-4ce2-8084-e832875f5e6c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:11.165679 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2add9c-313a-4ce2-8084-e832875f5e6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:11.167038 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2add9c-313a-4ce2-8084-e832875f5e6c None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:11.177916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 164/328] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:25:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:11.183470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2add9c-313a-4ce2-8084-e832875f5e6c None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:11.208341 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:11.240211 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:11.272032 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81aafd-08e5-4f63-a7d7-a59d8299a0bc None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:11.311145 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2add9c-313a-4ce2-8084-e832875f5e6c None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:11.321929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2782709-3fb2-4b36-a793-291b57a8cc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:11.322738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2782709-3fb2-4b36-a793-291b57a8cc2f None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:11.323023 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2782709-3fb2-4b36-a793-291b57a8cc2f None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:11.323343 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2782709-3fb2-4b36-a793-291b57a8cc2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:11.339863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2782709-3fb2-4b36-a793-291b57a8cc2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:11.352799 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0eb5c-5fd0-49be-a10a-05414d642e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:11.353954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0eb5c-5fd0-49be-a10a-05414d642e7e None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:11.354111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-d2782709-3fb2-4b36-a793-291b57a8cc2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:25:11.354111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:11.354111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:11.354111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:11.354111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:11.354111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:11.354111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:11.354111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:11.354111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:11.354111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:11.354111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:11.354111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:11.354111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:11.354111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:11.354111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:11.354111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:11.354929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:11.354929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:11.354929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:11.354929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:11.354929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:11.354929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:11.354929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:11.354929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:11.354929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:11.354929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:11.354929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:11.354929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:11.354929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:11.354929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:11.354929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:11.354929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:11.355777 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:11.355777 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:11.355777 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:11.355777 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:11.355777 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:11.355777 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:11.355777 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:11.355777 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:11.355777 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:11.355777 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:11.355777 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:25:11.355777 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:11.355777 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 165/329] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:25:11.357249 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0eb5c-5fd0-49be-a10a-05414d642e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:11.357732 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0eb5c-5fd0-49be-a10a-05414d642e7e None admin] PATH_INFO: `/v3/users/3148e56f61fa4073908311ed94c1ba6e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:11.359220 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0eb5c-5fd0-49be-a10a-05414d642e7e None admin] RBAC: Authorizing `identity:get_user(user_id=3148e56f61fa4073908311ed94c1ba6e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:11.361444 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0eb5c-5fd0-49be-a10a-05414d642e7e None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:11.361556 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2782709-3fb2-4b36-a793-291b57a8cc2f None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:11.364364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 165/330] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:25:11 2022] GET /identity/v3/users/3148e56f61fa4073908311ed94c1ba6e => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:11.369653 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0eb5c-5fd0-49be-a10a-05414d642e7e None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:11.489755 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2782709-3fb2-4b36-a793-291b57a8cc2f None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:11.503789 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0eb5c-5fd0-49be-a10a-05414d642e7e None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:11.511004 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:11.527289 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:11.537633 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fd27f-ea40-4a60-bf48-d5199e4b770b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:11.538347 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fd27f-ea40-4a60-bf48-d5199e4b770b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:11.538632 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fd27f-ea40-4a60-bf48-d5199e4b770b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:11.538907 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fd27f-ea40-4a60-bf48-d5199e4b770b None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:11.540684 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fd27f-ea40-4a60-bf48-d5199e4b770b None admin] RBAC: Adding query filter params (name=member) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:11.540999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fd27f-ea40-4a60-bf48-d5199e4b770b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:11.542413 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fd27f-ea40-4a60-bf48-d5199e4b770b None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:11.553086 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce7a4a-d778-4bb6-9d8a-9cefa6bcb284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:11.553377 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 166/331] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:25:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:11.554491 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce7a4a-d778-4bb6-9d8a-9cefa6bcb284 None admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:11.554997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce7a4a-d778-4bb6-9d8a-9cefa6bcb284 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:11.555564 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce7a4a-d778-4bb6-9d8a-9cefa6bcb284 None admin] PATH_INFO: `/v3/system/users/3148e56f61fa4073908311ed94c1ba6e/roles/2ed814d9cd4844f5b4ddfc8627b8fc6a` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:11.557380 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce7a4a-d778-4bb6-9d8a-9cefa6bcb284 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3148e56f61fa4073908311ed94c1ba6e, role_id=2ed814d9cd4844f5b4ddfc8627b8fc6a)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:11.559034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce7a4a-d778-4bb6-9d8a-9cefa6bcb284 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:11.559562 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fd27f-ea40-4a60-bf48-d5199e4b770b None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:11.573552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 166/332] 10.222.0.41 () {58 vars in 1334 bytes} [Fri May 27 09:25:11 2022] PUT /identity/v3/system/users/3148e56f61fa4073908311ed94c1ba6e/roles/2ed814d9cd4844f5b4ddfc8627b8fc6a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:25:11.682589 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fd27f-ea40-4a60-bf48-d5199e4b770b None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:11.720734 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29d134-4708-4040-8676-69ac8c247836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:11.721647 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29d134-4708-4040-8676-69ac8c247836 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:11.721931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29d134-4708-4040-8676-69ac8c247836 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:11.722207 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29d134-4708-4040-8676-69ac8c247836 None admin] PATH_INFO: `/v3/users/ee5d5d7846764faf872f8d70ee173cba` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:11.724109 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29d134-4708-4040-8676-69ac8c247836 None admin] RBAC: Authorizing `identity:get_user(user_id=ee5d5d7846764faf872f8d70ee173cba)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:11.725593 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29d134-4708-4040-8676-69ac8c247836 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:11.727318 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 167/333] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:25:11 2022] GET /identity/v3/users/ee5d5d7846764faf872f8d70ee173cba => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:11.733341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce7a4a-d778-4bb6-9d8a-9cefa6bcb284 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:11.841681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce7a4a-d778-4bb6-9d8a-9cefa6bcb284 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:11.877051 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea40833-f7d8-4eac-8b93-e2a82c87c1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:11.877717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea40833-f7d8-4eac-8b93-e2a82c87c1bd None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:11.878003 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea40833-f7d8-4eac-8b93-e2a82c87c1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:11.878278 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea40833-f7d8-4eac-8b93-e2a82c87c1bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:11.879161 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea40833-f7d8-4eac-8b93-e2a82c87c1bd None admin] RBAC: Adding query filter params (role.id=207b29fd2d8344ceb403e1c2e9d91ac2, user.id=ee5d5d7846764faf872f8d70ee173cba, scope.system=all) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:11.879507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea40833-f7d8-4eac-8b93-e2a82c87c1bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:11.880934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea40833-f7d8-4eac-8b93-e2a82c87c1bd None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:11.893152 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 167/334] 10.222.0.41 () {56 vars in 1308 bytes} [Fri May 27 09:25:11 2022] GET /identity/v3/role_assignments?user.id=ee5d5d7846764faf872f8d70ee173cba&scope.system=all&role.id=207b29fd2d8344ceb403e1c2e9d91ac2 => generated 510 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:13.321363 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bb6b8-1b9a-4f2e-97a0-f36573f1cfcf None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:13.321363 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bb6b8-1b9a-4f2e-97a0-f36573f1cfcf None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:13.321363 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bb6b8-1b9a-4f2e-97a0-f36573f1cfcf None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:13.322477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 168/335] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:13.328569 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c31c7-01b3-4a3c-88a5-27687138afc0 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:13.329413 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c31c7-01b3-4a3c-88a5-27687138afc0 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:13.329916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c31c7-01b3-4a3c-88a5-27687138afc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:13.350644 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-588c31c7-01b3-4a3c-88a5-27687138afc0 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:13.352213 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-588c31c7-01b3-4a3c-88a5-27687138afc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:13.380587 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:13.424925 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 168/336] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:13.449100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bb6b8-1b9a-4f2e-97a0-f36573f1cfcf None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:13.512522 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:13.573058 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bb6b8-1b9a-4f2e-97a0-f36573f1cfcf None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:13.614260 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317851c-a684-46cf-940d-a4d5ed3b7a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:13.615070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317851c-a684-46cf-940d-a4d5ed3b7a38 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:13.615380 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317851c-a684-46cf-940d-a4d5ed3b7a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:13.615663 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317851c-a684-46cf-940d-a4d5ed3b7a38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:13.630229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317851c-a684-46cf-940d-a4d5ed3b7a38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:13.638094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-2317851c-a684-46cf-940d-a4d5ed3b7a38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:25:13.638094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:13.638094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:13.638094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:13.638094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:13.638094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:13.638094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:13.638094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:13.638094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:13.638094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:13.638094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:13.638094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:13.638094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:13.638094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:13.638094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:13.638094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:13.639011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:13.639011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:13.639011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:13.639011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:13.639011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:13.639011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:13.639011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:13.639011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:13.639011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:13.639011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:13.639011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:13.639011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:13.639011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:13.639011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:13.639011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:13.639011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:13.640284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:13.640284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:13.640284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:13.640284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:13.640284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:13.640284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:13.640284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:13.640284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:13.640284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:13.640284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:13.640284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:25:13.640284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:13.640284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 169/337] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:13.645884 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c31c7-01b3-4a3c-88a5-27687138afc0 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:13.775960 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c31c7-01b3-4a3c-88a5-27687138afc0 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:13.811118 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba9604-b3ed-4ba6-aebd-82ff8b1a8d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:13.811840 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba9604-b3ed-4ba6-aebd-82ff8b1a8d3a None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:13.812258 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba9604-b3ed-4ba6-aebd-82ff8b1a8d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:13.812534 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba9604-b3ed-4ba6-aebd-82ff8b1a8d3a None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:13.813278 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba9604-b3ed-4ba6-aebd-82ff8b1a8d3a None admin] RBAC: Adding query filter params (name=member) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:13.813584 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba9604-b3ed-4ba6-aebd-82ff8b1a8d3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:13.814958 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba9604-b3ed-4ba6-aebd-82ff8b1a8d3a None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:13.824518 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 169/338] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:25:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:13.829984 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317851c-a684-46cf-940d-a4d5ed3b7a38 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:13.946517 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317851c-a684-46cf-940d-a4d5ed3b7a38 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:13.953804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:13.986499 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdae63-29dd-4e30-a0b1-2984aafed3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:13.987159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdae63-29dd-4e30-a0b1-2984aafed3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:13.987473 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdae63-29dd-4e30-a0b1-2984aafed3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:13.987756 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdae63-29dd-4e30-a0b1-2984aafed3b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:14.017797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642e446-eff2-4ddc-92b2-8d4e6ace170f None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:14.018125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642e446-eff2-4ddc-92b2-8d4e6ace170f None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:14.018370 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642e446-eff2-4ddc-92b2-8d4e6ace170f None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:14.020111 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 170/339] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:25:14.027441 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74025e4f-e487-466a-b662-bd99da89c264 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:14.028029 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74025e4f-e487-466a-b662-bd99da89c264 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:14.028515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74025e4f-e487-466a-b662-bd99da89c264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:14.072513 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-74025e4f-e487-466a-b662-bd99da89c264 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:14.073708 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-74025e4f-e487-466a-b662-bd99da89c264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:14.080722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdae63-29dd-4e30-a0b1-2984aafed3b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:14.082247 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdae63-29dd-4e30-a0b1-2984aafed3b8 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:14.155637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:14.228671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 171/340] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:25:14.233248 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 170/341] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 09:25:14.239541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74025e4f-e487-466a-b662-bd99da89c264 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:14.270271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdae63-29dd-4e30-a0b1-2984aafed3b8 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:14.278912 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:14.388384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74025e4f-e487-466a-b662-bd99da89c264 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:14.461543 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7685cad-b88e-49c8-bea2-87752a26ac01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:14.462433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7685cad-b88e-49c8-bea2-87752a26ac01 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:14.462722 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7685cad-b88e-49c8-bea2-87752a26ac01 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:14.463006 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7685cad-b88e-49c8-bea2-87752a26ac01 None admin] PATH_INFO: `/v3/projects/9af9b910687447d4b7b9285bfc31988e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:14.468179 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7685cad-b88e-49c8-bea2-87752a26ac01 None admin] RBAC: Authorizing `identity:get_project(project_id=9af9b910687447d4b7b9285bfc31988e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:14.469632 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdae63-29dd-4e30-a0b1-2984aafed3b8 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:14.470099 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7685cad-b88e-49c8-bea2-87752a26ac01 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:14.475301 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 172/342] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:25:14 2022] GET /identity/v3/projects/9af9b910687447d4b7b9285bfc31988e => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:14.477809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7685cad-b88e-49c8-bea2-87752a26ac01 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:14.530771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7843f-8af5-4039-8288-2ae6da95cde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:14.531892 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7843f-8af5-4039-8288-2ae6da95cde0 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:14.532328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7843f-8af5-4039-8288-2ae6da95cde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:14.532582 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:14.532971 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7843f-8af5-4039-8288-2ae6da95cde0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:14.556688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7843f-8af5-4039-8288-2ae6da95cde0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:14.569450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-12c7843f-8af5-4039-8288-2ae6da95cde0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:25:14.569450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:14.569450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:14.569450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:14.569450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:14.569450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:14.569450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:14.569450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:14.569450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:14.569450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:14.569450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:14.569450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:14.569450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:14.569450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:14.569450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:14.569450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:14.570353 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:14.570353 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:14.570353 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:14.570353 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:14.570353 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:14.570353 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:14.570353 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:14.570353 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:14.570353 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:14.570353 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:14.570353 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:14.570353 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:14.570353 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:14.570353 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:14.570353 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:14.570353 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:14.571137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:14.571137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:14.571137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:14.571137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:14.571137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:14.571137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:14.571137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:14.571137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:14.571137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:14.571137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:14.571137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:25:14.571137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:14.573864 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 171/343] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 09:25:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:25:14.583579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7843f-8af5-4039-8288-2ae6da95cde0 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:14.669943 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:14.698675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7843f-8af5-4039-8288-2ae6da95cde0 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:14.715005 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7685cad-b88e-49c8-bea2-87752a26ac01 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:14.734917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14184d05-0b13-4fc9-935c-3710379ef598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:14.736465 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14184d05-0b13-4fc9-935c-3710379ef598 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:14.736961 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14184d05-0b13-4fc9-935c-3710379ef598 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:14.737452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14184d05-0b13-4fc9-935c-3710379ef598 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:14.738464 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14184d05-0b13-4fc9-935c-3710379ef598 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:14.739233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14184d05-0b13-4fc9-935c-3710379ef598 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:14.740937 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14184d05-0b13-4fc9-935c-3710379ef598 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:14.751078 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 172/344] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:14.761950 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14184d05-0b13-4fc9-935c-3710379ef598 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:14.811301 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958506fc-5cf0-4583-9d6f-2e44af6f2cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:14.811301 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958506fc-5cf0-4583-9d6f-2e44af6f2cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:14.811301 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958506fc-5cf0-4583-9d6f-2e44af6f2cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:14.811301 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958506fc-5cf0-4583-9d6f-2e44af6f2cd6 None admin] PATH_INFO: `/v3/groups/cb220b4c757845e1b97e5c3736908d3e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:14.825667 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958506fc-5cf0-4583-9d6f-2e44af6f2cd6 None admin] RBAC: Authorizing `identity:get_group(group_id=cb220b4c757845e1b97e5c3736908d3e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:14.826903 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958506fc-5cf0-4583-9d6f-2e44af6f2cd6 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:14.829708 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 173/345] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 09:25:14 2022] GET /identity/v3/groups/cb220b4c757845e1b97e5c3736908d3e => generated 226 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:14.833631 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f55da-888b-4ef8-aeea-cd5202ad41b3 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:14.833921 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f55da-888b-4ef8-aeea-cd5202ad41b3 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:14.834276 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f55da-888b-4ef8-aeea-cd5202ad41b3 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:14.835585 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 174/346] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:25:14.844035 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f55da-888b-4ef8-aeea-cd5202ad41b3 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:14.939838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14184d05-0b13-4fc9-935c-3710379ef598 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:14.991611 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:14.997392 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d58284-298b-4715-9052-6e8d9e760335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:14.998187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d58284-298b-4715-9052-6e8d9e760335 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:14.998356 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d58284-298b-4715-9052-6e8d9e760335 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:14.998601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d58284-298b-4715-9052-6e8d9e760335 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:15.020197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:15.040339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f55da-888b-4ef8-aeea-cd5202ad41b3 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:15.135062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d58284-298b-4715-9052-6e8d9e760335 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:15.136042 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1170c-85ad-44f2-b758-0e3fe5f1f027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:15.136582 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d58284-298b-4715-9052-6e8d9e760335 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:15.136763 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1170c-85ad-44f2-b758-0e3fe5f1f027 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:15.137013 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1170c-85ad-44f2-b758-0e3fe5f1f027 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:15.137282 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1170c-85ad-44f2-b758-0e3fe5f1f027 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:15.138119 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1170c-85ad-44f2-b758-0e3fe5f1f027 None admin] RBAC: Adding query filter params (group.id=cb220b4c757845e1b97e5c3736908d3e, role.id=207b29fd2d8344ceb403e1c2e9d91ac2, scope.project.id=9af9b910687447d4b7b9285bfc31988e) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:15.138433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1170c-85ad-44f2-b758-0e3fe5f1f027 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:15.139898 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1170c-85ad-44f2-b758-0e3fe5f1f027 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:15.151605 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 175/347] 10.222.0.41 () {56 vars in 1376 bytes} [Fri May 27 09:25:14 2022] GET /identity/v3/role_assignments?group.id=cb220b4c757845e1b97e5c3736908d3e&scope.project.id=9af9b910687447d4b7b9285bfc31988e&role.id=207b29fd2d8344ceb403e1c2e9d91ac2 => generated 260 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:15.153247 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daa052-fac3-4f06-9a34-d3d04abd0f71 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:15.153690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daa052-fac3-4f06-9a34-d3d04abd0f71 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:15.154110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daa052-fac3-4f06-9a34-d3d04abd0f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:15.193132 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-c0daa052-fac3-4f06-9a34-d3d04abd0f71 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:15.194594 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-c0daa052-fac3-4f06-9a34-d3d04abd0f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:15.281493 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 173/348] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:25:15.290475 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d58284-298b-4715-9052-6e8d9e760335 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:15.321914 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:15.339614 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 176/349] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:15.351619 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e415332-efc0-4248-8423-1106b8450243 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:15.351913 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e415332-efc0-4248-8423-1106b8450243 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:15.352194 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e415332-efc0-4248-8423-1106b8450243 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:15.353877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 177/350] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:25:15.359203 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1752c0-1a98-41b5-a507-66904ff80bdf None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:15.359746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1752c0-1a98-41b5-a507-66904ff80bdf None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:15.360446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1752c0-1a98-41b5-a507-66904ff80bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:15.397805 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-1e1752c0-1a98-41b5-a507-66904ff80bdf None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:15.399734 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-1e1752c0-1a98-41b5-a507-66904ff80bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:15.404982 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d58284-298b-4715-9052-6e8d9e760335 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:15.444200 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa3d54-fc02-4427-b047-c751957d4b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:15.445532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa3d54-fc02-4427-b047-c751957d4b3f None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:15.445970 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa3d54-fc02-4427-b047-c751957d4b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:15.446395 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa3d54-fc02-4427-b047-c751957d4b3f None admin] PATH_INFO: `/v3/projects/9af9b910687447d4b7b9285bfc31988e` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:15.448020 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa3d54-fc02-4427-b047-c751957d4b3f None admin] RBAC: Authorizing `identity:get_project(project_id=9af9b910687447d4b7b9285bfc31988e)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:15.449648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa3d54-fc02-4427-b047-c751957d4b3f None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:15.451630 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 174/351] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:25:15 2022] GET /identity/v3/projects/9af9b910687447d4b7b9285bfc31988e => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:15.452605 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa3d54-fc02-4427-b047-c751957d4b3f None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:15.522672 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 178/352] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:25:15.524329 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cd58f-2176-4e02-8de7-bf25674320e6 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:15.524756 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cd58f-2176-4e02-8de7-bf25674320e6 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:15.525180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cd58f-2176-4e02-8de7-bf25674320e6 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:15.528992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 179/353] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:15.529911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cd58f-2176-4e02-8de7-bf25674320e6 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:15.548764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:15.601121 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:15.607893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa3d54-fc02-4427-b047-c751957d4b3f None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:15.646771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6120428-ced5-474f-b7a8-8c3f7c01dc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:15.647925 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6120428-ced5-474f-b7a8-8c3f7c01dc87 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:15.648408 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6120428-ced5-474f-b7a8-8c3f7c01dc87 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:15.648831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6120428-ced5-474f-b7a8-8c3f7c01dc87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:15.656530 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cd58f-2176-4e02-8de7-bf25674320e6 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:15.660820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6120428-ced5-474f-b7a8-8c3f7c01dc87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:15.671033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-b6120428-ced5-474f-b7a8-8c3f7c01dc87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:25:15.671033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:15.671033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:15.671033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:15.671033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:15.671033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:15.671033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:15.671033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:15.671033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:15.671033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:15.671033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:15.671033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:15.671033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:15.671033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:15.671033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:15.671033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:15.672479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:15.672479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:15.672479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:15.672479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:15.672479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:15.672479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:15.672479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:15.672479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:15.672479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:15.672479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:15.672479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:15.672479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:15.672479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:15.672479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:15.672479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:15.672479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:15.673458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:15.673458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:15.673458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:15.673458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:15.673458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:15.673458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:15.673458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:15.673458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:15.673458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:15.673458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:15.673458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:25:15.673458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:15.675531 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 175/354] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:15.677425 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525d0eb-2b60-4b9e-9581-7a859d0152f7 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:15.677855 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525d0eb-2b60-4b9e-9581-7a859d0152f7 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:15.678315 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525d0eb-2b60-4b9e-9581-7a859d0152f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:15.696185 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b9d50-3942-476c-ac0c-1b90f8598efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:15.696960 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-6525d0eb-2b60-4b9e-9581-7a859d0152f7 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:15.697080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b9d50-3942-476c-ac0c-1b90f8598efc None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:15.697244 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b9d50-3942-476c-ac0c-1b90f8598efc None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:15.697514 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b9d50-3942-476c-ac0c-1b90f8598efc None admin] PATH_INFO: `/v3/groups/cb220b4c757845e1b97e5c3736908d3e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:15.698708 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b9d50-3942-476c-ac0c-1b90f8598efc None admin] RBAC: Authorizing `identity:get_group(group_id=cb220b4c757845e1b97e5c3736908d3e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:15.698899 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-6525d0eb-2b60-4b9e-9581-7a859d0152f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:15.700194 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b9d50-3942-476c-ac0c-1b90f8598efc None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:15.702122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 180/355] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 09:25:15 2022] GET /identity/v3/groups/cb220b4c757845e1b97e5c3736908d3e => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:15.703348 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b9d50-3942-476c-ac0c-1b90f8598efc None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:15.776723 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 176/356] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:15.777829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525d0eb-2b60-4b9e-9581-7a859d0152f7 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:15.796303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:15.817956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b9d50-3942-476c-ac0c-1b90f8598efc None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:15.855646 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0f163-6b8d-4035-9644-274db3b3c837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:15.856453 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0f163-6b8d-4035-9644-274db3b3c837 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:15.856744 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0f163-6b8d-4035-9644-274db3b3c837 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:15.857026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0f163-6b8d-4035-9644-274db3b3c837 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:15.870400 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0f163-6b8d-4035-9644-274db3b3c837 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:15.872285 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:15.880735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-98c0f163-6b8d-4035-9644-274db3b3c837 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:25:15.880735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:15.880735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:15.880735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:15.880735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:15.880735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:15.880735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:15.880735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:15.880735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:15.880735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:15.880735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:15.880735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:15.880735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:15.880735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:15.880735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:15.880735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:15.881862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:15.881862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:15.881862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:15.881862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:15.881862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:15.881862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:15.881862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:15.881862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:15.881862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:15.881862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:15.881862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:15.881862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:15.881862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:15.881862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:15.881862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:15.881862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:15.882830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:15.882830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:15.882830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:15.882830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:15.882830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:15.882830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:15.882830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:15.882830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:15.882830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:15.882830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:15.882830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 09:25:15.882830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:15.882830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 181/357] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:15.883627 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0f163-6b8d-4035-9644-274db3b3c837 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:15.907301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525d0eb-2b60-4b9e-9581-7a859d0152f7 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:15.948008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6fec4-646b-4c28-b642-5b6f867ef02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:15.949039 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6fec4-646b-4c28-b642-5b6f867ef02b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:15.949472 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6fec4-646b-4c28-b642-5b6f867ef02b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:15.949820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6fec4-646b-4c28-b642-5b6f867ef02b None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:15.950583 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6fec4-646b-4c28-b642-5b6f867ef02b None admin] RBAC: Adding query filter params (name=member) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:15.950896 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6fec4-646b-4c28-b642-5b6f867ef02b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:15.952471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6fec4-646b-4c28-b642-5b6f867ef02b None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:15.963502 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 177/358] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:25:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:15.964489 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6fec4-646b-4c28-b642-5b6f867ef02b None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:16.008291 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0f163-6b8d-4035-9644-274db3b3c837 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:16.054427 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871a44e-472b-4d51-b48b-bfe6ee66f7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:16.055096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871a44e-472b-4d51-b48b-bfe6ee66f7ac None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:16.056547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871a44e-472b-4d51-b48b-bfe6ee66f7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:16.056833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871a44e-472b-4d51-b48b-bfe6ee66f7ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:16.057674 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871a44e-472b-4d51-b48b-bfe6ee66f7ac None admin] RBAC: Adding query filter params (group.id=cb220b4c757845e1b97e5c3736908d3e, role.id=580d60e140704327b90a80fc59a2165c, scope.project.id=9af9b910687447d4b7b9285bfc31988e) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:16.057986 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871a44e-472b-4d51-b48b-bfe6ee66f7ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:16.059572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871a44e-472b-4d51-b48b-bfe6ee66f7ac None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:16.065626 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 182/359] 10.222.0.41 () {56 vars in 1376 bytes} [Fri May 27 09:25:15 2022] GET /identity/v3/role_assignments?group.id=cb220b4c757845e1b97e5c3736908d3e&scope.project.id=9af9b910687447d4b7b9285bfc31988e&role.id=580d60e140704327b90a80fc59a2165c => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:16.066991 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871a44e-472b-4d51-b48b-bfe6ee66f7ac None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:16.070518 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:16.128618 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6fec4-646b-4c28-b642-5b6f867ef02b None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:16.194134 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f496b7-6641-4a83-896a-344d738c8cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:16.195018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f496b7-6641-4a83-896a-344d738c8cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:16.195383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f496b7-6641-4a83-896a-344d738c8cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:16.195710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f496b7-6641-4a83-896a-344d738c8cd1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:16.211949 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f496b7-6641-4a83-896a-344d738c8cd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:16.220655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-70f496b7-6641-4a83-896a-344d738c8cd1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:25:16.220655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:16.220655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:16.220655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:16.220655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:16.220655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:16.220655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:16.220655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:16.220655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:16.220655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:16.220655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:16.220655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:16.220655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:16.220655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:16.220655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:16.220655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:16.221603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:16.221603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:16.221603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:16.221603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:16.221603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:16.221603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:16.221603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:16.221603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:16.221603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:16.221603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:16.221603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:16.221603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:16.221603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:16.221603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:16.221603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:16.221603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:16.222381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:16.222381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:16.222381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:16.222381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:16.222381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:16.222381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:16.222381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:16.222381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:16.222381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:16.222381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:16.222381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:25:16.222381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:16.222381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 178/360] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 09:25:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:16.224402 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f496b7-6641-4a83-896a-344d738c8cd1 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:16.247311 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:16.281893 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871a44e-472b-4d51-b48b-bfe6ee66f7ac None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:16.326377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a799b1-c0e3-47df-8558-9434a3de3abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:16.328070 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a799b1-c0e3-47df-8558-9434a3de3abe None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:16.329991 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a799b1-c0e3-47df-8558-9434a3de3abe None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:16.329991 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a799b1-c0e3-47df-8558-9434a3de3abe None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:16.329991 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a799b1-c0e3-47df-8558-9434a3de3abe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:16.329991 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a799b1-c0e3-47df-8558-9434a3de3abe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:16.331055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a799b1-c0e3-47df-8558-9434a3de3abe None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:16.343701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 183/361] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:25:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:16.344303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a799b1-c0e3-47df-8558-9434a3de3abe None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:16.366744 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f496b7-6641-4a83-896a-344d738c8cd1 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:16.408166 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df11d82-468b-4ef9-827c-bd50a16e4497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:16.409255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df11d82-468b-4ef9-827c-bd50a16e4497 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:16.409554 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df11d82-468b-4ef9-827c-bd50a16e4497 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:16.409830 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df11d82-468b-4ef9-827c-bd50a16e4497 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:16.419215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:16.463021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a799b1-c0e3-47df-8558-9434a3de3abe None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:16.508511 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df11d82-468b-4ef9-827c-bd50a16e4497 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:16.509149 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df11d82-468b-4ef9-827c-bd50a16e4497 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:16.509689 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60acff7-01bf-4932-bd49-13ca966f4292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:16.510603 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60acff7-01bf-4932-bd49-13ca966f4292 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:16.511092 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60acff7-01bf-4932-bd49-13ca966f4292 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:16.511582 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60acff7-01bf-4932-bd49-13ca966f4292 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:16.512536 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60acff7-01bf-4932-bd49-13ca966f4292 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:16.513065 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60acff7-01bf-4932-bd49-13ca966f4292 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:16.516643 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60acff7-01bf-4932-bd49-13ca966f4292 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:16.520213 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:16.528066 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 184/362] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:16.529433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd124222-93e7-4cd8-83f3-75970fc5b62b None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:16.529812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd124222-93e7-4cd8-83f3-75970fc5b62b None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:16.530159 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd124222-93e7-4cd8-83f3-75970fc5b62b None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:16.531640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 185/363] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:16.532302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd124222-93e7-4cd8-83f3-75970fc5b62b None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:16.652083 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 179/364] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:25:16.654132 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd124222-93e7-4cd8-83f3-75970fc5b62b None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:16.654376 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e56f2-d99b-4f86-abfe-ce3f5f9489a0 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:16.654850 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e56f2-d99b-4f86-abfe-ce3f5f9489a0 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:16.655312 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e56f2-d99b-4f86-abfe-ce3f5f9489a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:16.681487 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-037e56f2-d99b-4f86-abfe-ce3f5f9489a0 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:16.682985 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-037e56f2-d99b-4f86-abfe-ce3f5f9489a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:16.691625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:16.700576 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90cbc2-a12f-46c7-bcf3-6ff0a4d3f3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:16.701759 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90cbc2-a12f-46c7-bcf3-6ff0a4d3f3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:16.702404 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90cbc2-a12f-46c7-bcf3-6ff0a4d3f3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:16.702853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90cbc2-a12f-46c7-bcf3-6ff0a4d3f3c0 None admin] PATH_INFO: `/v3/users/3148e56f61fa4073908311ed94c1ba6e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:16.704189 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90cbc2-a12f-46c7-bcf3-6ff0a4d3f3c0 None admin] RBAC: Authorizing `identity:get_user(user_id=3148e56f61fa4073908311ed94c1ba6e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:16.705686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90cbc2-a12f-46c7-bcf3-6ff0a4d3f3c0 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:16.707896 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 186/365] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:25:16 2022] GET /identity/v3/users/3148e56f61fa4073908311ed94c1ba6e => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:16.709086 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90cbc2-a12f-46c7-bcf3-6ff0a4d3f3c0 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:16.768479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 180/366] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:16.769412 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e56f2-d99b-4f86-abfe-ce3f5f9489a0 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:16.822941 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:16.833720 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90cbc2-a12f-46c7-bcf3-6ff0a4d3f3c0 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:16.875556 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e0020-e7ab-4cf3-81ec-6864175bf666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:16.876316 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e0020-e7ab-4cf3-81ec-6864175bf666 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:16.876605 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e0020-e7ab-4cf3-81ec-6864175bf666 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:16.876882 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e0020-e7ab-4cf3-81ec-6864175bf666 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:16.906766 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e56f2-d99b-4f86-abfe-ce3f5f9489a0 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:16.949253 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:16.955591 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b8760-6732-4734-b2f8-4bb535a8a7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:16.956731 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b8760-6732-4734-b2f8-4bb535a8a7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:16.957065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b8760-6732-4734-b2f8-4bb535a8a7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:16.957344 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b8760-6732-4734-b2f8-4bb535a8a7d2 None admin] PATH_INFO: `/v3/projects/b5242eba374f433f9faf5bc522321dd1` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:16.957443 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e0020-e7ab-4cf3-81ec-6864175bf666 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:16.958566 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b8760-6732-4734-b2f8-4bb535a8a7d2 None admin] RBAC: Authorizing `identity:get_project(project_id=b5242eba374f433f9faf5bc522321dd1)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:16.958836 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e0020-e7ab-4cf3-81ec-6864175bf666 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:16.960207 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b8760-6732-4734-b2f8-4bb535a8a7d2 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:16.963387 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 181/367] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:25:16 2022] GET /identity/v3/projects/b5242eba374f433f9faf5bc522321dd1 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:16.964167 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b8760-6732-4734-b2f8-4bb535a8a7d2 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:17.084355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b8760-6732-4734-b2f8-4bb535a8a7d2 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:17.087796 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 187/368] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:25:17.088545 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e0020-e7ab-4cf3-81ec-6864175bf666 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:17.092195 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:17.120678 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc12f9c-64ae-4545-9297-d8ddd35d2fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:17.121344 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc12f9c-64ae-4545-9297-d8ddd35d2fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:17.121630 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc12f9c-64ae-4545-9297-d8ddd35d2fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:17.121907 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc12f9c-64ae-4545-9297-d8ddd35d2fe6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:17.122746 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc12f9c-64ae-4545-9297-d8ddd35d2fe6 None admin] RBAC: Adding query filter params (role.id=2ed814d9cd4844f5b4ddfc8627b8fc6a, user.id=3148e56f61fa4073908311ed94c1ba6e, scope.system=all) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:17.123061 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc12f9c-64ae-4545-9297-d8ddd35d2fe6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:17.124545 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc12f9c-64ae-4545-9297-d8ddd35d2fe6 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:17.138655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 182/369] 10.222.0.41 () {56 vars in 1308 bytes} [Fri May 27 09:25:16 2022] GET /identity/v3/role_assignments?user.id=3148e56f61fa4073908311ed94c1ba6e&scope.system=all&role.id=2ed814d9cd4844f5b4ddfc8627b8fc6a => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:17.139536 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc12f9c-64ae-4545-9297-d8ddd35d2fe6 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:17.192996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:17.200131 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e0020-e7ab-4cf3-81ec-6864175bf666 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:17.240350 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cdead-14dc-46e1-9cbc-00083f04895a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:17.241157 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cdead-14dc-46e1-9cbc-00083f04895a None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:17.241440 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cdead-14dc-46e1-9cbc-00083f04895a None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:17.241722 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cdead-14dc-46e1-9cbc-00083f04895a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:17.253027 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286cdead-14dc-46e1-9cbc-00083f04895a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:17.256396 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc12f9c-64ae-4545-9297-d8ddd35d2fe6 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:17.262790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-286cdead-14dc-46e1-9cbc-00083f04895a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:25:17.262790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:17.262790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:17.262790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:17.262790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:17.262790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:17.262790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:17.262790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:17.262790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:17.262790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:17.262790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:17.262790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:17.262790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:17.262790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:17.262790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:17.262790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:17.263791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:17.263791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:17.263791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:17.263791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:17.263791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:17.263791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:17.263791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:17.263791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:17.263791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:17.263791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:17.263791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:17.263791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:17.263791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:17.263791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:17.263791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:17.263791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:17.264540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:17.264540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:17.264540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:17.264540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:17.264540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:17.264540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:17.264540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:17.264540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:17.264540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:17.264540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:17.264540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:25:17.264540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:17.267387 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 188/370] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:25:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:17.268231 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cdead-14dc-46e1-9cbc-00083f04895a None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:17.299450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d565454-8237-428c-b02e-088ce4f260db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:17.300622 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d565454-8237-428c-b02e-088ce4f260db None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:17.302069 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d565454-8237-428c-b02e-088ce4f260db None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:17.302545 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d565454-8237-428c-b02e-088ce4f260db None admin] PATH_INFO: `/v3/groups/cb220b4c757845e1b97e5c3736908d3e` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:17.304937 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d565454-8237-428c-b02e-088ce4f260db None admin] RBAC: Authorizing `identity:get_group(group_id=cb220b4c757845e1b97e5c3736908d3e)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:17.306572 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d565454-8237-428c-b02e-088ce4f260db None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:17.308710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 183/371] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 09:25:17 2022] GET /identity/v3/groups/cb220b4c757845e1b97e5c3736908d3e => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:17.309654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d565454-8237-428c-b02e-088ce4f260db None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:17.360518 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:17.389257 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cdead-14dc-46e1-9cbc-00083f04895a None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:17.420435 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d565454-8237-428c-b02e-088ce4f260db None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:17.427838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70267faf-4a16-4102-ba5f-c1586d2199b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:17.428719 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70267faf-4a16-4102-ba5f-c1586d2199b8 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:17.429009 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70267faf-4a16-4102-ba5f-c1586d2199b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:17.429282 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70267faf-4a16-4102-ba5f-c1586d2199b8 None admin] PATH_INFO: `/v3/projects/b5242eba374f433f9faf5bc522321dd1` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:17.430783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70267faf-4a16-4102-ba5f-c1586d2199b8 None admin] RBAC: Authorizing `identity:get_project(project_id=b5242eba374f433f9faf5bc522321dd1)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:17.431988 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70267faf-4a16-4102-ba5f-c1586d2199b8 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:17.433755 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 189/372] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:25:17 2022] GET /identity/v3/projects/b5242eba374f433f9faf5bc522321dd1 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:17.434731 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70267faf-4a16-4102-ba5f-c1586d2199b8 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:17.461395 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14cdbb-21ed-4d11-98b8-9a474e20fe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:17.462434 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14cdbb-21ed-4d11-98b8-9a474e20fe7b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:17.462946 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14cdbb-21ed-4d11-98b8-9a474e20fe7b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:17.463449 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14cdbb-21ed-4d11-98b8-9a474e20fe7b None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:17.464427 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14cdbb-21ed-4d11-98b8-9a474e20fe7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:17.464895 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:17.465127 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14cdbb-21ed-4d11-98b8-9a474e20fe7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:17.466711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14cdbb-21ed-4d11-98b8-9a474e20fe7b None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:17.477087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 184/373] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:17.478386 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14cdbb-21ed-4d11-98b8-9a474e20fe7b None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:17.552408 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70267faf-4a16-4102-ba5f-c1586d2199b8 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:17.588316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14cdbb-21ed-4d11-98b8-9a474e20fe7b None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:17.588675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a21719-ca23-4461-ae9d-c807579de916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:17.589341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a21719-ca23-4461-ae9d-c807579de916 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:17.589624 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a21719-ca23-4461-ae9d-c807579de916 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:17.589900 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a21719-ca23-4461-ae9d-c807579de916 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:17.590728 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a21719-ca23-4461-ae9d-c807579de916 None admin] RBAC: Adding query filter params (group.id=cb220b4c757845e1b97e5c3736908d3e, role.id=207b29fd2d8344ceb403e1c2e9d91ac2, scope.project.id=b5242eba374f433f9faf5bc522321dd1) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:17.591131 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a21719-ca23-4461-ae9d-c807579de916 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:17.591601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:17.593392 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a21719-ca23-4461-ae9d-c807579de916 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:17.599987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 190/374] 10.222.0.41 () {56 vars in 1376 bytes} [Fri May 27 09:25:17 2022] GET /identity/v3/role_assignments?group.id=cb220b4c757845e1b97e5c3736908d3e&scope.project.id=b5242eba374f433f9faf5bc522321dd1&role.id=207b29fd2d8344ceb403e1c2e9d91ac2 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:17.608319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a21719-ca23-4461-ae9d-c807579de916 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:17.636538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518df792-2051-4b92-85e3-966f9eb69c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:17.649717 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518df792-2051-4b92-85e3-966f9eb69c0c None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:17.650366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518df792-2051-4b92-85e3-966f9eb69c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:17.650840 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518df792-2051-4b92-85e3-966f9eb69c0c None admin] PATH_INFO: `/v3/groups/cb220b4c757845e1b97e5c3736908d3e` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:17.652730 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518df792-2051-4b92-85e3-966f9eb69c0c None admin] RBAC: Authorizing `identity:get_group(group_id=cb220b4c757845e1b97e5c3736908d3e)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:17.656284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518df792-2051-4b92-85e3-966f9eb69c0c None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:17.660892 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 185/375] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 09:25:17 2022] GET /identity/v3/groups/cb220b4c757845e1b97e5c3736908d3e => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:17.670770 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518df792-2051-4b92-85e3-966f9eb69c0c None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:17.750502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:17.785885 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a21719-ca23-4461-ae9d-c807579de916 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:17.793444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518df792-2051-4b92-85e3-966f9eb69c0c None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:17.834500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647cf51-6515-4292-ad57-09ae7b9afafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:17.835835 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647cf51-6515-4292-ad57-09ae7b9afafb None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:17.836437 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647cf51-6515-4292-ad57-09ae7b9afafb None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:17.836906 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647cf51-6515-4292-ad57-09ae7b9afafb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:17.837940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647cf51-6515-4292-ad57-09ae7b9afafb None admin] RBAC: Adding query filter params (group.id=cb220b4c757845e1b97e5c3736908d3e, role.id=580d60e140704327b90a80fc59a2165c, scope.project.id=b5242eba374f433f9faf5bc522321dd1) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:17.838471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647cf51-6515-4292-ad57-09ae7b9afafb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:17.840268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647cf51-6515-4292-ad57-09ae7b9afafb None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:17.846879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617dc741-d58f-4b27-8547-a89ecd366e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:17.847634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617dc741-d58f-4b27-8547-a89ecd366e07 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:17.848422 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617dc741-d58f-4b27-8547-a89ecd366e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:17.848697 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617dc741-d58f-4b27-8547-a89ecd366e07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:17.849453 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 186/376] 10.222.0.41 () {56 vars in 1376 bytes} [Fri May 27 09:25:17 2022] GET /identity/v3/role_assignments?group.id=cb220b4c757845e1b97e5c3736908d3e&scope.project.id=b5242eba374f433f9faf5bc522321dd1&role.id=580d60e140704327b90a80fc59a2165c => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:17.934598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617dc741-d58f-4b27-8547-a89ecd366e07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:17.936634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617dc741-d58f-4b27-8547-a89ecd366e07 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:18.058269 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:18.078523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 191/377] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:25:18.084777 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647cf51-6515-4292-ad57-09ae7b9afafb None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:18.114427 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:18.200766 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647cf51-6515-4292-ad57-09ae7b9afafb None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:18.238202 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e25a9-bf5f-4343-9564-b685b6b67f98 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:18.238530 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e25a9-bf5f-4343-9564-b685b6b67f98 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:18.238765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e25a9-bf5f-4343-9564-b685b6b67f98 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:18.240169 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 192/378] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:25:18.245449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b5f53-acc2-4d58-b046-a2bb2626f94f None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:18.245747 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b5f53-acc2-4d58-b046-a2bb2626f94f None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:18.246032 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b5f53-acc2-4d58-b046-a2bb2626f94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:18.262477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a0940-ea7b-4694-bcc8-4c351a893488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:18.263823 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a0940-ea7b-4694-bcc8-4c351a893488 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:18.264289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a0940-ea7b-4694-bcc8-4c351a893488 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:18.264738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a0940-ea7b-4694-bcc8-4c351a893488 None admin] PATH_INFO: `/v3/projects/ad2dfb9d6b014e38a0011fb0eee6eae7` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:18.267923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a0940-ea7b-4694-bcc8-4c351a893488 None admin] RBAC: Authorizing `identity:get_project(project_id=ad2dfb9d6b014e38a0011fb0eee6eae7)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:18.270164 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a0940-ea7b-4694-bcc8-4c351a893488 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:18.271007 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-ca9b5f53-acc2-4d58-b046-a2bb2626f94f None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:18.272428 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-ca9b5f53-acc2-4d58-b046-a2bb2626f94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:18.272538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 187/379] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:25:18 2022] GET /identity/v3/projects/ad2dfb9d6b014e38a0011fb0eee6eae7 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:18.278051 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a0940-ea7b-4694-bcc8-4c351a893488 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:18.405874 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 193/380] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:18.415712 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:18.431356 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a0940-ea7b-4694-bcc8-4c351a893488 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:18.433937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b5f53-acc2-4d58-b046-a2bb2626f94f None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:18.481036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1e486-608e-4e19-bda4-1ed60ea0890e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:18.481830 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1e486-608e-4e19-bda4-1ed60ea0890e None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:18.482115 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1e486-608e-4e19-bda4-1ed60ea0890e None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:18.482394 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1e486-608e-4e19-bda4-1ed60ea0890e None admin] PATH_INFO: `/v3/groups/707e8e20e0ff48a89dabe4d73ecf1794` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:18.493778 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1e486-608e-4e19-bda4-1ed60ea0890e None admin] RBAC: Authorizing `identity:get_group(group_id=707e8e20e0ff48a89dabe4d73ecf1794)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:18.495261 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1e486-608e-4e19-bda4-1ed60ea0890e None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:18.497028 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 188/381] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 09:25:18 2022] GET /identity/v3/groups/707e8e20e0ff48a89dabe4d73ecf1794 => generated 229 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:18.504956 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1e486-608e-4e19-bda4-1ed60ea0890e None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:18.621980 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b5f53-acc2-4d58-b046-a2bb2626f94f None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:18.656194 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:18.688243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a17b93-b704-416c-a633-b85f13cfca05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:18.689049 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a17b93-b704-416c-a633-b85f13cfca05 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:18.689439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a17b93-b704-416c-a633-b85f13cfca05 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:18.689722 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a17b93-b704-416c-a633-b85f13cfca05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:18.694577 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1e486-608e-4e19-bda4-1ed60ea0890e None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:18.713343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a17b93-b704-416c-a633-b85f13cfca05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:18.721446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-25a17b93-b704-416c-a633-b85f13cfca05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:25:18.721446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:18.721446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:18.721446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:18.721446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:18.721446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:18.721446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:18.721446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:18.721446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:18.721446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:18.721446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:18.721446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:18.721446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:18.721446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:18.721446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:18.721446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:18.722319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:18.722319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:18.722319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:18.722319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:18.722319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:18.722319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:18.722319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:18.722319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:18.722319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:18.722319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:18.722319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:18.722319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:18.722319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:18.722319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:18.722319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:18.722319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:18.723188 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:18.723188 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:18.723188 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:18.723188 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:18.723188 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:18.723188 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:18.723188 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:18.723188 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:18.723188 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:18.723188 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:18.723188 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:25:18.723188 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:18.724812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 194/382] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:25:18.730088 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a17b93-b704-416c-a633-b85f13cfca05 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:18.762279 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eaa585-ddc4-4a4e-b3c3-24c556f25c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:18.763261 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eaa585-ddc4-4a4e-b3c3-24c556f25c98 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:18.763815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eaa585-ddc4-4a4e-b3c3-24c556f25c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:18.764270 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eaa585-ddc4-4a4e-b3c3-24c556f25c98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:18.765286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eaa585-ddc4-4a4e-b3c3-24c556f25c98 None admin] RBAC: Adding query filter params (group.id=707e8e20e0ff48a89dabe4d73ecf1794, role.id=bb6c5483d9be4a16ac64750536c5e2e2, scope.project.id=ad2dfb9d6b014e38a0011fb0eee6eae7) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:18.765843 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eaa585-ddc4-4a4e-b3c3-24c556f25c98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:18.767501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eaa585-ddc4-4a4e-b3c3-24c556f25c98 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:18.780381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 189/383] 10.222.0.41 () {56 vars in 1376 bytes} [Fri May 27 09:25:18 2022] GET /identity/v3/role_assignments?group.id=707e8e20e0ff48a89dabe4d73ecf1794&scope.project.id=ad2dfb9d6b014e38a0011fb0eee6eae7&role.id=bb6c5483d9be4a16ac64750536c5e2e2 => generated 260 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:18.879809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a17b93-b704-416c-a633-b85f13cfca05 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:18.922451 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535d5d4-6792-4257-8490-5382fb24f857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:18.923497 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535d5d4-6792-4257-8490-5382fb24f857 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:18.923957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535d5d4-6792-4257-8490-5382fb24f857 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:18.924437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535d5d4-6792-4257-8490-5382fb24f857 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:18.925373 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535d5d4-6792-4257-8490-5382fb24f857 None admin] RBAC: Adding query filter params (name=member) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:18.926431 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535d5d4-6792-4257-8490-5382fb24f857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:18.928056 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535d5d4-6792-4257-8490-5382fb24f857 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:18.940465 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 195/384] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:25:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:18.946025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eaa585-ddc4-4a4e-b3c3-24c556f25c98 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:18.976100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:19.018254 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c7120-c818-4d62-82de-15e24074d91c None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:19.018637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c7120-c818-4d62-82de-15e24074d91c None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:19.018996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c7120-c818-4d62-82de-15e24074d91c None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:19.020700 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 196/385] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:25:19.025974 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404c9e0-7a46-47ec-a374-236dd0545400 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:19.026271 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404c9e0-7a46-47ec-a374-236dd0545400 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:19.026552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404c9e0-7a46-47ec-a374-236dd0545400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:19.053581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-3404c9e0-7a46-47ec-a374-236dd0545400 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:19.054821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-3404c9e0-7a46-47ec-a374-236dd0545400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:19.084504 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eaa585-ddc4-4a4e-b3c3-24c556f25c98 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:19.098945 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:19.134002 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57488cbc-e600-46a4-9fc3-3990dc5a4cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:19.134913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57488cbc-e600-46a4-9fc3-3990dc5a4cad None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:19.135201 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57488cbc-e600-46a4-9fc3-3990dc5a4cad None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:19.135536 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57488cbc-e600-46a4-9fc3-3990dc5a4cad None admin] PATH_INFO: `/v3/groups/cb220b4c757845e1b97e5c3736908d3e` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:19.137140 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57488cbc-e600-46a4-9fc3-3990dc5a4cad None admin] RBAC: Authorizing `identity:get_group(group_id=cb220b4c757845e1b97e5c3736908d3e)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:19.138617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57488cbc-e600-46a4-9fc3-3990dc5a4cad None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:19.141159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 190/386] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 09:25:18 2022] GET /identity/v3/groups/cb220b4c757845e1b97e5c3736908d3e => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:19.146504 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57488cbc-e600-46a4-9fc3-3990dc5a4cad None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:19.169855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 197/387] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:25:19.251477 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404c9e0-7a46-47ec-a374-236dd0545400 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:19.282405 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:19.298434 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57488cbc-e600-46a4-9fc3-3990dc5a4cad None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:19.370284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5bc82-cf31-49ce-a309-c34263e9d51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:19.372626 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5bc82-cf31-49ce-a309-c34263e9d51b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:19.372916 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5bc82-cf31-49ce-a309-c34263e9d51b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:19.373200 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5bc82-cf31-49ce-a309-c34263e9d51b None admin] PATH_INFO: `/v3/projects/9af9b910687447d4b7b9285bfc31988e` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:19.376667 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5bc82-cf31-49ce-a309-c34263e9d51b None admin] RBAC: Authorizing `identity:get_project(project_id=9af9b910687447d4b7b9285bfc31988e)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:19.378144 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5bc82-cf31-49ce-a309-c34263e9d51b None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:19.379919 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 191/388] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:25:19 2022] GET /identity/v3/projects/9af9b910687447d4b7b9285bfc31988e => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:19.386173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5bc82-cf31-49ce-a309-c34263e9d51b None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:19.439343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404c9e0-7a46-47ec-a374-236dd0545400 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:19.489978 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66a2fc-1826-4290-a4e6-0508dac66596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:19.490805 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66a2fc-1826-4290-a4e6-0508dac66596 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:19.491088 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66a2fc-1826-4290-a4e6-0508dac66596 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:19.491389 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66a2fc-1826-4290-a4e6-0508dac66596 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:19.502957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66a2fc-1826-4290-a4e6-0508dac66596 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:19.514116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-ac66a2fc-1826-4290-a4e6-0508dac66596 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:25:19.514116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:19.514116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:19.514116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:19.514116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:19.514116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:19.514116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:19.514116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:19.514116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:19.514116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:19.514116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:19.514116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:19.514116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:19.514116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:19.514116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:19.514116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:19.515080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:19.515080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:19.515080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:19.515080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:19.515080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:19.515080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:19.515080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:19.515080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:19.515080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:19.515080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:19.515080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:19.515080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:19.515080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:19.515080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:19.515080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:19.515080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:19.515931 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:19.515931 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:19.515931 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:19.515931 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:19.515931 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:19.515931 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:19.515931 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:19.515931 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:19.515931 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:19.515931 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:19.515931 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:25:19.515931 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:19.518565 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 198/389] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 09:25:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:25:19.524455 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66a2fc-1826-4290-a4e6-0508dac66596 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:19.541862 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5bc82-cf31-49ce-a309-c34263e9d51b None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:19.559314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:19.580324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf4bba-3c26-4ba1-9906-d2a69d1a51a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:19.581593 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf4bba-3c26-4ba1-9906-d2a69d1a51a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:19.582125 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf4bba-3c26-4ba1-9906-d2a69d1a51a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:19.582599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf4bba-3c26-4ba1-9906-d2a69d1a51a2 None admin] PATH_INFO: `/v3/projects/9af9b910687447d4b7b9285bfc31988e/groups/cb220b4c757845e1b97e5c3736908d3e/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:19.585139 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf4bba-3c26-4ba1-9906-d2a69d1a51a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=9af9b910687447d4b7b9285bfc31988e, group_id=cb220b4c757845e1b97e5c3736908d3e, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:19.586819 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf4bba-3c26-4ba1-9906-d2a69d1a51a2 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:19.610080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 192/390] 10.222.0.41 () {58 vars in 1442 bytes} [Fri May 27 09:25:19 2022] PUT /identity/v3/projects/9af9b910687447d4b7b9285bfc31988e/groups/cb220b4c757845e1b97e5c3736908d3e/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:25:19.642785 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66a2fc-1826-4290-a4e6-0508dac66596 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:19.681759 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7fe39-0274-4188-b5db-2d447bb83c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:19.682495 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7fe39-0274-4188-b5db-2d447bb83c91 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:19.682790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7fe39-0274-4188-b5db-2d447bb83c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:19.683073 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7fe39-0274-4188-b5db-2d447bb83c91 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:19.683855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7fe39-0274-4188-b5db-2d447bb83c91 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:19.684170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7fe39-0274-4188-b5db-2d447bb83c91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:19.685574 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7fe39-0274-4188-b5db-2d447bb83c91 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:19.695445 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 199/391] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:19.701261 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf4bba-3c26-4ba1-9906-d2a69d1a51a2 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:19.724476 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:19.841244 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf4bba-3c26-4ba1-9906-d2a69d1a51a2 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:19.890433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee641c-9b45-4eae-af5f-d34dd79b42bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:19.891334 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee641c-9b45-4eae-af5f-d34dd79b42bb None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:19.891629 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee641c-9b45-4eae-af5f-d34dd79b42bb None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:19.891913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee641c-9b45-4eae-af5f-d34dd79b42bb None admin] PATH_INFO: `/v3/groups/cb220b4c757845e1b97e5c3736908d3e` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:19.893106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee641c-9b45-4eae-af5f-d34dd79b42bb None admin] RBAC: Authorizing `identity:get_group(group_id=cb220b4c757845e1b97e5c3736908d3e)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:19.894636 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee641c-9b45-4eae-af5f-d34dd79b42bb None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:19.896673 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 193/392] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 09:25:19 2022] GET /identity/v3/groups/cb220b4c757845e1b97e5c3736908d3e => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:19.902068 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7fe39-0274-4188-b5db-2d447bb83c91 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:20.000815 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:20.010233 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7fe39-0274-4188-b5db-2d447bb83c91 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:20.044562 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40978b0-6c40-45eb-ab1b-9783770a6fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:20.045444 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40978b0-6c40-45eb-ab1b-9783770a6fcc None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:20.045738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40978b0-6c40-45eb-ab1b-9783770a6fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:20.046023 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40978b0-6c40-45eb-ab1b-9783770a6fcc None admin] PATH_INFO: `/v3/projects/9af9b910687447d4b7b9285bfc31988e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:20.047221 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40978b0-6c40-45eb-ab1b-9783770a6fcc None admin] RBAC: Authorizing `identity:get_project(project_id=9af9b910687447d4b7b9285bfc31988e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:20.048801 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40978b0-6c40-45eb-ab1b-9783770a6fcc None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:20.051423 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 200/393] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:25:19 2022] GET /identity/v3/projects/9af9b910687447d4b7b9285bfc31988e => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:20.057106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee641c-9b45-4eae-af5f-d34dd79b42bb None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:20.161763 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:20.179558 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee641c-9b45-4eae-af5f-d34dd79b42bb None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:20.230489 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d5d7a-523a-417a-b315-d9b5ddff8908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:20.231736 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d5d7a-523a-417a-b315-d9b5ddff8908 None admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:20.232201 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d5d7a-523a-417a-b315-d9b5ddff8908 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:20.232652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d5d7a-523a-417a-b315-d9b5ddff8908 None admin] PATH_INFO: `/v3/projects/9af9b910687447d4b7b9285bfc31988e/groups/cb220b4c757845e1b97e5c3736908d3e/roles/580d60e140704327b90a80fc59a2165c` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:20.235569 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d5d7a-523a-417a-b315-d9b5ddff8908 None admin] RBAC: Authorizing `identity:create_grant(project_id=9af9b910687447d4b7b9285bfc31988e, group_id=cb220b4c757845e1b97e5c3736908d3e, role_id=580d60e140704327b90a80fc59a2165c)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:20.237261 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d5d7a-523a-417a-b315-d9b5ddff8908 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:20.271485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 194/394] 10.222.0.41 () {58 vars in 1442 bytes} [Fri May 27 09:25:20 2022] PUT /identity/v3/projects/9af9b910687447d4b7b9285bfc31988e/groups/cb220b4c757845e1b97e5c3736908d3e/roles/580d60e140704327b90a80fc59a2165c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:25:20.886928 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dc3d5-4f73-4e00-98cc-dc881f549d35 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:20.886928 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dc3d5-4f73-4e00-98cc-dc881f549d35 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:20.886928 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dc3d5-4f73-4e00-98cc-dc881f549d35 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:20.888083 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 201/395] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:20.893788 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2532a59-2414-45d9-b088-20ce31039117 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:20.895142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2532a59-2414-45d9-b088-20ce31039117 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:20.895672 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2532a59-2414-45d9-b088-20ce31039117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:20.913751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-d2532a59-2414-45d9-b088-20ce31039117 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:20.915253 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d2532a59-2414-45d9-b088-20ce31039117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:20.991436 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 195/396] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:21.011095 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5dc3d5-4f73-4e00-98cc-dc881f549d35 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:21.128400 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5dc3d5-4f73-4e00-98cc-dc881f549d35 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:21.164739 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3dd129-ff89-4355-980c-f1500b1230e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:21.165481 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3dd129-ff89-4355-980c-f1500b1230e7 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:21.165766 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3dd129-ff89-4355-980c-f1500b1230e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:21.166045 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3dd129-ff89-4355-980c-f1500b1230e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:21.177016 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3dd129-ff89-4355-980c-f1500b1230e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:21.185237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-fd3dd129-ff89-4355-980c-f1500b1230e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:25:21.185237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:21.185237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:21.185237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:21.185237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:21.185237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:21.185237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:21.185237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:21.185237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:21.185237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:21.185237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:21.185237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:21.185237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:21.185237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:21.185237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:21.185237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:21.186105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:21.186105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:21.186105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:21.186105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:21.186105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:21.186105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:21.186105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:21.186105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:21.186105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:21.186105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:21.186105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:21.186105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:21.186105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:21.186105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:21.186105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:21.186105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:21.186911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:21.186911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:21.186911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:21.186911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:21.186911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:21.186911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:21.186911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:21.186911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:21.186911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:21.186911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:21.186911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:25:21.186911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:21.186911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 202/397] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 09:25:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:21.194450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2532a59-2414-45d9-b088-20ce31039117 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:21.258922 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef4a02-bdd5-4a25-b6fb-79a4c8b019a7 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:21.259238 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef4a02-bdd5-4a25-b6fb-79a4c8b019a7 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:21.259514 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef4a02-bdd5-4a25-b6fb-79a4c8b019a7 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:21.261716 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 203/398] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:25:21.268352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b06dbd-4207-4250-9539-ae0598c283a2 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:21.268937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b06dbd-4207-4250-9539-ae0598c283a2 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:21.269226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b06dbd-4207-4250-9539-ae0598c283a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:21.295694 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:21.305835 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-67b06dbd-4207-4250-9539-ae0598c283a2 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:21.307050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-67b06dbd-4207-4250-9539-ae0598c283a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:21.341696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2532a59-2414-45d9-b088-20ce31039117 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:21.345942 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:21.423229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52f6c2-c2b4-402e-90de-77142ae6b3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:21.423862 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52f6c2-c2b4-402e-90de-77142ae6b3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:21.424151 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52f6c2-c2b4-402e-90de-77142ae6b3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:21.424432 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52f6c2-c2b4-402e-90de-77142ae6b3b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:21.425193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52f6c2-c2b4-402e-90de-77142ae6b3b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:21.425508 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52f6c2-c2b4-402e-90de-77142ae6b3b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:21.427493 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52f6c2-c2b4-402e-90de-77142ae6b3b1 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:21.444396 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 196/399] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:21.450017 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52f6c2-c2b4-402e-90de-77142ae6b3b1 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:21.473060 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 204/400] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:25:21.480705 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb90ead-6625-48e3-9472-9cb6b9f1b67f None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:21.480993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb90ead-6625-48e3-9472-9cb6b9f1b67f None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:21.481271 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb90ead-6625-48e3-9472-9cb6b9f1b67f None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:21.482899 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 205/401] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:25:21.491300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2ea81-2724-4690-998c-7b3a07d2f048 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:21.491602 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2ea81-2724-4690-998c-7b3a07d2f048 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:21.491876 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2ea81-2724-4690-998c-7b3a07d2f048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:21.511422 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-3db2ea81-2724-4690-998c-7b3a07d2f048 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:21.512550 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-3db2ea81-2724-4690-998c-7b3a07d2f048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:21.582247 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52f6c2-c2b4-402e-90de-77142ae6b3b1 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:21.584271 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 206/402] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:21.585199 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2ea81-2724-4690-998c-7b3a07d2f048 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:21.621589 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91954e16-bbf4-40a0-bab8-f22e3985b157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:21.622928 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91954e16-bbf4-40a0-bab8-f22e3985b157 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:21.623517 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91954e16-bbf4-40a0-bab8-f22e3985b157 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:21.624015 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91954e16-bbf4-40a0-bab8-f22e3985b157 None admin] PATH_INFO: `/v3/groups/cb220b4c757845e1b97e5c3736908d3e` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:21.625416 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91954e16-bbf4-40a0-bab8-f22e3985b157 None admin] RBAC: Authorizing `identity:get_group(group_id=cb220b4c757845e1b97e5c3736908d3e)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:21.627243 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91954e16-bbf4-40a0-bab8-f22e3985b157 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:21.630154 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 197/403] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 09:25:21 2022] GET /identity/v3/groups/cb220b4c757845e1b97e5c3736908d3e => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:21.635420 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91954e16-bbf4-40a0-bab8-f22e3985b157 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:21.645897 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:21.669446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:21.690556 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2ea81-2724-4690-998c-7b3a07d2f048 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:21.727749 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae3391-4357-4b31-ad31-485ad59ed4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:21.728642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae3391-4357-4b31-ad31-485ad59ed4cd None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:21.728848 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae3391-4357-4b31-ad31-485ad59ed4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:21.729100 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae3391-4357-4b31-ad31-485ad59ed4cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:21.741135 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae3391-4357-4b31-ad31-485ad59ed4cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:21.748986 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-82ae3391-4357-4b31-ad31-485ad59ed4cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:25:21.748986 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:21.748986 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:21.748986 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:21.748986 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:21.748986 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:21.748986 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:21.748986 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:21.748986 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:21.748986 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:21.748986 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:21.748986 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:21.748986 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:21.748986 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:21.748986 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:21.748986 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:21.749918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:21.749918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:21.749918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:21.749918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:21.749918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:21.749918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:21.749918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:21.749918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:21.749918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:21.749918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:21.749918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:21.749918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:21.749918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:21.749918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:21.749918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:21.749918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:21.750701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:21.750701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:21.750701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:21.750701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:21.750701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:21.750701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:21.750701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:21.750701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:21.750701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:21.750701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:21.750701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:25:21.750701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:21.755480 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 207/404] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:21.755480 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae3391-4357-4b31-ad31-485ad59ed4cd None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:21.766770 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91954e16-bbf4-40a0-bab8-f22e3985b157 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:21.804800 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df8399-9f9a-4239-a903-ed54a58ccd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:21.805888 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df8399-9f9a-4239-a903-ed54a58ccd2c None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:21.806320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df8399-9f9a-4239-a903-ed54a58ccd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:21.806706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df8399-9f9a-4239-a903-ed54a58ccd2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:21.819338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df8399-9f9a-4239-a903-ed54a58ccd2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:21.828763 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-70df8399-9f9a-4239-a903-ed54a58ccd2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:25:21.828763 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:21.828763 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:21.828763 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:21.828763 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:21.828763 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:21.828763 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:21.828763 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:21.828763 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:21.828763 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:21.828763 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:21.828763 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:21.828763 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:21.828763 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:21.828763 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:21.828763 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:21.829726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:21.829726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:21.829726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:21.829726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:21.829726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:21.829726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:21.829726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:21.829726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:21.829726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:21.829726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:21.829726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:21.829726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:21.829726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:21.829726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:21.829726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:21.829726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:21.830706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:21.830706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:21.830706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:21.830706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:21.830706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:21.830706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:21.830706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:21.830706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:21.830706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:21.830706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:21.830706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:25:21.830706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:21.830706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 198/405] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:25:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:21.831599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df8399-9f9a-4239-a903-ed54a58ccd2c None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:21.867873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae3391-4357-4b31-ad31-485ad59ed4cd None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:21.902320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b7746-2fc6-4122-9604-edb2598556ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:21.904003 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b7746-2fc6-4122-9604-edb2598556ec None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:21.904488 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b7746-2fc6-4122-9604-edb2598556ec None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:21.904975 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b7746-2fc6-4122-9604-edb2598556ec None admin] PATH_INFO: `/v3/projects/b5242eba374f433f9faf5bc522321dd1` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:21.906391 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:21.906775 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b7746-2fc6-4122-9604-edb2598556ec None admin] RBAC: Authorizing `identity:get_project(project_id=b5242eba374f433f9faf5bc522321dd1)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:21.908436 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b7746-2fc6-4122-9604-edb2598556ec None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:21.910938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 208/406] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:25:21 2022] GET /identity/v3/projects/b5242eba374f433f9faf5bc522321dd1 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:21.911993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b7746-2fc6-4122-9604-edb2598556ec None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:21.927517 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:21.962830 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df8399-9f9a-4239-a903-ed54a58ccd2c None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:22.002602 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f16435-b321-46bd-9e1f-b86b861f6f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:22.003566 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f16435-b321-46bd-9e1f-b86b861f6f9a None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:22.004122 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f16435-b321-46bd-9e1f-b86b861f6f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:22.004626 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f16435-b321-46bd-9e1f-b86b861f6f9a None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:22.005651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f16435-b321-46bd-9e1f-b86b861f6f9a None admin] RBAC: Adding query filter params (name=member) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:22.006152 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f16435-b321-46bd-9e1f-b86b861f6f9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:22.007784 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f16435-b321-46bd-9e1f-b86b861f6f9a None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:22.017124 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 199/407] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:25:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:22.022768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f16435-b321-46bd-9e1f-b86b861f6f9a None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:22.024912 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b7746-2fc6-4122-9604-edb2598556ec None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:22.061974 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c0810-f451-4c4a-8632-ce4abd0a7c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:22.062804 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c0810-f451-4c4a-8632-ce4abd0a7c06 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:22.063192 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c0810-f451-4c4a-8632-ce4abd0a7c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:22.063605 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c0810-f451-4c4a-8632-ce4abd0a7c06 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:22.064558 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c0810-f451-4c4a-8632-ce4abd0a7c06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:22.064917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c0810-f451-4c4a-8632-ce4abd0a7c06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:22.066486 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c0810-f451-4c4a-8632-ce4abd0a7c06 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:22.076432 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 209/408] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:22.076841 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c0810-f451-4c4a-8632-ce4abd0a7c06 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:22.148675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:22.151154 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f16435-b321-46bd-9e1f-b86b861f6f9a None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:22.182840 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c0810-f451-4c4a-8632-ce4abd0a7c06 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:22.189326 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b8b77-ab4f-4ac5-a5d3-25c915e2dedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:22.190549 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b8b77-ab4f-4ac5-a5d3-25c915e2dedc None admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:22.191009 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b8b77-ab4f-4ac5-a5d3-25c915e2dedc None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:22.193437 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b8b77-ab4f-4ac5-a5d3-25c915e2dedc None admin] PATH_INFO: `/v3/projects/b5242eba374f433f9faf5bc522321dd1/groups/cb220b4c757845e1b97e5c3736908d3e/roles/580d60e140704327b90a80fc59a2165c` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:22.195616 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:22.198200 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b8b77-ab4f-4ac5-a5d3-25c915e2dedc None admin] RBAC: Authorizing `identity:create_grant(project_id=b5242eba374f433f9faf5bc522321dd1, group_id=cb220b4c757845e1b97e5c3736908d3e, role_id=580d60e140704327b90a80fc59a2165c)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:22.200117 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b8b77-ab4f-4ac5-a5d3-25c915e2dedc None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:22.216619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 200/409] 10.222.0.41 () {58 vars in 1442 bytes} [Fri May 27 09:25:22 2022] PUT /identity/v3/projects/b5242eba374f433f9faf5bc522321dd1/groups/cb220b4c757845e1b97e5c3736908d3e/roles/580d60e140704327b90a80fc59a2165c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:25:22.217786 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b8b77-ab4f-4ac5-a5d3-25c915e2dedc None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:22.220774 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b4d9d-69e4-4b84-8f13-f40a3c12949b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:22.221804 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b4d9d-69e4-4b84-8f13-f40a3c12949b None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:22.222178 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b4d9d-69e4-4b84-8f13-f40a3c12949b None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:22.223912 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b4d9d-69e4-4b84-8f13-f40a3c12949b None admin] PATH_INFO: `/v3/groups/cb220b4c757845e1b97e5c3736908d3e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:22.224674 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b4d9d-69e4-4b84-8f13-f40a3c12949b None admin] RBAC: Authorizing `identity:get_group(group_id=cb220b4c757845e1b97e5c3736908d3e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:22.226290 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b4d9d-69e4-4b84-8f13-f40a3c12949b None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:22.228607 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 210/410] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 09:25:22 2022] GET /identity/v3/groups/cb220b4c757845e1b97e5c3736908d3e => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:22.233669 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b4d9d-69e4-4b84-8f13-f40a3c12949b None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:22.341008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b8b77-ab4f-4ac5-a5d3-25c915e2dedc None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:22.381032 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f8149-85f9-4c3a-831a-778a08b58785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:22.382320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f8149-85f9-4c3a-831a-778a08b58785 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:22.382827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f8149-85f9-4c3a-831a-778a08b58785 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:22.383366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f8149-85f9-4c3a-831a-778a08b58785 None admin] PATH_INFO: `/v3/groups/707e8e20e0ff48a89dabe4d73ecf1794` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:22.384832 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f8149-85f9-4c3a-831a-778a08b58785 None admin] RBAC: Authorizing `identity:get_group(group_id=707e8e20e0ff48a89dabe4d73ecf1794)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:22.386514 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f8149-85f9-4c3a-831a-778a08b58785 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:22.388885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 201/411] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 09:25:22 2022] GET /identity/v3/groups/707e8e20e0ff48a89dabe4d73ecf1794 => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:22.398089 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f8149-85f9-4c3a-831a-778a08b58785 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:22.480852 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b4d9d-69e4-4b84-8f13-f40a3c12949b None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:22.500907 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:22.529836 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae616c4-399e-4571-9468-7f79c5007d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:22.530707 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae616c4-399e-4571-9468-7f79c5007d55 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:22.530990 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae616c4-399e-4571-9468-7f79c5007d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:22.531267 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae616c4-399e-4571-9468-7f79c5007d55 None admin] PATH_INFO: `/v3/projects/b5242eba374f433f9faf5bc522321dd1` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:22.532483 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae616c4-399e-4571-9468-7f79c5007d55 None admin] RBAC: Authorizing `identity:get_project(project_id=b5242eba374f433f9faf5bc522321dd1)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:22.533952 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae616c4-399e-4571-9468-7f79c5007d55 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:22.536575 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 211/412] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:25:22 2022] GET /identity/v3/projects/b5242eba374f433f9faf5bc522321dd1 => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:22.542083 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae616c4-399e-4571-9468-7f79c5007d55 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:22.556751 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:22.585082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f8149-85f9-4c3a-831a-778a08b58785 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:22.641080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18661dba-207e-40e6-85b4-e5399acd03dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:22.642113 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18661dba-207e-40e6-85b4-e5399acd03dc None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:22.642402 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18661dba-207e-40e6-85b4-e5399acd03dc None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:22.642800 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18661dba-207e-40e6-85b4-e5399acd03dc None admin] PATH_INFO: `/v3/projects/ad2dfb9d6b014e38a0011fb0eee6eae7` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:22.644031 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18661dba-207e-40e6-85b4-e5399acd03dc None admin] RBAC: Authorizing `identity:get_project(project_id=ad2dfb9d6b014e38a0011fb0eee6eae7)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:22.646292 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18661dba-207e-40e6-85b4-e5399acd03dc None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:22.652841 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 202/413] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:25:22 2022] GET /identity/v3/projects/ad2dfb9d6b014e38a0011fb0eee6eae7 => generated 344 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:22.652841 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a81ca7-7d6d-452a-a7bd-6a87b80eb695 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:22.652841 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a81ca7-7d6d-452a-a7bd-6a87b80eb695 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:22.652841 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a81ca7-7d6d-452a-a7bd-6a87b80eb695 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:22.652841 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 203/414] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:22.653902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a81ca7-7d6d-452a-a7bd-6a87b80eb695 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:22.703785 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae616c4-399e-4571-9468-7f79c5007d55 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:22.745672 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f50c0-f317-4284-b0ba-400f13ada609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:22.746898 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f50c0-f317-4284-b0ba-400f13ada609 None admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:22.747448 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f50c0-f317-4284-b0ba-400f13ada609 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:22.747882 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f50c0-f317-4284-b0ba-400f13ada609 None admin] PATH_INFO: `/v3/projects/b5242eba374f433f9faf5bc522321dd1/groups/cb220b4c757845e1b97e5c3736908d3e/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:22.750379 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f50c0-f317-4284-b0ba-400f13ada609 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5242eba374f433f9faf5bc522321dd1, group_id=cb220b4c757845e1b97e5c3736908d3e, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:22.752510 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f50c0-f317-4284-b0ba-400f13ada609 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:22.768517 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 212/415] 10.222.0.41 () {58 vars in 1442 bytes} [Fri May 27 09:25:22 2022] PUT /identity/v3/projects/b5242eba374f433f9faf5bc522321dd1/groups/cb220b4c757845e1b97e5c3736908d3e/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:25:22.770845 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79abd8-64ff-4c65-9914-78ee4eb494c3 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:22.771257 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79abd8-64ff-4c65-9914-78ee4eb494c3 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:22.771692 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79abd8-64ff-4c65-9914-78ee4eb494c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:22.782273 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a81ca7-7d6d-452a-a7bd-6a87b80eb695 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:22.790800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-ea79abd8-64ff-4c65-9914-78ee4eb494c3 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:22.792341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-ea79abd8-64ff-4c65-9914-78ee4eb494c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:22.810823 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:22.835577 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f3d19-58ae-483f-8c63-b40122010abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:22.836808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f3d19-58ae-483f-8c63-b40122010abf None admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:22.837215 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f3d19-58ae-483f-8c63-b40122010abf None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:22.837597 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f3d19-58ae-483f-8c63-b40122010abf None admin] PATH_INFO: `/v3/projects/ad2dfb9d6b014e38a0011fb0eee6eae7/groups/707e8e20e0ff48a89dabe4d73ecf1794/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:22.842459 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f3d19-58ae-483f-8c63-b40122010abf None admin] RBAC: Authorizing `identity:create_grant(project_id=ad2dfb9d6b014e38a0011fb0eee6eae7, group_id=707e8e20e0ff48a89dabe4d73ecf1794, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:22.844261 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f3d19-58ae-483f-8c63-b40122010abf None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:22.875400 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 204/416] 10.222.0.41 () {58 vars in 1442 bytes} [Fri May 27 09:25:22 2022] PUT /identity/v3/projects/ad2dfb9d6b014e38a0011fb0eee6eae7/groups/707e8e20e0ff48a89dabe4d73ecf1794/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:25:22.885299 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:22.900213 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 213/417] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:22.948560 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f3d19-58ae-483f-8c63-b40122010abf None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:23.086815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f3d19-58ae-483f-8c63-b40122010abf None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:23.126488 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6c941-6062-4950-9208-7a7577018144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:23.127724 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6c941-6062-4950-9208-7a7577018144 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:23.128228 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6c941-6062-4950-9208-7a7577018144 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:23.128770 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6c941-6062-4950-9208-7a7577018144 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:23.141786 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a6c941-6062-4950-9208-7a7577018144 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:23.150368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-24a6c941-6062-4950-9208-7a7577018144 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:25:23.150368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:23.150368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:23.150368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:23.150368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:23.150368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:23.150368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:23.150368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:23.150368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:23.150368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:23.150368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:23.150368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:23.150368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:23.150368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:23.150368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:23.150368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:23.151338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:23.151338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:23.151338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:23.151338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:23.151338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:23.151338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:23.151338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:23.151338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:23.151338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:23.151338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:23.151338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:23.151338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:23.151338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:23.151338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:23.151338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:23.151338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:23.152141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:23.152141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:23.152141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:23.152141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:23.152141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:23.152141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:23.152141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:23.152141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:23.152141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:23.152141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:23.152141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:25:23.152141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:23.153773 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 205/418] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:25:23.159355 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79abd8-64ff-4c65-9914-78ee4eb494c3 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:23.238681 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a640a-3080-44fb-9cbe-ad9fb1857a66 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:23.239032 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a640a-3080-44fb-9cbe-ad9fb1857a66 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:23.239309 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a640a-3080-44fb-9cbe-ad9fb1857a66 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:23.241043 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 206/419] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:25:23.246240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833f875-63b8-493a-80d0-15e5a956638e None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:23.246527 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833f875-63b8-493a-80d0-15e5a956638e None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:23.246805 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833f875-63b8-493a-80d0-15e5a956638e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:23.272588 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-7833f875-63b8-493a-80d0-15e5a956638e None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:23.273797 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-7833f875-63b8-493a-80d0-15e5a956638e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:23.336606 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79abd8-64ff-4c65-9914-78ee4eb494c3 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:23.368159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:23.391414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743cd07-4a06-49e5-aa20-b9a31c08e7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:23.392211 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743cd07-4a06-49e5-aa20-b9a31c08e7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:23.392496 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743cd07-4a06-49e5-aa20-b9a31c08e7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:23.392771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743cd07-4a06-49e5-aa20-b9a31c08e7f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:23.393511 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743cd07-4a06-49e5-aa20-b9a31c08e7f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:23.393816 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743cd07-4a06-49e5-aa20-b9a31c08e7f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:23.395244 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743cd07-4a06-49e5-aa20-b9a31c08e7f6 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:23.405353 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 214/420] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:25:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:23.411354 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743cd07-4a06-49e5-aa20-b9a31c08e7f6 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:23.481027 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:23.482699 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 207/421] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:25:23.517528 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743cd07-4a06-49e5-aa20-b9a31c08e7f6 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:23.522049 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833f875-63b8-493a-80d0-15e5a956638e None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:23.592617 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a9986-72e9-4dfc-a94f-e99364b42e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:23.593511 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a9986-72e9-4dfc-a94f-e99364b42e7e None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:23.593940 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a9986-72e9-4dfc-a94f-e99364b42e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:23.594375 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a9986-72e9-4dfc-a94f-e99364b42e7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:23.645898 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833f875-63b8-493a-80d0-15e5a956638e None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:23.719426 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a9986-72e9-4dfc-a94f-e99364b42e7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:23.736405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a9986-72e9-4dfc-a94f-e99364b42e7e None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:23.768568 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9898e7-2496-46f4-b475-a24f1b883a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:23.770311 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9898e7-2496-46f4-b475-a24f1b883a5e None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:23.770795 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9898e7-2496-46f4-b475-a24f1b883a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:23.771265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9898e7-2496-46f4-b475-a24f1b883a5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:23.804249 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9898e7-2496-46f4-b475-a24f1b883a5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:23.810932 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:23.812601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-ff9898e7-2496-46f4-b475-a24f1b883a5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:25:23.812601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:23.812601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:23.812601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:23.812601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:23.812601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:23.812601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:23.812601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:23.812601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:23.812601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:23.812601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:23.812601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:23.812601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:23.812601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:23.812601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:23.812601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:23.813468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:23.813468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:23.813468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:23.813468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:23.813468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:23.813468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:23.813468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:23.813468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:23.813468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:23.813468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:23.813468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:23.813468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:23.813468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:23.813468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:23.813468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:23.813468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:23.814275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:23.814275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:23.814275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:23.814275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:23.814275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:23.814275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:23.814275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:23.814275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:23.814275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:23.814275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:23.814275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:25:23.814275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:23.820299 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 208/422] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 09:25:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:23.825822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9898e7-2496-46f4-b475-a24f1b883a5e None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:23.860354 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 215/423] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:25:23.865794 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a9986-72e9-4dfc-a94f-e99364b42e7e None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:23.917833 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:23.973323 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a9986-72e9-4dfc-a94f-e99364b42e7e None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:24.008700 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174df81f-5f0b-4dfd-8644-e7101253efa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:24.009558 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174df81f-5f0b-4dfd-8644-e7101253efa5 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:24.009835 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174df81f-5f0b-4dfd-8644-e7101253efa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:24.010106 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174df81f-5f0b-4dfd-8644-e7101253efa5 None admin] PATH_INFO: `/v3/projects/9af9b910687447d4b7b9285bfc31988e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:24.011328 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174df81f-5f0b-4dfd-8644-e7101253efa5 None admin] RBAC: Authorizing `identity:get_project(project_id=9af9b910687447d4b7b9285bfc31988e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:24.012757 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174df81f-5f0b-4dfd-8644-e7101253efa5 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:24.014766 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 216/424] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:25:23 2022] GET /identity/v3/projects/9af9b910687447d4b7b9285bfc31988e => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:24.020536 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174df81f-5f0b-4dfd-8644-e7101253efa5 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:24.056420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:24.106939 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9898e7-2496-46f4-b475-a24f1b883a5e None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:24.136528 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174df81f-5f0b-4dfd-8644-e7101253efa5 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:24.172301 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef544e-e54b-4e45-858c-51d00bd25e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:24.173169 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef544e-e54b-4e45-858c-51d00bd25e0b None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:24.173446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef544e-e54b-4e45-858c-51d00bd25e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:24.173713 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef544e-e54b-4e45-858c-51d00bd25e0b None admin] PATH_INFO: `/v3/groups/cb220b4c757845e1b97e5c3736908d3e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:24.175017 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef544e-e54b-4e45-858c-51d00bd25e0b None admin] RBAC: Authorizing `identity:get_group(group_id=cb220b4c757845e1b97e5c3736908d3e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:24.176681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef544e-e54b-4e45-858c-51d00bd25e0b None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:24.178311 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 217/425] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 09:25:24 2022] GET /identity/v3/groups/cb220b4c757845e1b97e5c3736908d3e => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:24.183917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef544e-e54b-4e45-858c-51d00bd25e0b None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:24.193202 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972ee09-aa7f-4374-acac-cd100db607bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:24.193889 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972ee09-aa7f-4374-acac-cd100db607bb None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:24.194236 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972ee09-aa7f-4374-acac-cd100db607bb None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:24.194522 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972ee09-aa7f-4374-acac-cd100db607bb None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:24.195293 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972ee09-aa7f-4374-acac-cd100db607bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:24.195614 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972ee09-aa7f-4374-acac-cd100db607bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:24.197025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972ee09-aa7f-4374-acac-cd100db607bb None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:24.215712 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 209/426] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:24.221176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972ee09-aa7f-4374-acac-cd100db607bb None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:24.295619 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:24.304825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef544e-e54b-4e45-858c-51d00bd25e0b None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:24.342956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27202d8e-d247-418b-b35c-406bed527e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:24.343643 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27202d8e-d247-418b-b35c-406bed527e39 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:24.344033 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27202d8e-d247-418b-b35c-406bed527e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:24.344437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27202d8e-d247-418b-b35c-406bed527e39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:24.345265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27202d8e-d247-418b-b35c-406bed527e39 None admin] RBAC: Adding query filter params (group.id=cb220b4c757845e1b97e5c3736908d3e, role.id=207b29fd2d8344ceb403e1c2e9d91ac2, scope.project.id=9af9b910687447d4b7b9285bfc31988e) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:24.345574 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27202d8e-d247-418b-b35c-406bed527e39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:24.347000 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27202d8e-d247-418b-b35c-406bed527e39 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:24.354370 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 218/427] 10.222.0.41 () {56 vars in 1376 bytes} [Fri May 27 09:25:24 2022] GET /identity/v3/role_assignments?group.id=cb220b4c757845e1b97e5c3736908d3e&scope.project.id=9af9b910687447d4b7b9285bfc31988e&role.id=207b29fd2d8344ceb403e1c2e9d91ac2 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:24.408508 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:24.416023 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972ee09-aa7f-4374-acac-cd100db607bb None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:24.465320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce5aab-9ec1-4b9f-afd6-2aaca56e43ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:24.465982 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce5aab-9ec1-4b9f-afd6-2aaca56e43ab None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:24.466263 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce5aab-9ec1-4b9f-afd6-2aaca56e43ab None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:24.466535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce5aab-9ec1-4b9f-afd6-2aaca56e43ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:24.556145 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce5aab-9ec1-4b9f-afd6-2aaca56e43ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:24.558029 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce5aab-9ec1-4b9f-afd6-2aaca56e43ab None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:24.693285 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:24.701497 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 210/428] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 09:25:24.707531 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27202d8e-d247-418b-b35c-406bed527e39 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:24.789985 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3752e0-9e11-4036-9a29-0b22ddaa194a None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:24.790293 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3752e0-9e11-4036-9a29-0b22ddaa194a None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:24.790540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3752e0-9e11-4036-9a29-0b22ddaa194a None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:24.792174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 211/429] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:25:24.804242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207bf9f-7734-4194-9179-fc5ec05069be None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:24.804559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207bf9f-7734-4194-9179-fc5ec05069be None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:24.805277 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207bf9f-7734-4194-9179-fc5ec05069be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:24.826330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-c207bf9f-7734-4194-9179-fc5ec05069be None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:24.830115 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-c207bf9f-7734-4194-9179-fc5ec05069be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:24.833372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27202d8e-d247-418b-b35c-406bed527e39 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:24.872246 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92dd7a-663f-4129-ab62-117e693081cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:24.873108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92dd7a-663f-4129-ab62-117e693081cc None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:24.873388 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92dd7a-663f-4129-ab62-117e693081cc None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:24.873660 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92dd7a-663f-4129-ab62-117e693081cc None admin] PATH_INFO: `/v3/projects/9af9b910687447d4b7b9285bfc31988e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:24.874911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92dd7a-663f-4129-ab62-117e693081cc None admin] RBAC: Authorizing `identity:get_project(project_id=9af9b910687447d4b7b9285bfc31988e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:24.876387 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92dd7a-663f-4129-ab62-117e693081cc None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:24.879082 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 219/430] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:25:24 2022] GET /identity/v3/projects/9af9b910687447d4b7b9285bfc31988e => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:24.884249 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92dd7a-663f-4129-ab62-117e693081cc None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:24.910783 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 212/431] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:25:24.915244 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:24.933705 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207bf9f-7734-4194-9179-fc5ec05069be None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:25.007521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92dd7a-663f-4129-ab62-117e693081cc None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:25.054638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2624ec-2bb2-461a-a442-b42b99487150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:25.055853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2624ec-2bb2-461a-a442-b42b99487150 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:25.056145 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2624ec-2bb2-461a-a442-b42b99487150 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:25.056426 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2624ec-2bb2-461a-a442-b42b99487150 None admin] PATH_INFO: `/v3/groups/cb220b4c757845e1b97e5c3736908d3e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:25.057916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2624ec-2bb2-461a-a442-b42b99487150 None admin] RBAC: Authorizing `identity:get_group(group_id=cb220b4c757845e1b97e5c3736908d3e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:25.059216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207bf9f-7734-4194-9179-fc5ec05069be None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:25.059555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2624ec-2bb2-461a-a442-b42b99487150 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:25.062357 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 220/432] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 09:25:24 2022] GET /identity/v3/groups/cb220b4c757845e1b97e5c3736908d3e => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:25.067499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2624ec-2bb2-461a-a442-b42b99487150 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:25.095056 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:25.106056 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc6192-b463-436f-aace-ba97cd802f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:25.107162 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc6192-b463-436f-aace-ba97cd802f8b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:25.108129 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc6192-b463-436f-aace-ba97cd802f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:25.108594 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc6192-b463-436f-aace-ba97cd802f8b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:25.120452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc6192-b463-436f-aace-ba97cd802f8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:25.130101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-d7bc6192-b463-436f-aace-ba97cd802f8b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:25:25.130101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:25.130101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:25.130101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:25.130101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:25.130101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:25.130101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:25.130101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:25.130101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:25.130101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:25.130101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:25.130101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:25.130101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:25.130101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:25.130101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:25.130101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:25.130979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:25.130979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:25.130979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:25.130979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:25.130979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:25.130979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:25.130979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:25.130979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:25.130979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:25.130979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:25.130979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:25.130979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:25.130979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:25.130979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:25.130979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:25.130979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:25.131774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:25.131774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:25.131774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:25.131774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:25.131774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:25.131774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:25.131774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:25.131774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:25.131774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:25.131774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:25.131774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:25:25.131774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:25.134574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 213/433] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 09:25:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:25:25.143574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc6192-b463-436f-aace-ba97cd802f8b None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:25.197646 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:25.207409 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2624ec-2bb2-461a-a442-b42b99487150 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:25.260430 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e92199-a938-4dae-aed6-45ed916f851f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:25.261538 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e92199-a938-4dae-aed6-45ed916f851f None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:25.262031 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e92199-a938-4dae-aed6-45ed916f851f None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:25.262497 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e92199-a938-4dae-aed6-45ed916f851f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:25.263551 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e92199-a938-4dae-aed6-45ed916f851f None admin] RBAC: Adding query filter params (group.id=cb220b4c757845e1b97e5c3736908d3e, role.id=580d60e140704327b90a80fc59a2165c, scope.project.id=9af9b910687447d4b7b9285bfc31988e) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:25.264152 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e92199-a938-4dae-aed6-45ed916f851f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:25.265887 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e92199-a938-4dae-aed6-45ed916f851f None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:25.277635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 221/434] 10.222.0.41 () {56 vars in 1376 bytes} [Fri May 27 09:25:25 2022] GET /identity/v3/role_assignments?group.id=cb220b4c757845e1b97e5c3736908d3e&scope.project.id=9af9b910687447d4b7b9285bfc31988e&role.id=580d60e140704327b90a80fc59a2165c => generated 611 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:25.288978 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc6192-b463-436f-aace-ba97cd802f8b None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:25.328169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacca48-be9e-4b8a-917a-8fa3056eff34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:25.328887 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacca48-be9e-4b8a-917a-8fa3056eff34 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:25.329172 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacca48-be9e-4b8a-917a-8fa3056eff34 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:25.329449 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacca48-be9e-4b8a-917a-8fa3056eff34 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:25.330208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacca48-be9e-4b8a-917a-8fa3056eff34 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:25.330518 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacca48-be9e-4b8a-917a-8fa3056eff34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:25.332012 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacca48-be9e-4b8a-917a-8fa3056eff34 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:25.345999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 214/435] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:25.351738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e92199-a938-4dae-aed6-45ed916f851f None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:25.487512 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e92199-a938-4dae-aed6-45ed916f851f None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:25.532316 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad88bae-9a79-4b94-8e53-16d8fbe1d404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:25.532977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad88bae-9a79-4b94-8e53-16d8fbe1d404 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:25.533259 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad88bae-9a79-4b94-8e53-16d8fbe1d404 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:25.533534 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad88bae-9a79-4b94-8e53-16d8fbe1d404 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:25.563324 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:25.588341 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07122fa2-2d52-48b4-a5c7-f09218d458b1 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:25.588917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07122fa2-2d52-48b4-a5c7-f09218d458b1 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:25.589258 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07122fa2-2d52-48b4-a5c7-f09218d458b1 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:25.590776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 215/436] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:25:25.597134 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e6b18-2d57-468c-b73a-cdf6d74084a7 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:25.598052 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e6b18-2d57-468c-b73a-cdf6d74084a7 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:25.598551 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e6b18-2d57-468c-b73a-cdf6d74084a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:25.614140 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad88bae-9a79-4b94-8e53-16d8fbe1d404 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:25.615903 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad88bae-9a79-4b94-8e53-16d8fbe1d404 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:25.618182 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-442e6b18-2d57-468c-b73a-cdf6d74084a7 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:25.619595 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-442e6b18-2d57-468c-b73a-cdf6d74084a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:25.678427 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:25.716322 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 216/437] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:25:25.718025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f93f75-ced3-495d-9fe1-c15c047d1ab5 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:25.718311 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f93f75-ced3-495d-9fe1-c15c047d1ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:25.718586 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f93f75-ced3-495d-9fe1-c15c047d1ab5 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:25.721848 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 217/438] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:25.726927 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1b6ef-a8a8-48ba-93d8-421ccc1273b0 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:25.727214 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1b6ef-a8a8-48ba-93d8-421ccc1273b0 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:25.727521 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1b6ef-a8a8-48ba-93d8-421ccc1273b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:25.746440 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 222/439] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:25:25.746440 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad88bae-9a79-4b94-8e53-16d8fbe1d404 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:25.746681 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-c1c1b6ef-a8a8-48ba-93d8-421ccc1273b0 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:25.747909 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-c1c1b6ef-a8a8-48ba-93d8-421ccc1273b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:25.810679 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:25.830274 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 218/440] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:25:25.838966 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1b6ef-a8a8-48ba-93d8-421ccc1273b0 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:25.861464 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad88bae-9a79-4b94-8e53-16d8fbe1d404 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:25.895870 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d67e1-ba03-4cf0-ae37-a5d3badcad57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:25.896661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d67e1-ba03-4cf0-ae37-a5d3badcad57 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:25.896944 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d67e1-ba03-4cf0-ae37-a5d3badcad57 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:25.897218 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d67e1-ba03-4cf0-ae37-a5d3badcad57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:25.907001 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d67e1-ba03-4cf0-ae37-a5d3badcad57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:25.915163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-958d67e1-ba03-4cf0-ae37-a5d3badcad57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:25:25.915163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:25.915163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:25.915163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:25.915163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:25.915163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:25.915163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:25.915163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:25.915163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:25.915163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:25.915163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:25.915163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:25.915163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:25.915163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:25.915163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:25.915163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:25.916055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:25.916055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:25.916055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:25.916055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:25.916055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:25.916055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:25.916055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:25.916055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:25.916055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:25.916055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:25.916055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:25.916055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:25.916055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:25.916055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:25.916055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:25.916055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:25.916855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:25.916855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:25.916855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:25.916855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:25.916855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:25.916855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:25.916855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:25.916855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:25.916855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:25.916855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:25.916855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:25:25.916855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:25.916855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 223/441] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:25:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:25:25.917493 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d67e1-ba03-4cf0-ae37-a5d3badcad57 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:25.939200 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1b6ef-a8a8-48ba-93d8-421ccc1273b0 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:25.948457 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:25.986036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a8e1c-7e5b-44b6-88bd-0351ea09c73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:25.986898 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a8e1c-7e5b-44b6-88bd-0351ea09c73a None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:25.987180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a8e1c-7e5b-44b6-88bd-0351ea09c73a None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:25.987486 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a8e1c-7e5b-44b6-88bd-0351ea09c73a None admin] PATH_INFO: `/v3/projects/b5242eba374f433f9faf5bc522321dd1` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:25.988672 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a8e1c-7e5b-44b6-88bd-0351ea09c73a None admin] RBAC: Authorizing `identity:get_project(project_id=b5242eba374f433f9faf5bc522321dd1)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:25.990117 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a8e1c-7e5b-44b6-88bd-0351ea09c73a None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:25.992086 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 219/442] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:25:25 2022] GET /identity/v3/projects/b5242eba374f433f9faf5bc522321dd1 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:25.992712 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a8e1c-7e5b-44b6-88bd-0351ea09c73a None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:26.021478 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d67e1-ba03-4cf0-ae37-a5d3badcad57 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:26.044799 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:26.062055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cabfa8-1e3c-4ecb-9aea-d583743e30c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:26.062786 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cabfa8-1e3c-4ecb-9aea-d583743e30c7 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:26.063076 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cabfa8-1e3c-4ecb-9aea-d583743e30c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:26.063389 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cabfa8-1e3c-4ecb-9aea-d583743e30c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:26.073694 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cabfa8-1e3c-4ecb-9aea-d583743e30c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:26.081414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-78cabfa8-1e3c-4ecb-9aea-d583743e30c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 09:25:26.081414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:26.081414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:26.081414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:26.081414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:26.081414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:26.081414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:26.081414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:26.081414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:26.081414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:26.081414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:26.081414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:26.081414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:26.081414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:26.081414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:26.081414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:26.082813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:26.082813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:26.082813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:26.082813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:26.082813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:26.082813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:26.082813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:26.082813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:26.082813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:26.082813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:26.082813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:26.082813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:26.082813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:26.082813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:26.082813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:26.082813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:26.083634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:26.083634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:26.083634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:26.083634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:26.083634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:26.083634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:26.083634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:26.083634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:26.083634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:26.083634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:26.083634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 09:25:26.083634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:26.083634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 224/443] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:26.084274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cabfa8-1e3c-4ecb-9aea-d583743e30c7 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:26.111303 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a8e1c-7e5b-44b6-88bd-0351ea09c73a None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:26.145245 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833b2cc-292f-48ff-a8e8-147360ae9e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:26.145904 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833b2cc-292f-48ff-a8e8-147360ae9e96 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:26.146191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833b2cc-292f-48ff-a8e8-147360ae9e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:26.146466 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833b2cc-292f-48ff-a8e8-147360ae9e96 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:26.147206 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833b2cc-292f-48ff-a8e8-147360ae9e96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:26.147553 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833b2cc-292f-48ff-a8e8-147360ae9e96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:26.148948 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833b2cc-292f-48ff-a8e8-147360ae9e96 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:26.157009 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 220/444] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:26.158792 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833b2cc-292f-48ff-a8e8-147360ae9e96 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:26.187633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cabfa8-1e3c-4ecb-9aea-d583743e30c7 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:26.197002 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:26.221480 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8492cf4-d7ce-4915-8e04-81b26b654138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:26.224094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8492cf4-d7ce-4915-8e04-81b26b654138 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:26.224975 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8492cf4-d7ce-4915-8e04-81b26b654138 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:26.225266 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8492cf4-d7ce-4915-8e04-81b26b654138 None admin] PATH_INFO: `/v3/groups/cb220b4c757845e1b97e5c3736908d3e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:26.227030 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8492cf4-d7ce-4915-8e04-81b26b654138 None admin] RBAC: Authorizing `identity:get_group(group_id=cb220b4c757845e1b97e5c3736908d3e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:26.229455 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8492cf4-d7ce-4915-8e04-81b26b654138 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:26.231070 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 225/445] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 09:25:26 2022] GET /identity/v3/groups/cb220b4c757845e1b97e5c3736908d3e => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:26.231856 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8492cf4-d7ce-4915-8e04-81b26b654138 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:26.256949 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833b2cc-292f-48ff-a8e8-147360ae9e96 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:26.281232 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:26.290448 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a74e0-86cf-429a-b7e2-052c58c47348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:26.291120 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a74e0-86cf-429a-b7e2-052c58c47348 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:26.291437 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a74e0-86cf-429a-b7e2-052c58c47348 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:26.291723 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a74e0-86cf-429a-b7e2-052c58c47348 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:26.292461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a74e0-86cf-429a-b7e2-052c58c47348 None admin] RBAC: Adding query filter params (name=member) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:26.292769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a74e0-86cf-429a-b7e2-052c58c47348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:26.294145 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a74e0-86cf-429a-b7e2-052c58c47348 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:26.302149 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 221/446] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:25:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:26.302919 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a74e0-86cf-429a-b7e2-052c58c47348 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:26.335811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8492cf4-d7ce-4915-8e04-81b26b654138 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:26.370729 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56c788-ccfb-431d-b7f9-794043ce741a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:26.371400 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56c788-ccfb-431d-b7f9-794043ce741a None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:26.371687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56c788-ccfb-431d-b7f9-794043ce741a None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:26.371972 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56c788-ccfb-431d-b7f9-794043ce741a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:26.404674 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:26.407692 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a74e0-86cf-429a-b7e2-052c58c47348 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:26.439505 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56c788-ccfb-431d-b7f9-794043ce741a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:26.440954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56c788-ccfb-431d-b7f9-794043ce741a None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:26.441620 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188c215-31fe-4ecc-bb55-90696f3531dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:26.442154 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188c215-31fe-4ecc-bb55-90696f3531dd None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:26.442439 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188c215-31fe-4ecc-bb55-90696f3531dd None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:26.442714 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188c215-31fe-4ecc-bb55-90696f3531dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:26.443564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188c215-31fe-4ecc-bb55-90696f3531dd None admin] RBAC: Adding query filter params (group.id=cb220b4c757845e1b97e5c3736908d3e, role.id=580d60e140704327b90a80fc59a2165c, scope.project.id=b5242eba374f433f9faf5bc522321dd1) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:26.444554 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188c215-31fe-4ecc-bb55-90696f3531dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:26.445307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188c215-31fe-4ecc-bb55-90696f3531dd None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:26.451321 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 222/447] 10.222.0.41 () {56 vars in 1376 bytes} [Fri May 27 09:25:26 2022] GET /identity/v3/role_assignments?group.id=cb220b4c757845e1b97e5c3736908d3e&scope.project.id=b5242eba374f433f9faf5bc522321dd1&role.id=580d60e140704327b90a80fc59a2165c => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:26.451901 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188c215-31fe-4ecc-bb55-90696f3531dd None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:26.491809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:26.552877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 226/448] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:25:26.558550 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56c788-ccfb-431d-b7f9-794043ce741a None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:26.587399 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188c215-31fe-4ecc-bb55-90696f3531dd None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:26.624749 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942cc12-e1f7-437f-bbd8-80f11f70e135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:26.625489 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942cc12-e1f7-437f-bbd8-80f11f70e135 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:26.625771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942cc12-e1f7-437f-bbd8-80f11f70e135 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:26.626054 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942cc12-e1f7-437f-bbd8-80f11f70e135 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:26.663181 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:26.680861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56c788-ccfb-431d-b7f9-794043ce741a None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:26.706029 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942cc12-e1f7-437f-bbd8-80f11f70e135 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:26.707580 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942cc12-e1f7-437f-bbd8-80f11f70e135 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:26.716597 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87951b17-6ede-492c-aaf9-bc54c4781995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:26.717445 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87951b17-6ede-492c-aaf9-bc54c4781995 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:26.717722 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87951b17-6ede-492c-aaf9-bc54c4781995 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:26.717988 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87951b17-6ede-492c-aaf9-bc54c4781995 None admin] PATH_INFO: `/v3/projects/ad2dfb9d6b014e38a0011fb0eee6eae7` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:26.719141 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87951b17-6ede-492c-aaf9-bc54c4781995 None admin] RBAC: Authorizing `identity:get_project(project_id=ad2dfb9d6b014e38a0011fb0eee6eae7)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:26.720604 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87951b17-6ede-492c-aaf9-bc54c4781995 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:26.722291 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 227/449] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:25:26 2022] GET /identity/v3/projects/ad2dfb9d6b014e38a0011fb0eee6eae7 => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:26.727750 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87951b17-6ede-492c-aaf9-bc54c4781995 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:26.744891 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:26.807783 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 223/450] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:25:26.813200 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942cc12-e1f7-437f-bbd8-80f11f70e135 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:26.829701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87951b17-6ede-492c-aaf9-bc54c4781995 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:26.862481 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29861cbd-cd39-4e24-96dc-df7176777461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:26.863830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29861cbd-cd39-4e24-96dc-df7176777461 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:26.864114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29861cbd-cd39-4e24-96dc-df7176777461 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:26.864386 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29861cbd-cd39-4e24-96dc-df7176777461 None admin] PATH_INFO: `/v3/groups/707e8e20e0ff48a89dabe4d73ecf1794` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:26.865553 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29861cbd-cd39-4e24-96dc-df7176777461 None admin] RBAC: Authorizing `identity:get_group(group_id=707e8e20e0ff48a89dabe4d73ecf1794)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:26.867021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29861cbd-cd39-4e24-96dc-df7176777461 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:26.868661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 228/451] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 09:25:26 2022] GET /identity/v3/groups/707e8e20e0ff48a89dabe4d73ecf1794 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:26.873400 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:26.874494 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29861cbd-cd39-4e24-96dc-df7176777461 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:26.910633 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942cc12-e1f7-437f-bbd8-80f11f70e135 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:26.944394 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0314f-544c-4cb9-9910-14b257f31b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:26.945256 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0314f-544c-4cb9-9910-14b257f31b83 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:26.945541 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0314f-544c-4cb9-9910-14b257f31b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:26.945821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0314f-544c-4cb9-9910-14b257f31b83 None admin] PATH_INFO: `/v3/projects/b5242eba374f433f9faf5bc522321dd1` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:26.947004 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0314f-544c-4cb9-9910-14b257f31b83 None admin] RBAC: Authorizing `identity:get_project(project_id=b5242eba374f433f9faf5bc522321dd1)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:26.948508 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0314f-544c-4cb9-9910-14b257f31b83 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:26.950184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 224/452] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:25:26 2022] GET /identity/v3/projects/b5242eba374f433f9faf5bc522321dd1 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:26.955184 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:26.955930 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0314f-544c-4cb9-9910-14b257f31b83 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:26.973127 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29861cbd-cd39-4e24-96dc-df7176777461 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:27.007971 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b941ff9-cc2b-4d4e-8861-f68527a182df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:27.008618 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b941ff9-cc2b-4d4e-8861-f68527a182df None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:27.008900 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b941ff9-cc2b-4d4e-8861-f68527a182df None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:27.009175 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b941ff9-cc2b-4d4e-8861-f68527a182df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:27.009990 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b941ff9-cc2b-4d4e-8861-f68527a182df None admin] RBAC: Adding query filter params (group.id=707e8e20e0ff48a89dabe4d73ecf1794, role.id=bb6c5483d9be4a16ac64750536c5e2e2, scope.project.id=ad2dfb9d6b014e38a0011fb0eee6eae7) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:27.010300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b941ff9-cc2b-4d4e-8861-f68527a182df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:27.011752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b941ff9-cc2b-4d4e-8861-f68527a182df None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:27.017436 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 229/453] 10.222.0.41 () {56 vars in 1376 bytes} [Fri May 27 09:25:26 2022] GET /identity/v3/role_assignments?group.id=707e8e20e0ff48a89dabe4d73ecf1794&scope.project.id=ad2dfb9d6b014e38a0011fb0eee6eae7&role.id=bb6c5483d9be4a16ac64750536c5e2e2 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:27.060897 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0314f-544c-4cb9-9910-14b257f31b83 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:27.093450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:27.099138 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f551343-482a-4468-8882-59f97c597360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:27.100048 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f551343-482a-4468-8882-59f97c597360 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:27.100332 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f551343-482a-4468-8882-59f97c597360 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:27.100608 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f551343-482a-4468-8882-59f97c597360 None admin] PATH_INFO: `/v3/groups/cb220b4c757845e1b97e5c3736908d3e` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:27.101837 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f551343-482a-4468-8882-59f97c597360 None admin] RBAC: Authorizing `identity:get_group(group_id=cb220b4c757845e1b97e5c3736908d3e)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:27.103401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f551343-482a-4468-8882-59f97c597360 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:27.105068 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 225/454] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 09:25:26 2022] GET /identity/v3/groups/cb220b4c757845e1b97e5c3736908d3e => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:27.111308 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b941ff9-cc2b-4d4e-8861-f68527a182df None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:27.214007 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b941ff9-cc2b-4d4e-8861-f68527a182df None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:27.251060 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef927ee4-fc5e-436d-9064-ff202c5b0e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:27.251752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef927ee4-fc5e-436d-9064-ff202c5b0e15 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:27.252033 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef927ee4-fc5e-436d-9064-ff202c5b0e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:27.252303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef927ee4-fc5e-436d-9064-ff202c5b0e15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:27.253127 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef927ee4-fc5e-436d-9064-ff202c5b0e15 None admin] RBAC: Adding query filter params (group.id=cb220b4c757845e1b97e5c3736908d3e, role.id=207b29fd2d8344ceb403e1c2e9d91ac2, scope.project.id=b5242eba374f433f9faf5bc522321dd1) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:27.253436 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef927ee4-fc5e-436d-9064-ff202c5b0e15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:27.254876 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef927ee4-fc5e-436d-9064-ff202c5b0e15 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:27.260609 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 230/455] 10.222.0.41 () {56 vars in 1376 bytes} [Fri May 27 09:25:27 2022] GET /identity/v3/role_assignments?group.id=cb220b4c757845e1b97e5c3736908d3e&scope.project.id=b5242eba374f433f9faf5bc522321dd1&role.id=207b29fd2d8344ceb403e1c2e9d91ac2 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:30.290429 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924c814-db41-4a9e-a1cf-e0cde11ac8cb None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:30.291475 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924c814-db41-4a9e-a1cf-e0cde11ac8cb None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:30.291986 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924c814-db41-4a9e-a1cf-e0cde11ac8cb None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:30.293816 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 226/456] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:30.298793 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ad159-5678-4a15-92c1-1557ef8d4d2c None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:30.299625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ad159-5678-4a15-92c1-1557ef8d4d2c None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:30.300214 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ad159-5678-4a15-92c1-1557ef8d4d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:30.317778 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11c2b2-2373-45ee-bd82-154191ab8566 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:30.318061 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11c2b2-2373-45ee-bd82-154191ab8566 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:30.318260 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11c2b2-2373-45ee-bd82-154191ab8566 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:30.319895 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-f66ad159-5678-4a15-92c1-1557ef8d4d2c None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:30.320058 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 227/457] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:30.321430 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f66ad159-5678-4a15-92c1-1557ef8d4d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:30.324685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:30.329036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed09c4-7857-4c3f-b2b9-67b78e92cd27 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:30.329331 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed09c4-7857-4c3f-b2b9-67b78e92cd27 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:30.330118 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed09c4-7857-4c3f-b2b9-67b78e92cd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:30.366591 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-4fed09c4-7857-4c3f-b2b9-67b78e92cd27 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:30.367815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-4fed09c4-7857-4c3f-b2b9-67b78e92cd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:30.457031 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 231/458] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:30.481830 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 228/459] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:30.489656 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ad159-5678-4a15-92c1-1557ef8d4d2c None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:30.514116 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed09c4-7857-4c3f-b2b9-67b78e92cd27 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:30.629471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed09c4-7857-4c3f-b2b9-67b78e92cd27 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:30.662911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ad159-5678-4a15-92c1-1557ef8d4d2c None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:30.666734 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:30.674110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06ac76-d76e-45fc-a002-c7d607007d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:30.674911 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06ac76-d76e-45fc-a002-c7d607007d80 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:30.675191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06ac76-d76e-45fc-a002-c7d607007d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:30.675510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06ac76-d76e-45fc-a002-c7d607007d80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:30.688627 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06ac76-d76e-45fc-a002-c7d607007d80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:30.690782 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06ac76-d76e-45fc-a002-c7d607007d80 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:30.699579 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921dc067-4fef-4850-80e3-b4ed135278bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:30.700665 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dc067-4fef-4850-80e3-b4ed135278bf None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:30.701143 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dc067-4fef-4850-80e3-b4ed135278bf None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:30.701608 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dc067-4fef-4850-80e3-b4ed135278bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:30.711005 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:30.713915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-af06ac76-d76e-45fc-a002-c7d607007d80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:30.713915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:30.713915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:30.713915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:30.713915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:30.713915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:30.713915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:30.713915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:30.713915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:30.713915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:30.713915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:30.713915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:30.713915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:30.713915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:30.713915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:30.715967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:30.715967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:30.715967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:30.715967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:30.715967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:30.715967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:30.715967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:30.715967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:30.715967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:30.715967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:30.715967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:30.715967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:30.715967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:30.715967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:30.715967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:30.715967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:30.715967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:30.716799 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:30.716799 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:30.716799 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:30.716799 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:30.717020 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921dc067-4fef-4850-80e3-b4ed135278bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:30.717088 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 229/460] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:25:30.717088 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58534d6f-7c94-482f-ba16-bd4c3005fbf3 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:30.717088 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58534d6f-7c94-482f-ba16-bd4c3005fbf3 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:30.717249 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58534d6f-7c94-482f-ba16-bd4c3005fbf3 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:30.718618 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921dc067-4fef-4850-80e3-b4ed135278bf None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:30.719314 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 230/461] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:30.720801 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58534d6f-7c94-482f-ba16-bd4c3005fbf3 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:30.743661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-921dc067-4fef-4850-80e3-b4ed135278bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:30.743661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:30.743661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:30.743661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:30.743661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:30.743661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:30.743661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:30.743661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:30.743661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:30.743661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:30.743661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:30.743661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:30.743661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:30.743661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:30.743661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:30.744555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:30.744555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:30.744555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:30.744555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:30.744555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:30.744555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:30.744555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:30.744555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:30.744555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:30.744555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:30.744555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:30.744555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:30.744555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:30.744555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:30.744555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:30.744555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:30.744555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:30.745392 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:30.745392 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:30.745392 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:30.745392 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:30.745392 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 232/462] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:30.746366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672887d-e9c6-4f83-8c3d-3d04d39ab5a8 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:30.746846 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672887d-e9c6-4f83-8c3d-3d04d39ab5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:30.747240 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672887d-e9c6-4f83-8c3d-3d04d39ab5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:30.766230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-e672887d-e9c6-4f83-8c3d-3d04d39ab5a8 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:30.767710 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e672887d-e9c6-4f83-8c3d-3d04d39ab5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:30.851242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 233/463] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:30.852885 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672887d-e9c6-4f83-8c3d-3d04d39ab5a8 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:30.858801 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58534d6f-7c94-482f-ba16-bd4c3005fbf3 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:30.899066 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde83c7e-b62a-440b-999e-d3dded345cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:30.900055 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde83c7e-b62a-440b-999e-d3dded345cce None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:30.900495 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde83c7e-b62a-440b-999e-d3dded345cce None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:30.900917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde83c7e-b62a-440b-999e-d3dded345cce None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:30.901780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde83c7e-b62a-440b-999e-d3dded345cce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:30.902239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde83c7e-b62a-440b-999e-d3dded345cce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:30.903960 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde83c7e-b62a-440b-999e-d3dded345cce None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:30.923798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 231/464] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:30.925019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde83c7e-b62a-440b-999e-d3dded345cce None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:30.974414 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:30.978604 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672887d-e9c6-4f83-8c3d-3d04d39ab5a8 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:31.013144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:31.028097 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5d447-b52b-4523-873e-285a2fe952d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:31.028767 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5d447-b52b-4523-873e-285a2fe952d4 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:31.029046 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5d447-b52b-4523-873e-285a2fe952d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:31.029316 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5d447-b52b-4523-873e-285a2fe952d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:31.032760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5d447-b52b-4523-873e-285a2fe952d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:31.032760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5d447-b52b-4523-873e-285a2fe952d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:31.032760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5d447-b52b-4523-873e-285a2fe952d4 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:31.044073 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 234/465] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:31.044681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5d447-b52b-4523-873e-285a2fe952d4 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:31.048301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde83c7e-b62a-440b-999e-d3dded345cce None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:31.093167 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5da22a-426f-48f0-be7e-7cd9805a4922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:31.094001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5da22a-426f-48f0-be7e-7cd9805a4922 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:31.094246 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5da22a-426f-48f0-be7e-7cd9805a4922 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:31.094522 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5da22a-426f-48f0-be7e-7cd9805a4922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:31.105217 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5da22a-426f-48f0-be7e-7cd9805a4922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:31.106680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5da22a-426f-48f0-be7e-7cd9805a4922 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:31.125421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-ab5da22a-426f-48f0-be7e-7cd9805a4922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:31.125421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:31.125421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:31.125421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:31.125421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:31.125421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:31.125421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:31.125421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:31.125421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:31.125421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:31.125421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:31.125421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:31.125421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:31.125421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:31.125421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:31.126330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:31.126330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:31.126330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:31.126330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:31.126330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:31.126330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:31.126330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:31.126330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:31.126330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:31.126330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:31.126330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:31.126330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:31.126330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:31.126330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:31.126330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:31.126330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:31.126330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:31.127153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:31.127153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:31.127153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:31.127153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:31.127153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 232/466] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:31.128216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec663c-a6ab-4fe2-9d30-d5b16ce5ed4e None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:31.128216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec663c-a6ab-4fe2-9d30-d5b16ce5ed4e None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:31.128893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec663c-a6ab-4fe2-9d30-d5b16ce5ed4e None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:31.131389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 233/467] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:31.131389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec663c-a6ab-4fe2-9d30-d5b16ce5ed4e None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:31.157446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5d447-b52b-4523-873e-285a2fe952d4 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:31.193105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15efc5f-79a9-41d0-a086-35969b1f5de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:31.194782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15efc5f-79a9-41d0-a086-35969b1f5de5 None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:31.195579 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15efc5f-79a9-41d0-a086-35969b1f5de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:31.196085 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15efc5f-79a9-41d0-a086-35969b1f5de5 None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:31.197621 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15efc5f-79a9-41d0-a086-35969b1f5de5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:31.199580 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15efc5f-79a9-41d0-a086-35969b1f5de5 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:31.224318 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 235/468] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 09:25:31 2022] POST /identity/v3/users => generated 248 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:25:31.225752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15efc5f-79a9-41d0-a086-35969b1f5de5 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:31.229802 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:31.240107 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec663c-a6ab-4fe2-9d30-d5b16ce5ed4e None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:31.284986 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53eceb7-5b07-42bd-9748-385fabde7961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:31.286544 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eceb7-5b07-42bd-9748-385fabde7961 None admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:31.286544 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eceb7-5b07-42bd-9748-385fabde7961 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:31.286544 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eceb7-5b07-42bd-9748-385fabde7961 None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:31.287161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53eceb7-5b07-42bd-9748-385fabde7961 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:31.288852 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53eceb7-5b07-42bd-9748-385fabde7961 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:31.302924 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:31.323375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 234/469] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 09:25:31 2022] POST /identity/v3/users => generated 246 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:25:31.323375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12698874-f512-4347-a98e-7534ce4b7353 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:31.323375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12698874-f512-4347-a98e-7534ce4b7353 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:31.323375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12698874-f512-4347-a98e-7534ce4b7353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:31.365616 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-12698874-f512-4347-a98e-7534ce4b7353 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:31.366891 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-12698874-f512-4347-a98e-7534ce4b7353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:31.420810 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15efc5f-79a9-41d0-a086-35969b1f5de5 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:31.486359 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19f013-db4c-45ef-b183-bcc58faa584a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:31.487049 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19f013-db4c-45ef-b183-bcc58faa584a None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:31.487417 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19f013-db4c-45ef-b183-bcc58faa584a None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:31.487692 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19f013-db4c-45ef-b183-bcc58faa584a None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:31.488979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19f013-db4c-45ef-b183-bcc58faa584a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:31.489292 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19f013-db4c-45ef-b183-bcc58faa584a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:31.490761 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19f013-db4c-45ef-b183-bcc58faa584a None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:31.494488 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 235/470] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:31.496191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4980c-faaf-4152-9fac-972403461b07 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:31.496191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4980c-faaf-4152-9fac-972403461b07 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:31.496384 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4980c-faaf-4152-9fac-972403461b07 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:31.497811 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 236/471] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:31.504537 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833d520-b2d7-4ba3-aec4-ebb5965dbc7a None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:31.505484 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833d520-b2d7-4ba3-aec4-ebb5965dbc7a None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:31.505484 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833d520-b2d7-4ba3-aec4-ebb5965dbc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:31.511397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 236/472] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:31.517153 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19f013-db4c-45ef-b183-bcc58faa584a None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:31.524923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-1833d520-b2d7-4ba3-aec4-ebb5965dbc7a None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:31.526258 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-1833d520-b2d7-4ba3-aec4-ebb5965dbc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:31.621242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 237/473] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:25:31.622089 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833d520-b2d7-4ba3-aec4-ebb5965dbc7a None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:31.638957 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:31.642079 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:31.646087 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19f013-db4c-45ef-b183-bcc58faa584a None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:31.686656 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913352d6-8b9b-4ba9-9347-346d8c5369d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:31.687599 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913352d6-8b9b-4ba9-9347-346d8c5369d0 None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:31.688046 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913352d6-8b9b-4ba9-9347-346d8c5369d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:31.688463 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913352d6-8b9b-4ba9-9347-346d8c5369d0 None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:31.689360 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913352d6-8b9b-4ba9-9347-346d8c5369d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:31.691068 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913352d6-8b9b-4ba9-9347-346d8c5369d0 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:31.715977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 237/474] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 09:25:31 2022] POST /identity/v3/users => generated 248 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:25:31.717114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913352d6-8b9b-4ba9-9347-346d8c5369d0 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:31.752294 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833d520-b2d7-4ba3-aec4-ebb5965dbc7a None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:31.829752 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56124324-d5f1-48f9-b3ff-9f0839f80141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:31.830806 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56124324-d5f1-48f9-b3ff-9f0839f80141 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:31.831232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56124324-d5f1-48f9-b3ff-9f0839f80141 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:31.832344 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56124324-d5f1-48f9-b3ff-9f0839f80141 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:31.852388 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56124324-d5f1-48f9-b3ff-9f0839f80141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:31.854981 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56124324-d5f1-48f9-b3ff-9f0839f80141 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:31.891090 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-56124324-d5f1-48f9-b3ff-9f0839f80141 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:31.891090 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:31.891090 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:31.891090 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:31.891090 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:31.891090 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:31.891090 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:31.891090 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:31.891090 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:31.891090 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:31.891090 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:31.891090 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:31.891090 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:31.891090 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:31.891090 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:31.892193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:31.892193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:31.892193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:31.892193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:31.892193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:31.892193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:31.892193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:31.892193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:31.892193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:31.892193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:31.892193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:31.892193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:31.892193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:31.892193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:31.892193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:31.892193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:31.892193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:31.893227 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:31.893227 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:31.893227 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:31.893227 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:31.895734 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 238/475] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:31.901985 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56124324-d5f1-48f9-b3ff-9f0839f80141 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:31.920243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913352d6-8b9b-4ba9-9347-346d8c5369d0 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:31.972231 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e442b94-1b2f-4fcd-980f-795615711e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:31.973542 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e442b94-1b2f-4fcd-980f-795615711e70 None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:31.973542 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e442b94-1b2f-4fcd-980f-795615711e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:31.973542 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e442b94-1b2f-4fcd-980f-795615711e70 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:31.974126 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e442b94-1b2f-4fcd-980f-795615711e70 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:31.975730 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e442b94-1b2f-4fcd-980f-795615711e70 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:31.984529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.sql.core [None req-8e442b94-1b2f-4fcd-980f-795615711e70 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 09:25:31.984529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 27 09:25:31.984529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [parameters: {'id': '57042f0bfe17444aad02746f4e654f00', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 27 09:25:31.984529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80091) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 09:25:32.008854 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-8e442b94-1b2f-4fcd-980f-795615711e70 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 27 09:25:32.008854 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:32.008854 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 09:25:32.008854 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 09:25:32.008854 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 09:25:32.008854 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 09:25:32.008854 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 09:25:32.008854 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application result = self._query(query) May 27 09:25:32.008854 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 09:25:32.008854 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application conn.query(q) May 27 09:25:32.008854 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 09:25:32.008854 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 09:25:32.008854 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 09:25:32.008854 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application result.read() May 27 09:25:32.008854 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 09:25:32.009788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 09:25:32.009788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 09:25:32.009788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 09:25:32.009788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 09:25:32.009788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 09:25:32.009788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 09:25:32.009788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 09:25:32.009788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 09:25:32.009788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:32.009788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 09:25:32.009788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:32.009788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:32.009788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 09:25:32.009788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 09:25:32.009788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 27 09:25:32.009788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return ref.to_dict() May 27 09:25:32.009788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 09:25:32.009788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application next(self.gen) May 27 09:25:32.011150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 09:25:32.011150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application yield resource May 27 09:25:32.011150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 09:25:32.011150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application next(self.gen) May 27 09:25:32.011150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 09:25:32.011150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self.session.rollback() May 27 09:25:32.011150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 09:25:32.011150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self.force_reraise() May 27 09:25:32.011150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 09:25:32.011150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise self.value May 27 09:25:32.011150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 09:25:32.011150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 09:25:32.011150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 09:25:32.011150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application session.commit() May 27 09:25:32.011150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 09:25:32.011150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 09:25:32.011150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 09:25:32.012207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._prepare_impl() May 27 09:25:32.012207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 09:25:32.012207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self.session.flush() May 27 09:25:32.012207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 09:25:32.012207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._flush(objects) May 27 09:25:32.012207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 09:25:32.012207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 09:25:32.012207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 09:25:32.012207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application compat.raise_( May 27 09:25:32.012207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 09:25:32.012207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception May 27 09:25:32.012207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 09:25:32.012207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application flush_context.execute() May 27 09:25:32.012207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 09:25:32.012207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rec.execute(self) May 27 09:25:32.012207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 09:25:32.012207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 09:25:32.013041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 09:25:32.013041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 09:25:32.013041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 27 09:25:32.013041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application c = connection._execute_20( May 27 09:25:32.013041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 09:25:32.013041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 09:25:32.013041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 09:25:32.013041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 09:25:32.013041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 09:25:32.013041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 09:25:32.013041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 09:25:32.013041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 09:25:32.013041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 09:25:32.013041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 09:25:32.013041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 09:25:32.013041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception May 27 09:25:32.013814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 09:25:32.013814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 09:25:32.013814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 09:25:32.013814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 09:25:32.013814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 09:25:32.013814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application result = self._query(query) May 27 09:25:32.013814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 09:25:32.013814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application conn.query(q) May 27 09:25:32.013814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 09:25:32.013814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 09:25:32.013814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 09:25:32.013814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application result.read() May 27 09:25:32.013814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 09:25:32.013814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 09:25:32.013814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 09:25:32.013814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 09:25:32.015623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 09:25:32.015623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 09:25:32.015623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 09:25:32.015623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 09:25:32.015623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 09:25:32.015623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 27 09:25:32.015623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [parameters: {'id': '57042f0bfe17444aad02746f4e654f00', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 27 09:25:32.015623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 09:25:32.015623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:32.015623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:25:32.015623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:32.015623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:32.015623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:32.015623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:32.015623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:32.015623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:32.016658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:32.016658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:32.016658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:32.016658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:32.016658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:32.016658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:32.016658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 27 09:25:32.016658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 27 09:25:32.016658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:32.016658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:32.016658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 27 09:25:32.016658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 27 09:25:32.016658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 09:25:32.016658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 09:25:32.016658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 27 09:25:32.016658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:32.017677 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 238/476] 10.222.0.41 () {60 vars in 1131 bytes} [Fri May 27 09:25:31 2022] POST /identity/v3/roles => generated 144 bytes in 293 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:32.019375 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e442b94-1b2f-4fcd-980f-795615711e70 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:32.019855 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:32.051812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:32.069404 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56124324-d5f1-48f9-b3ff-9f0839f80141 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:32.108418 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ddb78-fea6-44c5-9f38-df89f4ba46a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:32.109353 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ddb78-fea6-44c5-9f38-df89f4ba46a0 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:32.109780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ddb78-fea6-44c5-9f38-df89f4ba46a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:32.110506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ddb78-fea6-44c5-9f38-df89f4ba46a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:32.111400 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ddb78-fea6-44c5-9f38-df89f4ba46a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:32.111842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ddb78-fea6-44c5-9f38-df89f4ba46a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:32.113924 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ddb78-fea6-44c5-9f38-df89f4ba46a0 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:32.126843 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 239/477] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:32.132362 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ddb78-fea6-44c5-9f38-df89f4ba46a0 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:32.141141 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e442b94-1b2f-4fcd-980f-795615711e70 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:32.179299 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277dc65f-f32c-4353-bb90-e56834690772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:32.179299 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277dc65f-f32c-4353-bb90-e56834690772 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:32.179299 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277dc65f-f32c-4353-bb90-e56834690772 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:32.179299 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277dc65f-f32c-4353-bb90-e56834690772 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:32.188397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277dc65f-f32c-4353-bb90-e56834690772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:32.201743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-277dc65f-f32c-4353-bb90-e56834690772 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:25:32.201743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:32.201743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:32.201743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:32.201743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:32.201743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:32.201743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:32.201743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:32.201743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:32.201743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:32.201743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:32.201743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:32.201743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:32.201743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:32.201743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:32.201743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:32.202695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:32.202695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:32.202695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:32.202695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:32.202695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:32.202695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:32.202695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:32.202695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:32.202695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:32.202695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:32.202695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:32.202695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:32.202695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:32.202695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:32.202695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:32.202695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:32.203861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:32.203861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:32.203861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:32.203861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:32.203861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:32.203861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:32.203861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:32.203861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:32.203861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:32.203861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:32.203861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 09:25:32.203861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:32.203861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 239/478] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 09:25:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:32.209014 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277dc65f-f32c-4353-bb90-e56834690772 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:32.311676 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:32.318457 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277dc65f-f32c-4353-bb90-e56834690772 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:32.350632 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ddb78-fea6-44c5-9f38-df89f4ba46a0 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:32.354427 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21143d76-6915-4429-8f7c-0a89bcdf6a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:32.355099 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21143d76-6915-4429-8f7c-0a89bcdf6a25 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:32.355426 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21143d76-6915-4429-8f7c-0a89bcdf6a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:32.355703 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21143d76-6915-4429-8f7c-0a89bcdf6a25 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:32.356441 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21143d76-6915-4429-8f7c-0a89bcdf6a25 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:32.356746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21143d76-6915-4429-8f7c-0a89bcdf6a25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:32.368011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21143d76-6915-4429-8f7c-0a89bcdf6a25 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:32.374275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:32.377745 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 240/479] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:32.405671 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa369e14-50ce-4843-9647-36582e1bc97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:32.406380 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa369e14-50ce-4843-9647-36582e1bc97d None admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:32.406671 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa369e14-50ce-4843-9647-36582e1bc97d None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:32.406950 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa369e14-50ce-4843-9647-36582e1bc97d None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:32.407746 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa369e14-50ce-4843-9647-36582e1bc97d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:32.409254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa369e14-50ce-4843-9647-36582e1bc97d None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:32.450666 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 240/480] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 09:25:32 2022] POST /identity/v3/users => generated 249 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:25:33.982038 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137311f-2ced-42c3-8c8c-8eb55acedfe3 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:33.982740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137311f-2ced-42c3-8c8c-8eb55acedfe3 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:33.982740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137311f-2ced-42c3-8c8c-8eb55acedfe3 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:33.984252 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 241/481] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:33.991969 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9104f-3fd6-4b18-87f9-77db3f954ade None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:33.992539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9104f-3fd6-4b18-87f9-77db3f954ade None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:33.992717 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9104f-3fd6-4b18-87f9-77db3f954ade None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:33.994205 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 241/482] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:33.996728 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ea45a-02b4-43b1-bcb8-14e58f3d39ab None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:33.997025 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ea45a-02b4-43b1-bcb8-14e58f3d39ab None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:33.997310 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ea45a-02b4-43b1-bcb8-14e58f3d39ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:34.012060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7b791-3c49-49f1-8348-95eb4239a449 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:34.012354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7b791-3c49-49f1-8348-95eb4239a449 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:34.012639 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7b791-3c49-49f1-8348-95eb4239a449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:34.021311 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-882ea45a-02b4-43b1-bcb8-14e58f3d39ab None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:34.022514 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-882ea45a-02b4-43b1-bcb8-14e58f3d39ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:34.050694 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-91b7b791-3c49-49f1-8348-95eb4239a449 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:34.051930 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-91b7b791-3c49-49f1-8348-95eb4239a449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:34.131265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 242/483] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:25:34.157020 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ea45a-02b4-43b1-bcb8-14e58f3d39ab None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:34.205443 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 242/484] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:25:34.239239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7b791-3c49-49f1-8348-95eb4239a449 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:34.265690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:34.335803 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ea45a-02b4-43b1-bcb8-14e58f3d39ab None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:34.410309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b62fe-fc03-455b-a56d-4152ffb29e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:34.411137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b62fe-fc03-455b-a56d-4152ffb29e86 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:34.411450 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b62fe-fc03-455b-a56d-4152ffb29e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:34.411724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b62fe-fc03-455b-a56d-4152ffb29e86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:34.421408 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7b791-3c49-49f1-8348-95eb4239a449 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:34.423580 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b62fe-fc03-455b-a56d-4152ffb29e86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:34.432847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-ac3b62fe-fc03-455b-a56d-4152ffb29e86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:34.432847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:34.432847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:34.432847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:34.432847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:34.432847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:34.432847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:34.432847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:34.432847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:34.432847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:34.432847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:34.432847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:34.432847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:34.432847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:34.432847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:34.432847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:34.433744 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:34.433744 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:34.433744 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:34.433744 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:34.433744 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:34.433744 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:34.433744 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:34.433744 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:34.433744 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:34.433744 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:34.433744 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:34.433744 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:34.433744 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:34.433744 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:34.433744 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:34.433744 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:34.434514 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:34.434514 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:34.434514 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:34.434514 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:34.434514 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:34.434514 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:34.434514 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:34.434514 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:34.434514 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:34.434514 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:34.434514 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:34.434514 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:34.434514 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 243/485] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 09:25:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:25:34.440603 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b62fe-fc03-455b-a56d-4152ffb29e86 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:34.443623 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:34.500093 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc6ae8-ac89-4016-9951-c8b728fd35f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:34.500825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc6ae8-ac89-4016-9951-c8b728fd35f5 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:34.501110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc6ae8-ac89-4016-9951-c8b728fd35f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:34.501386 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc6ae8-ac89-4016-9951-c8b728fd35f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:34.524559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc6ae8-ac89-4016-9951-c8b728fd35f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:34.532452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-3afc6ae8-ac89-4016-9951-c8b728fd35f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:34.532452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:34.532452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:34.532452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:34.532452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:34.532452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:34.532452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:34.532452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:34.532452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:34.532452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:34.532452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:34.532452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:34.532452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:34.532452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:34.532452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:34.532452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:34.533326 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:34.533326 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:34.533326 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:34.533326 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:34.533326 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:34.533326 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:34.533326 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:34.533326 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:34.533326 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:34.533326 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:34.533326 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:34.533326 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:34.533326 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:34.533326 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:34.533326 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:34.533326 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:34.534114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:34.534114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:34.534114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:34.534114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:34.534114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:34.534114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:34.534114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:34.534114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:34.534114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:34.534114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:34.534114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:34.534114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:34.534114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 243/486] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 09:25:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:25:34.539454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc6ae8-ac89-4016-9951-c8b728fd35f5 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:34.602065 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b62fe-fc03-455b-a56d-4152ffb29e86 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:34.633248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:34.640175 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed1237-0a32-4e50-a14d-00c515929e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:34.640854 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed1237-0a32-4e50-a14d-00c515929e2e None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:34.641142 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed1237-0a32-4e50-a14d-00c515929e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:34.641421 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed1237-0a32-4e50-a14d-00c515929e2e None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:34.642277 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed1237-0a32-4e50-a14d-00c515929e2e None admin] RBAC: Adding query filter params (name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:34.642695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed1237-0a32-4e50-a14d-00c515929e2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:34.644124 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed1237-0a32-4e50-a14d-00c515929e2e None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:34.648732 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc6ae8-ac89-4016-9951-c8b728fd35f5 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:34.653052 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 244/487] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 09:25:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:34.654307 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02136eff-fdb0-456e-93c9-d60aad18fab4 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:34.654596 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02136eff-fdb0-456e-93c9-d60aad18fab4 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:34.654879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02136eff-fdb0-456e-93c9-d60aad18fab4 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:34.656360 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 245/488] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:34.658489 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02136eff-fdb0-456e-93c9-d60aad18fab4 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:34.695970 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ba6c7-029f-4d78-80bd-1384f3480656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:34.696650 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ba6c7-029f-4d78-80bd-1384f3480656 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:34.696934 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ba6c7-029f-4d78-80bd-1384f3480656 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:34.697211 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ba6c7-029f-4d78-80bd-1384f3480656 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:34.697959 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ba6c7-029f-4d78-80bd-1384f3480656 None admin] RBAC: Adding query filter params (name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:34.698266 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ba6c7-029f-4d78-80bd-1384f3480656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:34.699674 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ba6c7-029f-4d78-80bd-1384f3480656 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:34.708759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 244/489] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 09:25:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:34.713273 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831048b-8590-4202-bbe0-1c0f4297a8f5 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:34.713273 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831048b-8590-4202-bbe0-1c0f4297a8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:34.713273 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831048b-8590-4202-bbe0-1c0f4297a8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:34.729614 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-3831048b-8590-4202-bbe0-1c0f4297a8f5 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:34.730914 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-3831048b-8590-4202-bbe0-1c0f4297a8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:34.760192 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:34.807159 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02136eff-fdb0-456e-93c9-d60aad18fab4 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:34.811560 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 245/490] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:34.812743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831048b-8590-4202-bbe0-1c0f4297a8f5 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:34.855376 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c01059-7ef2-4851-999d-a3787712ed59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:34.856571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c01059-7ef2-4851-999d-a3787712ed59 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:34.857058 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c01059-7ef2-4851-999d-a3787712ed59 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:34.857552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c01059-7ef2-4851-999d-a3787712ed59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:34.871446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c01059-7ef2-4851-999d-a3787712ed59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:34.874517 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c01059-7ef2-4851-999d-a3787712ed59 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:34.892965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-94c01059-7ef2-4851-999d-a3787712ed59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:34.892965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:34.892965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:34.892965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:34.892965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:34.892965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:34.892965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:34.892965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:34.892965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:34.892965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:34.892965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:34.892965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:34.892965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:34.892965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:34.892965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:34.893866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:34.893866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:34.893866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:34.893866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:34.893866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:34.893866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:34.893866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:34.893866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:34.893866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:34.893866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:34.893866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:34.893866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:34.893866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:34.893866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:34.893866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:34.893866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:34.893866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:34.894684 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:34.894684 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:34.894684 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:34.894684 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:34.896613 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 246/491] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:34.901886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c01059-7ef2-4851-999d-a3787712ed59 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:34.939354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831048b-8590-4202-bbe0-1c0f4297a8f5 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:34.953062 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:34.980318 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e29952-c654-429d-b8d7-0bac107b4af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:34.981608 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e29952-c654-429d-b8d7-0bac107b4af0 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:34.982131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e29952-c654-429d-b8d7-0bac107b4af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:34.982602 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e29952-c654-429d-b8d7-0bac107b4af0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:34.994483 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e29952-c654-429d-b8d7-0bac107b4af0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:34.996852 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e29952-c654-429d-b8d7-0bac107b4af0 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:35.018513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-d9e29952-c654-429d-b8d7-0bac107b4af0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:35.018513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:35.018513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:35.018513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:35.018513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:35.018513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:35.018513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:35.018513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:35.018513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:35.018513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:35.018513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:35.018513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:35.018513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:35.018513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:35.018513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:35.020080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:35.020080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:35.020080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:35.020080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:35.020080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:35.020080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:35.020080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:35.020080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:35.020080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:35.020080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:35.020080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:35.020080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:35.020080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:35.020080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:35.020080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:35.020080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:35.020080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:35.021095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:35.021095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:35.021095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:35.021095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:35.021958 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 246/492] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:35.022760 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e29952-c654-429d-b8d7-0bac107b4af0 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:35.028000 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c01059-7ef2-4851-999d-a3787712ed59 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:35.040964 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:35.073200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed882c9-0e12-4bfc-aab6-7ffa71e602ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:35.074119 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed882c9-0e12-4bfc-aab6-7ffa71e602ea None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:35.074412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed882c9-0e12-4bfc-aab6-7ffa71e602ea None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:35.074706 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed882c9-0e12-4bfc-aab6-7ffa71e602ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:35.086595 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed882c9-0e12-4bfc-aab6-7ffa71e602ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:35.095538 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-9ed882c9-0e12-4bfc-aab6-7ffa71e602ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:35.095538 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:35.095538 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:35.095538 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:35.095538 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:35.095538 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:35.095538 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:35.095538 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:35.095538 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:35.095538 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:35.095538 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:35.095538 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:35.095538 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:35.095538 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:35.095538 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:35.095538 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:35.096433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:35.096433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:35.096433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:35.096433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:35.096433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:35.096433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:35.096433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:35.096433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:35.096433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:35.096433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:35.096433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:35.096433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:35.096433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:35.096433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:35.096433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:35.096433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:35.097833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:35.097833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:35.097833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:35.097833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:35.097833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:35.097833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:35.097833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:35.097833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:35.097833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:35.097833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:35.097833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:35.097833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:35.097833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 247/493] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 09:25:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:35.098974 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aac2ec-230c-4671-a693-57195d3cc83b None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:35.098974 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aac2ec-230c-4671-a693-57195d3cc83b None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:35.099123 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aac2ec-230c-4671-a693-57195d3cc83b None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:35.103406 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 248/494] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:35.103406 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aac2ec-230c-4671-a693-57195d3cc83b None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:35.139197 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e29952-c654-429d-b8d7-0bac107b4af0 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:35.174284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e98d88-81cd-402a-bd73-efc8a7d5e722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:35.174949 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e98d88-81cd-402a-bd73-efc8a7d5e722 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:35.175295 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e98d88-81cd-402a-bd73-efc8a7d5e722 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:35.175589 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e98d88-81cd-402a-bd73-efc8a7d5e722 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:35.176296 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e98d88-81cd-402a-bd73-efc8a7d5e722 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:35.176607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e98d88-81cd-402a-bd73-efc8a7d5e722 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:35.178008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e98d88-81cd-402a-bd73-efc8a7d5e722 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:35.190644 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 247/495] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:35.191556 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e98d88-81cd-402a-bd73-efc8a7d5e722 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:35.216759 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aac2ec-230c-4671-a693-57195d3cc83b None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:35.219603 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:35.255652 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebaf079-e106-42ce-80f2-d20f3622946b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:35.256317 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebaf079-e106-42ce-80f2-d20f3622946b None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:35.256814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebaf079-e106-42ce-80f2-d20f3622946b None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:35.256932 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebaf079-e106-42ce-80f2-d20f3622946b None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:35.257573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebaf079-e106-42ce-80f2-d20f3622946b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:35.257879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebaf079-e106-42ce-80f2-d20f3622946b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:35.259243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebaf079-e106-42ce-80f2-d20f3622946b None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:35.271118 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:35.275852 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 249/496] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:35.277053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008db801-6b6b-4bd3-8d81-6c8f1c6d4ad2 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:35.277344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008db801-6b6b-4bd3-8d81-6c8f1c6d4ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:35.277618 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008db801-6b6b-4bd3-8d81-6c8f1c6d4ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:35.295166 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-008db801-6b6b-4bd3-8d81-6c8f1c6d4ad2 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:35.296411 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-008db801-6b6b-4bd3-8d81-6c8f1c6d4ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:35.305496 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e98d88-81cd-402a-bd73-efc8a7d5e722 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:35.343875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcf6c1-8bef-4c2b-b89d-812d87882462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:35.344555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcf6c1-8bef-4c2b-b89d-812d87882462 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:35.344844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcf6c1-8bef-4c2b-b89d-812d87882462 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:35.345123 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcf6c1-8bef-4c2b-b89d-812d87882462 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:35.346166 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bcf6c1-8bef-4c2b-b89d-812d87882462 None admin] RBAC: Adding query filter params (name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:35.346166 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bcf6c1-8bef-4c2b-b89d-812d87882462 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:35.348114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bcf6c1-8bef-4c2b-b89d-812d87882462 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:35.356856 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 248/497] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 09:25:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:35.357480 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcf6c1-8bef-4c2b-b89d-812d87882462 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:35.387307 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 250/498] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:35.387307 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008db801-6b6b-4bd3-8d81-6c8f1c6d4ad2 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:35.475666 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcf6c1-8bef-4c2b-b89d-812d87882462 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:35.485219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:35.494425 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008db801-6b6b-4bd3-8d81-6c8f1c6d4ad2 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:35.510785 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b41c6-b6e6-40bb-8e9b-ef8b89aba85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:35.511696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b41c6-b6e6-40bb-8e9b-ef8b89aba85f None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:35.511983 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b41c6-b6e6-40bb-8e9b-ef8b89aba85f None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:35.512262 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b41c6-b6e6-40bb-8e9b-ef8b89aba85f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:35.514173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:35.520460 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b41c6-b6e6-40bb-8e9b-ef8b89aba85f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:35.522085 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b41c6-b6e6-40bb-8e9b-ef8b89aba85f None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:35.529128 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aefb22-c1ea-42c6-937a-ba56ec8dc22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:35.529908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aefb22-c1ea-42c6-937a-ba56ec8dc22a None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:35.530210 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aefb22-c1ea-42c6-937a-ba56ec8dc22a None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:35.530480 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aefb22-c1ea-42c6-937a-ba56ec8dc22a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:35.537905 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aefb22-c1ea-42c6-937a-ba56ec8dc22a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:35.538018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-ec3b41c6-b6e6-40bb-8e9b-ef8b89aba85f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 09:25:35.538018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:35.538018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:35.538018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:35.538018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:35.538018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:35.538018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:35.538018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:35.538018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:35.538018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:35.538018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:35.538018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:35.538018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:25:35.538018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:25:35.538018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:25:35.538018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:25:35.538931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:35.538931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:35.538931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:25:35.538931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:35.538931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:25:35.538931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:35.538931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:35.538931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:35.538931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:35.538931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:35.538931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:35.538931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:35.538931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:35.538931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:35.538931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:35.538931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:35.538931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:35.538931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:35.540094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:35.540094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:35.540094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:25:35.540094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:25:35.540094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:25:35.540094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:25:35.540094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:25:35.540094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:25:35.540094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 09:25:35.540094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:35.540094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 249/499] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:35.540647 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aefb22-c1ea-42c6-937a-ba56ec8dc22a None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:35.540731 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b41c6-b6e6-40bb-8e9b-ef8b89aba85f None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:35.558130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-c9aefb22-c1ea-42c6-937a-ba56ec8dc22a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:25:35.558130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:35.558130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:35.558130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:35.558130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:35.558130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:35.558130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:35.558130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:35.558130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:35.558130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:35.558130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:35.558130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:35.558130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:25:35.558130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:25:35.558130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:25:35.558130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:25:35.559034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:35.559034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:35.559034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:25:35.559034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:35.559034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:25:35.559034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:35.559034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:35.559034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:35.559034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:35.559034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:35.559034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:35.559034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:35.559034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:35.559034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:35.559034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:35.559034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:35.559034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:35.559034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:35.560149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:35.560149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:35.560149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:25:35.560149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:25:35.560149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:25:35.560149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:25:35.560149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:25:35.560149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:25:35.560149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:25:35.560149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:35.560149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 251/500] 10.222.0.41 () {56 vars in 1093 bytes} [Fri May 27 09:25:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:35.560149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aefb22-c1ea-42c6-937a-ba56ec8dc22a None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:35.642263 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b41c6-b6e6-40bb-8e9b-ef8b89aba85f None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:35.656981 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aefb22-c1ea-42c6-937a-ba56ec8dc22a None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:35.674469 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58236163-fe01-4b38-aeef-6fa5668d28e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:35.675866 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58236163-fe01-4b38-aeef-6fa5668d28e1 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:35.676155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58236163-fe01-4b38-aeef-6fa5668d28e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:35.676435 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58236163-fe01-4b38-aeef-6fa5668d28e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:35.686795 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58236163-fe01-4b38-aeef-6fa5668d28e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:35.688311 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58236163-fe01-4b38-aeef-6fa5668d28e1 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:35.692483 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e798a-eaa0-4086-af39-6a1719584b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:35.693257 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e798a-eaa0-4086-af39-6a1719584b2f None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:35.693540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e798a-eaa0-4086-af39-6a1719584b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:35.693814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e798a-eaa0-4086-af39-6a1719584b2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:35.703598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e798a-eaa0-4086-af39-6a1719584b2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:35.704902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-58236163-fe01-4b38-aeef-6fa5668d28e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:35.704902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:35.704902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:35.704902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:35.704902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:35.704902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:35.704902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:35.704902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:35.704902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:35.704902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:35.704902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:35.704902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:35.704902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:35.704902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:35.704902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:35.705826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:35.705826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:35.705826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:35.705826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:35.705826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:35.705826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:35.705826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:35.705826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:35.705826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:35.705826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:35.705826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:35.705826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:35.705826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:35.705826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:35.705826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:35.705826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:35.705826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:35.707206 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:35.707206 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:35.707206 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:35.707206 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:35.707447 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e798a-eaa0-4086-af39-6a1719584b2f None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:35.711211 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 250/501] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:35.712435 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f283a06-37b3-4e3c-87da-6b3c431b154c None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:35.712729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f283a06-37b3-4e3c-87da-6b3c431b154c None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:35.713010 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f283a06-37b3-4e3c-87da-6b3c431b154c None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:35.714275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 251/502] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:35.714965 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f283a06-37b3-4e3c-87da-6b3c431b154c None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:35.724412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-029e798a-eaa0-4086-af39-6a1719584b2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:35.724412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:35.724412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:35.724412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:35.724412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:35.724412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:35.724412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:35.724412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:35.724412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:35.724412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:35.724412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:35.724412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:35.724412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:35.724412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:35.724412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:35.725391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:35.725391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:35.725391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:35.725391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:35.725391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:35.725391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:35.725391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:35.725391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:35.725391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:35.725391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:35.725391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:35.725391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:35.725391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:35.725391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:35.725391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:35.725391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:35.725391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:35.731026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:35.731026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:35.731026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:35.731026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:35.731026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 252/503] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:35.731026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e798a-eaa0-4086-af39-6a1719584b2f None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:35.737972 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:35.770301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:35.824335 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f283a06-37b3-4e3c-87da-6b3c431b154c None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:35.828438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e798a-eaa0-4086-af39-6a1719584b2f None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:35.858250 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75692856-692b-4f4a-99ad-0ad28f1163b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:35.858912 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75692856-692b-4f4a-99ad-0ad28f1163b3 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:35.859198 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75692856-692b-4f4a-99ad-0ad28f1163b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:35.859505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75692856-692b-4f4a-99ad-0ad28f1163b3 None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:35.860591 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75692856-692b-4f4a-99ad-0ad28f1163b3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:35.860903 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75692856-692b-4f4a-99ad-0ad28f1163b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:35.862350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75692856-692b-4f4a-99ad-0ad28f1163b3 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:35.862545 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da43ee-f034-4a91-96ec-17d6efa7ab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:35.863238 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da43ee-f034-4a91-96ec-17d6efa7ab69 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:35.863620 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da43ee-f034-4a91-96ec-17d6efa7ab69 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:35.863901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da43ee-f034-4a91-96ec-17d6efa7ab69 None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:35.864724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da43ee-f034-4a91-96ec-17d6efa7ab69 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:35.865037 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da43ee-f034-4a91-96ec-17d6efa7ab69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:35.866443 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da43ee-f034-4a91-96ec-17d6efa7ab69 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:35.898428 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 252/504] 10.222.0.41 () {56 vars in 1137 bytes} [Fri May 27 09:25:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:35.899255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75692856-692b-4f4a-99ad-0ad28f1163b3 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:35.906717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 253/505] 10.222.0.41 () {56 vars in 1133 bytes} [Fri May 27 09:25:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:35.908423 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaf51f-af9e-4064-a1e9-cc9bc015c4e2 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:35.908716 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaf51f-af9e-4064-a1e9-cc9bc015c4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:35.908995 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaf51f-af9e-4064-a1e9-cc9bc015c4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:35.926105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-eeaaf51f-af9e-4064-a1e9-cc9bc015c4e2 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:35.927324 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-eeaaf51f-af9e-4064-a1e9-cc9bc015c4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:35.985321 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:35.993042 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 254/506] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:35.993830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaf51f-af9e-4064-a1e9-cc9bc015c4e2 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:35.996596 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75692856-692b-4f4a-99ad-0ad28f1163b3 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:35.998917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:36.031893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30c57f-93ba-4f30-a8e2-11ed26ec922a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:36.032565 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30c57f-93ba-4f30-a8e2-11ed26ec922a None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:36.032851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30c57f-93ba-4f30-a8e2-11ed26ec922a None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:36.033131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30c57f-93ba-4f30-a8e2-11ed26ec922a None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:36.033860 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30c57f-93ba-4f30-a8e2-11ed26ec922a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:36.034172 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30c57f-93ba-4f30-a8e2-11ed26ec922a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:36.036178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30c57f-93ba-4f30-a8e2-11ed26ec922a None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:36.047662 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 253/507] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:36.048506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30c57f-93ba-4f30-a8e2-11ed26ec922a None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:36.113623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaf51f-af9e-4064-a1e9-cc9bc015c4e2 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:36.146468 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c9921-c38d-450f-a41d-f3385264bce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:36.146968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30c57f-93ba-4f30-a8e2-11ed26ec922a None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:36.147119 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c9921-c38d-450f-a41d-f3385264bce9 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:36.147438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c9921-c38d-450f-a41d-f3385264bce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:36.147712 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c9921-c38d-450f-a41d-f3385264bce9 None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:36.148421 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c9921-c38d-450f-a41d-f3385264bce9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:36.148722 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c9921-c38d-450f-a41d-f3385264bce9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:36.150088 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c9921-c38d-450f-a41d-f3385264bce9 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:36.161262 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 255/508] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:36.162046 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c9921-c38d-450f-a41d-f3385264bce9 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:36.179446 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abd44f-f203-48f4-8890-cea6f988bc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:36.180100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abd44f-f203-48f4-8890-cea6f988bc24 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:36.180387 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abd44f-f203-48f4-8890-cea6f988bc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:36.180667 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abd44f-f203-48f4-8890-cea6f988bc24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:36.212197 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:36.219801 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:36.248902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abd44f-f203-48f4-8890-cea6f988bc24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:36.250399 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abd44f-f203-48f4-8890-cea6f988bc24 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:36.267795 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c9921-c38d-450f-a41d-f3385264bce9 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:36.302736 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a57487-00b6-4fe4-a0a6-2df61d24e429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:36.303447 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a57487-00b6-4fe4-a0a6-2df61d24e429 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:36.303736 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a57487-00b6-4fe4-a0a6-2df61d24e429 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:36.304015 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a57487-00b6-4fe4-a0a6-2df61d24e429 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:36.351893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 254/509] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:25:36.352729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abd44f-f203-48f4-8890-cea6f988bc24 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:36.371683 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a57487-00b6-4fe4-a0a6-2df61d24e429 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:36.373096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a57487-00b6-4fe4-a0a6-2df61d24e429 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:36.414030 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:36.425271 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:36.450735 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abd44f-f203-48f4-8890-cea6f988bc24 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:36.470850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 256/510] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:25:36.471703 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a57487-00b6-4fe4-a0a6-2df61d24e429 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:36.488772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cb8e5-b464-42d1-b76c-763c5ee6852d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:36.489566 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cb8e5-b464-42d1-b76c-763c5ee6852d None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:36.489851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cb8e5-b464-42d1-b76c-763c5ee6852d None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:36.490131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cb8e5-b464-42d1-b76c-763c5ee6852d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:36.500058 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353cb8e5-b464-42d1-b76c-763c5ee6852d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:36.507838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-353cb8e5-b464-42d1-b76c-763c5ee6852d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:36.507838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:36.507838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:36.507838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:36.507838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:36.507838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:36.507838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:36.507838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:36.507838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:36.507838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:36.507838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:36.507838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:36.507838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:36.507838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:36.507838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:36.507838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:36.508824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:36.508824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:36.508824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:36.508824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:36.508824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:36.508824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:36.508824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:36.508824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:36.508824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:36.508824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:36.508824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:36.508824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:36.508824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:36.508824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:36.508824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:36.508824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:36.509599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:36.509599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:36.509599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:36.509599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:36.509599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:36.509599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:36.509599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:36.509599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:36.509599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:36.509599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:36.509599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:36.509599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:36.509599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 255/511] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 09:25:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:36.510231 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cb8e5-b464-42d1-b76c-763c5ee6852d None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:36.570767 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a57487-00b6-4fe4-a0a6-2df61d24e429 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:36.606207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4faea3-2307-4e5d-8696-f71bc47faa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:36.606996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4faea3-2307-4e5d-8696-f71bc47faa0e None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:36.607295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4faea3-2307-4e5d-8696-f71bc47faa0e None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:36.607573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4faea3-2307-4e5d-8696-f71bc47faa0e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:36.608744 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cb8e5-b464-42d1-b76c-763c5ee6852d None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:36.614728 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4faea3-2307-4e5d-8696-f71bc47faa0e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:36.616184 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4faea3-2307-4e5d-8696-f71bc47faa0e None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:36.631342 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:36.631521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-6f4faea3-2307-4e5d-8696-f71bc47faa0e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 09:25:36.631521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:36.631521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:36.631521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:36.631521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:36.631521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:36.631521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:36.631521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:36.631521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:36.631521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:36.631521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:36.631521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:36.631521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:25:36.631521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:25:36.631521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:25:36.631521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:25:36.632442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:36.632442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:36.632442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:25:36.632442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:36.632442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:25:36.632442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:36.632442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:36.632442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:36.632442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:36.632442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:36.632442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:36.632442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:36.632442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:36.632442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:36.632442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:36.632442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:36.632442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:36.632442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:36.633297 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:36.633297 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:36.633297 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:25:36.633297 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:25:36.633297 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:25:36.633297 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:25:36.633297 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:25:36.633297 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:25:36.633297 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 09:25:36.633297 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:36.633297 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 257/512] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:36.633982 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4faea3-2307-4e5d-8696-f71bc47faa0e None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:36.648016 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfb276-95ea-48a3-af22-915e4ef1ec24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:36.648691 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfb276-95ea-48a3-af22-915e4ef1ec24 None admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:36.648977 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfb276-95ea-48a3-af22-915e4ef1ec24 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:36.649096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:36.649253 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfb276-95ea-48a3-af22-915e4ef1ec24 None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:36.649958 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfb276-95ea-48a3-af22-915e4ef1ec24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:36.651427 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfb276-95ea-48a3-af22-915e4ef1ec24 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:36.672480 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 256/513] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 09:25:36 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:25:36.673274 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfb276-95ea-48a3-af22-915e4ef1ec24 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:36.742837 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4faea3-2307-4e5d-8696-f71bc47faa0e None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:36.779618 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030651e-3c6a-4187-8ca4-8ff36e85692d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:36.780430 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030651e-3c6a-4187-8ca4-8ff36e85692d None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:36.780720 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030651e-3c6a-4187-8ca4-8ff36e85692d None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:36.781008 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030651e-3c6a-4187-8ca4-8ff36e85692d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:36.792794 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030651e-3c6a-4187-8ca4-8ff36e85692d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:36.794281 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030651e-3c6a-4187-8ca4-8ff36e85692d None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:36.800257 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfb276-95ea-48a3-af22-915e4ef1ec24 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:36.813529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-2030651e-3c6a-4187-8ca4-8ff36e85692d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:36.813529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:36.813529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:36.813529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:36.813529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:36.813529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:36.813529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:36.813529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:36.813529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:36.813529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:36.813529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:36.813529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:36.813529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:36.813529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:36.813529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:36.814449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:36.814449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:36.814449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:36.814449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:36.814449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:36.814449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:36.814449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:36.814449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:36.814449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:36.814449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:36.814449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:36.814449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:36.814449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:36.814449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:36.814449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:36.814449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:36.814449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:36.816571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:36.816571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:36.816571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:36.816571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:36.816571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 258/514] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:36.816571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030651e-3c6a-4187-8ca4-8ff36e85692d None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:36.844709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e678b-9d74-4773-9961-afeb022f4ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:36.845492 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e678b-9d74-4773-9961-afeb022f4ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:36.845772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e678b-9d74-4773-9961-afeb022f4ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:36.846051 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e678b-9d74-4773-9961-afeb022f4ee1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:36.862073 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e678b-9d74-4773-9961-afeb022f4ee1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:36.864171 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e678b-9d74-4773-9961-afeb022f4ee1 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:36.887563 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-676e678b-9d74-4773-9961-afeb022f4ee1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:36.887563 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:36.887563 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:36.887563 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:36.887563 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:36.887563 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:36.887563 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:36.887563 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:36.887563 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:36.887563 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:36.887563 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:36.887563 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:36.887563 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:36.887563 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:36.887563 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:36.888430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:36.888430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:36.888430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:36.888430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:36.888430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:36.888430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:36.888430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:36.888430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:36.888430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:36.888430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:36.888430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:36.888430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:36.888430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:36.888430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:36.888430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:36.888430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:36.888430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:36.889267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:36.889267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:36.889267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:36.889267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:36.889267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 257/515] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:36.889820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e678b-9d74-4773-9961-afeb022f4ee1 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:36.901742 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:36.930896 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:36.942501 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030651e-3c6a-4187-8ca4-8ff36e85692d None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:36.979355 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ef900-6cbb-40f0-bd97-385152270602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:36.980026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ef900-6cbb-40f0-bd97-385152270602 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:36.980418 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ef900-6cbb-40f0-bd97-385152270602 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:36.980694 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ef900-6cbb-40f0-bd97-385152270602 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:36.981428 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ef900-6cbb-40f0-bd97-385152270602 None admin] RBAC: Adding query filter params (name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:36.981842 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ef900-6cbb-40f0-bd97-385152270602 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:36.983376 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ef900-6cbb-40f0-bd97-385152270602 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:36.996857 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 259/516] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 09:25:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:36.996857 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ef900-6cbb-40f0-bd97-385152270602 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:37.011663 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e678b-9d74-4773-9961-afeb022f4ee1 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:37.047656 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcf795-c729-408e-b1d0-7592b38a6a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:37.048420 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcf795-c729-408e-b1d0-7592b38a6a51 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:37.048792 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcf795-c729-408e-b1d0-7592b38a6a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:37.049135 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcf795-c729-408e-b1d0-7592b38a6a51 None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:37.050043 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fcf795-c729-408e-b1d0-7592b38a6a51 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:37.050669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fcf795-c729-408e-b1d0-7592b38a6a51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:37.051964 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fcf795-c729-408e-b1d0-7592b38a6a51 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:37.073038 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 258/517] 10.222.0.41 () {56 vars in 1137 bytes} [Fri May 27 09:25:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:37.073878 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcf795-c729-408e-b1d0-7592b38a6a51 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:37.115225 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ef900-6cbb-40f0-bd97-385152270602 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:37.142439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:37.150908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355cc84-ba1a-4731-a499-d79f4430c7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:37.151601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355cc84-ba1a-4731-a499-d79f4430c7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:37.151883 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355cc84-ba1a-4731-a499-d79f4430c7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:37.152158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355cc84-ba1a-4731-a499-d79f4430c7d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:37.152876 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3355cc84-ba1a-4731-a499-d79f4430c7d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:37.153185 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3355cc84-ba1a-4731-a499-d79f4430c7d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:37.154558 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3355cc84-ba1a-4731-a499-d79f4430c7d3 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:37.170708 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 260/518] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:37.170708 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355cc84-ba1a-4731-a499-d79f4430c7d3 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:37.179366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:37.190338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcf795-c729-408e-b1d0-7592b38a6a51 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:37.237262 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea05a28-6d5d-422c-b331-62ed8319ef3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:37.238464 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea05a28-6d5d-422c-b331-62ed8319ef3b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:37.238735 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea05a28-6d5d-422c-b331-62ed8319ef3b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:37.239016 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea05a28-6d5d-422c-b331-62ed8319ef3b None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:37.239785 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea05a28-6d5d-422c-b331-62ed8319ef3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:37.240098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea05a28-6d5d-422c-b331-62ed8319ef3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:37.241543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea05a28-6d5d-422c-b331-62ed8319ef3b None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:37.258521 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 259/519] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:37.258521 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea05a28-6d5d-422c-b331-62ed8319ef3b None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:37.301105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355cc84-ba1a-4731-a499-d79f4430c7d3 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:37.334761 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921013e-b972-4ea2-afaf-7b9ab68982ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:37.335649 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921013e-b972-4ea2-afaf-7b9ab68982ee None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:37.335935 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921013e-b972-4ea2-afaf-7b9ab68982ee None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:37.336209 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921013e-b972-4ea2-afaf-7b9ab68982ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:37.346184 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921013e-b972-4ea2-afaf-7b9ab68982ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:37.347687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921013e-b972-4ea2-afaf-7b9ab68982ee None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:37.365930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-e921013e-b972-4ea2-afaf-7b9ab68982ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:37.365930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:37.365930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:37.365930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:37.365930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:37.365930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:37.365930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:37.365930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:37.365930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:37.365930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:37.365930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:37.365930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:37.365930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:37.365930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:37.365930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:37.366967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:37.366967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:37.366967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:37.366967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:37.366967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:37.366967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:37.366967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:37.366967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:37.366967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:37.366967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:37.366967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:37.366967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:37.366967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:37.366967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:37.366967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:37.366967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:37.366967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:37.368039 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:37.368039 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:37.368039 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:37.368039 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:37.368247 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea05a28-6d5d-422c-b331-62ed8319ef3b None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:37.371670 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 261/520] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:37.372509 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921013e-b972-4ea2-afaf-7b9ab68982ee None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:37.403725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23610cfe-69a1-4150-9b49-095a7c41cbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:37.404291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23610cfe-69a1-4150-9b49-095a7c41cbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:37.404580 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23610cfe-69a1-4150-9b49-095a7c41cbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:37.405118 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23610cfe-69a1-4150-9b49-095a7c41cbe0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:37.416292 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:37.426954 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:37.478567 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23610cfe-69a1-4150-9b49-095a7c41cbe0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:37.480086 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23610cfe-69a1-4150-9b49-095a7c41cbe0 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:37.480818 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921013e-b972-4ea2-afaf-7b9ab68982ee None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:37.517467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd506eda-77d9-43e9-b20e-a8c971ba2f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:37.518815 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd506eda-77d9-43e9-b20e-a8c971ba2f06 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:37.518815 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd506eda-77d9-43e9-b20e-a8c971ba2f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:37.518815 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd506eda-77d9-43e9-b20e-a8c971ba2f06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:37.525811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd506eda-77d9-43e9-b20e-a8c971ba2f06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:37.527451 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd506eda-77d9-43e9-b20e-a8c971ba2f06 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:37.545965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-fd506eda-77d9-43e9-b20e-a8c971ba2f06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:37.545965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:37.545965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:37.545965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:37.545965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:37.545965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:37.545965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:37.545965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:37.545965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:37.545965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:37.545965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:37.545965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:37.545965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:25:37.545965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:25:37.545965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:25:37.546867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:25:37.546867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:37.546867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:37.546867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:37.546867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:37.546867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:37.546867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:37.546867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:37.546867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:37.546867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:37.546867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:37.546867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:37.546867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:37.546867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:37.546867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:37.546867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:37.546867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:37.547749 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:25:37.547749 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:25:37.547749 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:25:37.547749 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:25:37.547749 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:25:37.547749 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:25:37.547749 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:37.547749 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:37.547749 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 262/521] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:37.548342 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd506eda-77d9-43e9-b20e-a8c971ba2f06 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:37.598332 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 260/522] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:25:37.599540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23610cfe-69a1-4150-9b49-095a7c41cbe0 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:37.652070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:37.656674 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:37.661258 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd506eda-77d9-43e9-b20e-a8c971ba2f06 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:37.695206 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20ac62-fcf2-4edf-a347-20aa12ea964e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:37.696208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20ac62-fcf2-4edf-a347-20aa12ea964e None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:37.696342 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20ac62-fcf2-4edf-a347-20aa12ea964e None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:37.696552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20ac62-fcf2-4edf-a347-20aa12ea964e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:37.703247 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20ac62-fcf2-4edf-a347-20aa12ea964e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:37.704720 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20ac62-fcf2-4edf-a347-20aa12ea964e None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:37.708539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23610cfe-69a1-4150-9b49-095a7c41cbe0 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:37.718948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-1f20ac62-fcf2-4edf-a347-20aa12ea964e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:37.718948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:37.718948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:37.718948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:37.718948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:37.718948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:37.718948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:37.718948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:37.718948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:37.718948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:37.718948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:37.718948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:37.718948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:25:37.718948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:25:37.718948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:25:37.719811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:25:37.719811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:37.719811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:37.719811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:37.719811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:37.719811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:37.719811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:37.719811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:37.719811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:37.719811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:37.719811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:37.719811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:37.719811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:37.719811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:37.719811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:37.719811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:37.719811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:37.720635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:25:37.720635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:25:37.720635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:25:37.720635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:25:37.720635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:25:37.720635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:25:37.720635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:37.720635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:37.720635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 263/523] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:37.721102 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20ac62-fcf2-4edf-a347-20aa12ea964e None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:37.753946 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1d81b-799c-4aed-acbd-3be8771326a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:37.754756 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1d81b-799c-4aed-acbd-3be8771326a0 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:37.755042 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1d81b-799c-4aed-acbd-3be8771326a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:37.755344 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1d81b-799c-4aed-acbd-3be8771326a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:37.756062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1d81b-799c-4aed-acbd-3be8771326a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:37.756359 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1d81b-799c-4aed-acbd-3be8771326a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:37.757730 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1d81b-799c-4aed-acbd-3be8771326a0 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:37.773923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 261/524] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:37.773923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1d81b-799c-4aed-acbd-3be8771326a0 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:37.835345 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20ac62-fcf2-4edf-a347-20aa12ea964e None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:37.872039 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3670a-1fe0-4938-9537-fd7f7dd6ef87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:37.872703 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3670a-1fe0-4938-9537-fd7f7dd6ef87 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:37.872987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3670a-1fe0-4938-9537-fd7f7dd6ef87 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:37.873262 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3670a-1fe0-4938-9537-fd7f7dd6ef87 None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:37.874039 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3670a-1fe0-4938-9537-fd7f7dd6ef87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:37.874349 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3670a-1fe0-4938-9537-fd7f7dd6ef87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:37.875843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3670a-1fe0-4938-9537-fd7f7dd6ef87 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:37.886822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1d81b-799c-4aed-acbd-3be8771326a0 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:37.894284 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 264/525] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:25:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:37.895100 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3670a-1fe0-4938-9537-fd7f7dd6ef87 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:37.903626 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:37.918831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:37.931470 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1ff3a-37aa-4aa2-970a-e0af0366cbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:37.932373 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1ff3a-37aa-4aa2-970a-e0af0366cbd9 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:37.932658 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1ff3a-37aa-4aa2-970a-e0af0366cbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:37.933649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1ff3a-37aa-4aa2-970a-e0af0366cbd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:37.944994 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1ff3a-37aa-4aa2-970a-e0af0366cbd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:37.946455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1ff3a-37aa-4aa2-970a-e0af0366cbd9 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:37.965401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-b2e1ff3a-37aa-4aa2-970a-e0af0366cbd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:37.965401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:37.965401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:37.965401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:37.965401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:37.965401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:37.965401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:37.965401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:37.965401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:37.965401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:37.965401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:37.965401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:37.965401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:37.965401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:37.965401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:37.966265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:37.966265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:37.966265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:37.966265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:37.966265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:37.966265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:37.966265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:37.966265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:37.966265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:37.966265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:37.966265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:37.966265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:37.966265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:37.966265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:37.966265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:37.966265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:37.966265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:37.967171 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:37.967171 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:37.967171 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:37.967171 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:37.967171 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 262/526] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:37.968102 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1ff3a-37aa-4aa2-970a-e0af0366cbd9 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:38.006307 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3670a-1fe0-4938-9537-fd7f7dd6ef87 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:38.044868 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b4c5f-6db0-454a-9310-da182939ff98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:38.045770 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b4c5f-6db0-454a-9310-da182939ff98 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:38.045912 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b4c5f-6db0-454a-9310-da182939ff98 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:38.046072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b4c5f-6db0-454a-9310-da182939ff98 None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:38.046847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b4c5f-6db0-454a-9310-da182939ff98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:38.047155 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b4c5f-6db0-454a-9310-da182939ff98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:38.048619 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b4c5f-6db0-454a-9310-da182939ff98 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:38.062202 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 265/527] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:25:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:38.063027 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b4c5f-6db0-454a-9310-da182939ff98 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:38.082129 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1ff3a-37aa-4aa2-970a-e0af0366cbd9 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:38.117231 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6bbf2-2cf2-44b6-99c9-a829666e3734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:38.118031 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6bbf2-2cf2-44b6-99c9-a829666e3734 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:38.118316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6bbf2-2cf2-44b6-99c9-a829666e3734 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:38.118597 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6bbf2-2cf2-44b6-99c9-a829666e3734 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:38.126372 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6bbf2-2cf2-44b6-99c9-a829666e3734 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:38.127885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6bbf2-2cf2-44b6-99c9-a829666e3734 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:38.142108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-7fb6bbf2-2cf2-44b6-99c9-a829666e3734 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 09:25:38.142108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:38.142108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:38.142108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:38.142108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:38.142108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:38.142108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:38.142108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:38.142108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:38.142108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:38.142108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:38.142108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:38.142108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:25:38.142108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:25:38.142108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:25:38.142108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:25:38.143112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:38.143112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:38.143112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:25:38.143112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:38.143112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:25:38.143112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:38.143112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:38.143112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:38.143112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:38.143112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:38.143112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:38.143112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:38.143112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:38.143112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:38.143112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:38.143112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:38.143112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:38.143112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:38.144769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:38.144769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:38.144769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:25:38.144769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:25:38.144769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:25:38.144769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:25:38.144769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:25:38.144769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:25:38.144769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 09:25:38.144769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:38.148416 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 263/528] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 09:25:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:38.149236 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6bbf2-2cf2-44b6-99c9-a829666e3734 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:38.149581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:38.170984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b4c5f-6db0-454a-9310-da182939ff98 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:38.174243 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:38.206733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971c6a8-c097-4dec-93cd-9439537dece3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:38.207447 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971c6a8-c097-4dec-93cd-9439537dece3 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:38.207733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971c6a8-c097-4dec-93cd-9439537dece3 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:38.208060 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971c6a8-c097-4dec-93cd-9439537dece3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:38.208891 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971c6a8-c097-4dec-93cd-9439537dece3 None admin] RBAC: Adding query filter params (role.id=5cde0d2bc9ca433b8904823fc602ab67, scope.project.id=b1d802dc0211467fa4e709cd01d411dc, user.id=192c3d179fdb43c9885f637446c83a89) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:38.209211 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971c6a8-c097-4dec-93cd-9439537dece3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:38.210635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971c6a8-c097-4dec-93cd-9439537dece3 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:38.223346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 266/529] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:25:38 2022] GET /identity/v3/role_assignments?user.id=192c3d179fdb43c9885f637446c83a89&scope.project.id=b1d802dc0211467fa4e709cd01d411dc&role.id=5cde0d2bc9ca433b8904823fc602ab67 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:38.223346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971c6a8-c097-4dec-93cd-9439537dece3 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:38.270227 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6bbf2-2cf2-44b6-99c9-a829666e3734 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:38.312478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8c440-da07-43ef-a8a6-29518fc5fc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:38.313305 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8c440-da07-43ef-a8a6-29518fc5fc9f None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:38.313656 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8c440-da07-43ef-a8a6-29518fc5fc9f None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:38.314336 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8c440-da07-43ef-a8a6-29518fc5fc9f None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:38.314812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8c440-da07-43ef-a8a6-29518fc5fc9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:38.315202 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8c440-da07-43ef-a8a6-29518fc5fc9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:38.317621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8c440-da07-43ef-a8a6-29518fc5fc9f None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:38.333044 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 264/530] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:38.334292 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8c440-da07-43ef-a8a6-29518fc5fc9f None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:38.362402 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971c6a8-c097-4dec-93cd-9439537dece3 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:38.400862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4269e2-a3ac-4879-a427-7b68af9e4e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:38.401669 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4269e2-a3ac-4879-a427-7b68af9e4e46 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:38.402061 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4269e2-a3ac-4879-a427-7b68af9e4e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:38.402403 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4269e2-a3ac-4879-a427-7b68af9e4e46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:38.403367 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4269e2-a3ac-4879-a427-7b68af9e4e46 None admin] RBAC: Adding query filter params (role.id=5cde0d2bc9ca433b8904823fc602ab67, scope.project.id=b1d802dc0211467fa4e709cd01d411dc, user.id=d2b1c12e88c549208894fc0dd0c60b88) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:38.403753 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4269e2-a3ac-4879-a427-7b68af9e4e46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:38.405295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4269e2-a3ac-4879-a427-7b68af9e4e46 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:38.419264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 267/531] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:25:38 2022] GET /identity/v3/role_assignments?user.id=d2b1c12e88c549208894fc0dd0c60b88&scope.project.id=b1d802dc0211467fa4e709cd01d411dc&role.id=5cde0d2bc9ca433b8904823fc602ab67 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:38.420445 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4269e2-a3ac-4879-a427-7b68af9e4e46 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:38.442610 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:38.445242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:38.473044 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8c440-da07-43ef-a8a6-29518fc5fc9f None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:38.521194 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0356276-c0a4-4cc6-bbe0-6e452af9b365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:38.521910 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0356276-c0a4-4cc6-bbe0-6e452af9b365 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:38.522201 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0356276-c0a4-4cc6-bbe0-6e452af9b365 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:38.522485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0356276-c0a4-4cc6-bbe0-6e452af9b365 None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:38.523732 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0356276-c0a4-4cc6-bbe0-6e452af9b365 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:38.524059 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0356276-c0a4-4cc6-bbe0-6e452af9b365 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:38.525539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0356276-c0a4-4cc6-bbe0-6e452af9b365 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:38.551936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 265/532] 10.222.0.41 () {56 vars in 1139 bytes} [Fri May 27 09:25:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:38.553479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0356276-c0a4-4cc6-bbe0-6e452af9b365 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:38.593018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4269e2-a3ac-4879-a427-7b68af9e4e46 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:38.674578 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0356276-c0a4-4cc6-bbe0-6e452af9b365 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:38.682738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e6b2a-554b-4b0b-ab69-ac1e2e2bb259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:38.683625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e6b2a-554b-4b0b-ab69-ac1e2e2bb259 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:38.683909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e6b2a-554b-4b0b-ab69-ac1e2e2bb259 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:38.684184 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e6b2a-554b-4b0b-ab69-ac1e2e2bb259 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:38.701237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e6b2a-554b-4b0b-ab69-ac1e2e2bb259 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:38.702652 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e6b2a-554b-4b0b-ab69-ac1e2e2bb259 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:38.714134 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34962c6-a8d1-4335-bbc4-2356e2aecb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:38.714799 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34962c6-a8d1-4335-bbc4-2356e2aecb46 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:38.715085 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34962c6-a8d1-4335-bbc4-2356e2aecb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:38.715395 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34962c6-a8d1-4335-bbc4-2356e2aecb46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:38.718470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-bc8e6b2a-554b-4b0b-ab69-ac1e2e2bb259 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:38.718470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:38.718470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:38.718470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:38.718470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:38.718470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:38.718470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:38.718470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:38.718470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:38.718470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:38.718470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:38.718470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:38.718470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:25:38.718470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:25:38.718470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:25:38.720384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:25:38.720384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:38.720384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:38.720384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:38.720384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:38.720384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:38.720384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:38.720384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:38.720384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:38.720384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:38.720384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:38.720384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:38.720384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:38.720384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:38.720384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:38.720384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:38.720384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:38.722455 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:25:38.722455 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:25:38.722455 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:25:38.722455 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:25:38.722455 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:25:38.722455 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:25:38.722455 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:38.722455 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:38.728385 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 268/533] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:38.728385 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e6b2a-554b-4b0b-ab69-ac1e2e2bb259 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:38.728777 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:38.807004 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34962c6-a8d1-4335-bbc4-2356e2aecb46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:38.808503 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34962c6-a8d1-4335-bbc4-2356e2aecb46 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:38.888042 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:38.932165 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 266/534] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 09:25:38.940367 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34962c6-a8d1-4335-bbc4-2356e2aecb46 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:38.941540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e6b2a-554b-4b0b-ab69-ac1e2e2bb259 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:38.981857 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3591b-94a1-48f3-9c94-706b5e90d00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:38.982673 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:38.983843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3591b-94a1-48f3-9c94-706b5e90d00e None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:38.984345 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3591b-94a1-48f3-9c94-706b5e90d00e None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:38.985067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3591b-94a1-48f3-9c94-706b5e90d00e None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:38.986065 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3591b-94a1-48f3-9c94-706b5e90d00e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:38.986573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3591b-94a1-48f3-9c94-706b5e90d00e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:38.988802 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3591b-94a1-48f3-9c94-706b5e90d00e None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:39.006815 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 269/535] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:25:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:39.008480 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f46a5-d0eb-460a-bf6f-9fe404277bca None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:39.008991 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f46a5-d0eb-460a-bf6f-9fe404277bca None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:39.009466 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f46a5-d0eb-460a-bf6f-9fe404277bca None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:39.010898 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 270/536] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:39.016066 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f46a5-d0eb-460a-bf6f-9fe404277bca None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:39.057750 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34962c6-a8d1-4335-bbc4-2356e2aecb46 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:39.102264 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4b2dc-5bff-42eb-98e3-cd48ffd4174e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:39.103060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4b2dc-5bff-42eb-98e3-cd48ffd4174e None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:39.103375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4b2dc-5bff-42eb-98e3-cd48ffd4174e None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:39.103656 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4b2dc-5bff-42eb-98e3-cd48ffd4174e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:39.118283 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4b2dc-5bff-42eb-98e3-cd48ffd4174e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:39.119813 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4b2dc-5bff-42eb-98e3-cd48ffd4174e None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:39.138525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-3be4b2dc-5bff-42eb-98e3-cd48ffd4174e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:39.138525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:39.138525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:39.138525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:39.138525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:39.138525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:39.138525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:39.138525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:39.138525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:39.138525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:39.138525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:39.138525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:39.138525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:39.138525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:39.138525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:39.139696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:39.139696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:39.139696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:39.139696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:39.139696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:39.139696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:39.139696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:39.139696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:39.139696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:39.139696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:39.139696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:39.139696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:39.139696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:39.139696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:39.139696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:39.139696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:39.139696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:39.140716 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:39.140716 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:39.140716 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:39.140716 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:39.140716 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 267/537] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:39.141456 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f605b2-35f4-4625-8bed-95c017e31969 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:39.141991 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f605b2-35f4-4625-8bed-95c017e31969 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:39.141991 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f605b2-35f4-4625-8bed-95c017e31969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:39.152403 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f46a5-d0eb-460a-bf6f-9fe404277bca None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:39.159080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-81f605b2-35f4-4625-8bed-95c017e31969 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:39.160862 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-81f605b2-35f4-4625-8bed-95c017e31969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:39.183923 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:39.194709 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00d662-6760-4edd-a1e9-ea65cea0f74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:39.199575 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00d662-6760-4edd-a1e9-ea65cea0f74c None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:39.200096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00d662-6760-4edd-a1e9-ea65cea0f74c None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:39.200579 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00d662-6760-4edd-a1e9-ea65cea0f74c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:39.201595 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00d662-6760-4edd-a1e9-ea65cea0f74c None admin] RBAC: Adding query filter params (role.id=5cde0d2bc9ca433b8904823fc602ab67, scope.project.id=b1d802dc0211467fa4e709cd01d411dc, user.id=38e04575437341df8127860a5e5abc50) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:39.202085 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00d662-6760-4edd-a1e9-ea65cea0f74c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:39.206019 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00d662-6760-4edd-a1e9-ea65cea0f74c None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:39.215479 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 271/538] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:25:39 2022] GET /identity/v3/role_assignments?user.id=38e04575437341df8127860a5e5abc50&scope.project.id=b1d802dc0211467fa4e709cd01d411dc&role.id=5cde0d2bc9ca433b8904823fc602ab67 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:39.216605 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00d662-6760-4edd-a1e9-ea65cea0f74c None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:39.260086 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 268/539] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:39.299003 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f605b2-35f4-4625-8bed-95c017e31969 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:39.344732 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:39.418362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00d662-6760-4edd-a1e9-ea65cea0f74c None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:39.468651 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e940e-5512-41e9-9be9-879f332f6e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:39.469607 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e940e-5512-41e9-9be9-879f332f6e0c None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:39.469899 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e940e-5512-41e9-9be9-879f332f6e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:39.470179 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e940e-5512-41e9-9be9-879f332f6e0c None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:39.470918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e940e-5512-41e9-9be9-879f332f6e0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:39.471229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e940e-5512-41e9-9be9-879f332f6e0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:39.472955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f605b2-35f4-4625-8bed-95c017e31969 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:39.473249 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e940e-5512-41e9-9be9-879f332f6e0c None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:39.494562 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 272/540] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:39.501088 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e940e-5512-41e9-9be9-879f332f6e0c None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:39.540538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732228d-0fb1-485d-977c-dec01ed7aa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:39.541773 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732228d-0fb1-485d-977c-dec01ed7aa5b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:39.542255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732228d-0fb1-485d-977c-dec01ed7aa5b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:39.542751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732228d-0fb1-485d-977c-dec01ed7aa5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:39.560855 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732228d-0fb1-485d-977c-dec01ed7aa5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:39.574155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-f732228d-0fb1-485d-977c-dec01ed7aa5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:39.574155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:39.574155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:39.574155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:39.574155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:39.574155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:39.574155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:39.574155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:39.574155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:39.574155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:39.574155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:39.574155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:39.574155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:39.574155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:39.574155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:39.574155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:39.575095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:39.575095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:39.575095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:39.575095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:39.575095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:39.575095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:39.575095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:39.575095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:39.575095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:39.575095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:39.575095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:39.575095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:39.575095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:39.575095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:39.575095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:39.575095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:39.576428 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:39.576428 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:39.576428 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:39.576428 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:39.576428 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:39.576428 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:39.576428 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:39.576428 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:39.576428 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:39.576428 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:39.576428 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:39.576428 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:39.581015 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 269/541] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 09:25:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:25:39.589276 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732228d-0fb1-485d-977c-dec01ed7aa5b None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:39.615297 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:39.687933 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e940e-5512-41e9-9be9-879f332f6e0c None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:39.745811 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:39.765460 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732228d-0fb1-485d-977c-dec01ed7aa5b None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:39.777345 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25fc59-3db1-44d8-a8f6-94ef893c1c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:39.778152 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25fc59-3db1-44d8-a8f6-94ef893c1c61 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:39.778437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25fc59-3db1-44d8-a8f6-94ef893c1c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:39.778713 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25fc59-3db1-44d8-a8f6-94ef893c1c61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:39.800060 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25fc59-3db1-44d8-a8f6-94ef893c1c61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:39.801560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25fc59-3db1-44d8-a8f6-94ef893c1c61 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:39.802497 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502e88b-3423-4477-94e9-6e4d759725fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:39.803299 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502e88b-3423-4477-94e9-6e4d759725fe None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:39.803702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502e88b-3423-4477-94e9-6e4d759725fe None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:39.804099 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502e88b-3423-4477-94e9-6e4d759725fe None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:39.804945 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502e88b-3423-4477-94e9-6e4d759725fe None admin] RBAC: Adding query filter params (name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:39.805358 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502e88b-3423-4477-94e9-6e4d759725fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:39.806844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502e88b-3423-4477-94e9-6e4d759725fe None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:39.816402 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 270/542] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 09:25:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:39.827921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502e88b-3423-4477-94e9-6e4d759725fe None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:39.837243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-fe25fc59-3db1-44d8-a8f6-94ef893c1c61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:39.837243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:39.837243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:39.837243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:39.837243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:39.837243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:39.837243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:39.837243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:39.837243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:39.837243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:39.837243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:39.837243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:39.837243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:25:39.837243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:25:39.837243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:25:39.838332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:25:39.838332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:39.838332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:39.838332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:39.838332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:39.838332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:39.838332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:39.838332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:39.838332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:39.838332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:39.838332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:39.838332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:39.838332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:39.838332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:39.838332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:39.838332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:39.838332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:39.839146 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:25:39.839146 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:25:39.839146 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:25:39.839146 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:25:39.839146 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:25:39.839146 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:25:39.839146 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:39.839146 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:39.842044 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 273/543] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:39.847739 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25fc59-3db1-44d8-a8f6-94ef893c1c61 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:39.958196 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502e88b-3423-4477-94e9-6e4d759725fe None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:39.995376 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17411fdb-a176-4f5f-bbe9-36f8c765bd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:39.995376 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17411fdb-a176-4f5f-bbe9-36f8c765bd9b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:39.995376 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17411fdb-a176-4f5f-bbe9-36f8c765bd9b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:39.995376 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17411fdb-a176-4f5f-bbe9-36f8c765bd9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:40.007119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17411fdb-a176-4f5f-bbe9-36f8c765bd9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:40.008625 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17411fdb-a176-4f5f-bbe9-36f8c765bd9b None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:40.011391 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:40.028142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-17411fdb-a176-4f5f-bbe9-36f8c765bd9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:40.028142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:40.028142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:40.028142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:40.028142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:40.028142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:40.028142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:40.028142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:40.028142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:40.028142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:40.028142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:40.028142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:40.028142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:40.028142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:40.028142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:40.029022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:40.029022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:40.029022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:40.029022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:40.029022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:40.029022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:40.029022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:40.029022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:40.029022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:40.029022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:40.029022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:40.029022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:40.029022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:40.029022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:40.029022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:40.029022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:40.029022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:40.029839 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:40.029839 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:40.029839 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:40.029839 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:40.029839 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 271/544] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:40.035049 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17411fdb-a176-4f5f-bbe9-36f8c765bd9b None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:40.053329 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25fc59-3db1-44d8-a8f6-94ef893c1c61 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:40.089342 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:40.143428 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17411fdb-a176-4f5f-bbe9-36f8c765bd9b None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:40.156526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8eeb26-53e2-4190-877b-5b49c69fc63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:40.157208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8eeb26-53e2-4190-877b-5b49c69fc63d None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:40.157492 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8eeb26-53e2-4190-877b-5b49c69fc63d None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:40.157769 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8eeb26-53e2-4190-877b-5b49c69fc63d None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:40.158560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8eeb26-53e2-4190-877b-5b49c69fc63d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:40.158876 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8eeb26-53e2-4190-877b-5b49c69fc63d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:40.160376 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8eeb26-53e2-4190-877b-5b49c69fc63d None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:40.180101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecdad0-6f7c-436c-9ebe-e11d23b5a5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:40.180821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecdad0-6f7c-436c-9ebe-e11d23b5a5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:40.181115 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecdad0-6f7c-436c-9ebe-e11d23b5a5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:40.181403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecdad0-6f7c-436c-9ebe-e11d23b5a5e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:40.182129 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecdad0-6f7c-436c-9ebe-e11d23b5a5e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:40.182442 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecdad0-6f7c-436c-9ebe-e11d23b5a5e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:40.183874 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecdad0-6f7c-436c-9ebe-e11d23b5a5e4 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:40.189774 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 274/545] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:25:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:40.196003 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8eeb26-53e2-4190-877b-5b49c69fc63d None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:40.198205 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 272/546] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:40.203408 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecdad0-6f7c-436c-9ebe-e11d23b5a5e4 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:40.263459 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:40.311248 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecdad0-6f7c-436c-9ebe-e11d23b5a5e4 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:40.348007 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59663a6-d6dc-431b-abb8-b828172f024d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:40.348813 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59663a6-d6dc-431b-abb8-b828172f024d None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:40.349103 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59663a6-d6dc-431b-abb8-b828172f024d None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:40.349384 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59663a6-d6dc-431b-abb8-b828172f024d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:40.357271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59663a6-d6dc-431b-abb8-b828172f024d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:40.359247 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59663a6-d6dc-431b-abb8-b828172f024d None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:40.376761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-a59663a6-d6dc-431b-abb8-b828172f024d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 09:25:40.376761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:40.376761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:40.376761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:40.376761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:40.376761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:40.376761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:40.376761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:40.376761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:40.376761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:40.376761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:40.376761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:40.376761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:25:40.376761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:25:40.376761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:25:40.376761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:25:40.377668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:40.377668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:40.377668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:25:40.377668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:40.377668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:25:40.377668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:40.377668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:40.377668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:40.377668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:40.377668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:40.377668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:40.377668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:40.377668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:40.377668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:40.377668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:40.377668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:40.377668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:40.377668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:40.379639 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:40.379639 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:40.379639 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:25:40.379639 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:25:40.379639 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:25:40.379639 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:25:40.379639 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:25:40.379639 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:25:40.379639 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 09:25:40.379639 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:40.379639 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 273/547] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:25:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:25:40.384683 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59663a6-d6dc-431b-abb8-b828172f024d None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:40.449225 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8eeb26-53e2-4190-877b-5b49c69fc63d None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:40.499951 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59663a6-d6dc-431b-abb8-b828172f024d None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:40.519546 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:40.541518 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af54260-8e1a-4cc2-99fc-2762336e138e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:40.542199 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af54260-8e1a-4cc2-99fc-2762336e138e None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:40.542484 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af54260-8e1a-4cc2-99fc-2762336e138e None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:40.542765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af54260-8e1a-4cc2-99fc-2762336e138e None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:40.544012 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af54260-8e1a-4cc2-99fc-2762336e138e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:40.544887 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af54260-8e1a-4cc2-99fc-2762336e138e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:40.546345 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af54260-8e1a-4cc2-99fc-2762336e138e None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:40.548464 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abfe33-3667-4dae-982a-13d9daefd9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:40.549124 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abfe33-3667-4dae-982a-13d9daefd9aa None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:40.549407 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abfe33-3667-4dae-982a-13d9daefd9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:40.549682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abfe33-3667-4dae-982a-13d9daefd9aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:40.551068 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1abfe33-3667-4dae-982a-13d9daefd9aa None admin] RBAC: Adding query filter params (role.id=5cde0d2bc9ca433b8904823fc602ab67, scope.project.id=b1d802dc0211467fa4e709cd01d411dc, user.id=c1103a08484048da82c5e4627552253e) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:40.551407 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1abfe33-3667-4dae-982a-13d9daefd9aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:40.552840 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1abfe33-3667-4dae-982a-13d9daefd9aa None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:40.560462 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 275/548] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:25:40 2022] GET /identity/v3/role_assignments?user.id=c1103a08484048da82c5e4627552253e&scope.project.id=b1d802dc0211467fa4e709cd01d411dc&role.id=5cde0d2bc9ca433b8904823fc602ab67 => generated 259 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:40.591562 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 274/549] 10.222.0.41 () {56 vars in 1135 bytes} [Fri May 27 09:25:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:40.597530 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abfe33-3667-4dae-982a-13d9daefd9aa None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:40.667657 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:40.770250 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abfe33-3667-4dae-982a-13d9daefd9aa None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:40.816739 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72094fff-c6a7-4700-abc1-3eb4e0325f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:40.817427 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72094fff-c6a7-4700-abc1-3eb4e0325f5f None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:40.817716 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72094fff-c6a7-4700-abc1-3eb4e0325f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:40.817995 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72094fff-c6a7-4700-abc1-3eb4e0325f5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:40.898590 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72094fff-c6a7-4700-abc1-3eb4e0325f5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:40.900002 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72094fff-c6a7-4700-abc1-3eb4e0325f5f None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:40.929717 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c20197-5a6a-4186-8fb3-eda820585140 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:40.930026 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c20197-5a6a-4186-8fb3-eda820585140 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:40.930284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c20197-5a6a-4186-8fb3-eda820585140 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:40.931684 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 275/550] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:40.936808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5c77b-5907-43fe-9c28-faafb6adcbe4 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:40.937099 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5c77b-5907-43fe-9c28-faafb6adcbe4 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:40.937382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5c77b-5907-43fe-9c28-faafb6adcbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:40.950055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:40.980352 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-45a5c77b-5907-43fe-9c28-faafb6adcbe4 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:40.981574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-45a5c77b-5907-43fe-9c28-faafb6adcbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:41.040577 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 276/551] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:25:41.041999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e885e0f-be30-4ce5-94c9-9cbbd5950f85 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:41.042406 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e885e0f-be30-4ce5-94c9-9cbbd5950f85 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:41.042684 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e885e0f-be30-4ce5-94c9-9cbbd5950f85 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:41.044090 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 277/552] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:41.048822 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e885e0f-be30-4ce5-94c9-9cbbd5950f85 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:41.107300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 276/553] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:41.107300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e7787-f7c5-4453-9b7f-2d73915484c1 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:41.107300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e7787-f7c5-4453-9b7f-2d73915484c1 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:41.107300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e7787-f7c5-4453-9b7f-2d73915484c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:41.122282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-d51e7787-f7c5-4453-9b7f-2d73915484c1 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:41.123998 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d51e7787-f7c5-4453-9b7f-2d73915484c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:41.188601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e885e0f-be30-4ce5-94c9-9cbbd5950f85 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:41.215505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 277/554] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:41.217061 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e7787-f7c5-4453-9b7f-2d73915484c1 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:41.250097 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29627813-97ce-4bf1-a968-9a74233f4a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:41.250908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29627813-97ce-4bf1-a968-9a74233f4a21 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:41.251198 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29627813-97ce-4bf1-a968-9a74233f4a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:41.251507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29627813-97ce-4bf1-a968-9a74233f4a21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:41.255714 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:41.267249 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:41.268356 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29627813-97ce-4bf1-a968-9a74233f4a21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:41.271232 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29627813-97ce-4bf1-a968-9a74233f4a21 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:41.295372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-29627813-97ce-4bf1-a968-9a74233f4a21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:41.295372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:41.295372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:41.295372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:41.295372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:41.295372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:41.295372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:41.295372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:41.295372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:41.295372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:41.295372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:41.295372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:41.295372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:41.295372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:41.295372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:41.296320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:41.296320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:41.296320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:41.296320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:41.296320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:41.296320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:41.296320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:41.296320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:41.296320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:41.296320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:41.296320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:41.296320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:41.296320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:41.296320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:41.296320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:41.296320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:41.296320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:41.297806 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:41.297806 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:41.297806 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:41.297806 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:41.297806 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 278/555] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:41.297806 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29627813-97ce-4bf1-a968-9a74233f4a21 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:41.354230 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e7787-f7c5-4453-9b7f-2d73915484c1 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:41.399311 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfb56a-9b76-4137-b2af-8fff8c4b845f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:41.400139 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfb56a-9b76-4137-b2af-8fff8c4b845f None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:41.400672 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfb56a-9b76-4137-b2af-8fff8c4b845f None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:41.400962 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfb56a-9b76-4137-b2af-8fff8c4b845f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:41.408939 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29627813-97ce-4bf1-a968-9a74233f4a21 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:41.414103 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cfb56a-9b76-4137-b2af-8fff8c4b845f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:41.422769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-a1cfb56a-9b76-4137-b2af-8fff8c4b845f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:41.422769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:41.422769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:41.422769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:41.422769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:41.422769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:41.422769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:41.422769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:41.422769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:41.422769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:41.422769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:41.422769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:41.422769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:41.422769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:41.422769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:41.422769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:41.423765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:41.423765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:41.423765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:41.423765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:41.423765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:41.423765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:41.423765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:41.423765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:41.423765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:41.423765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:41.423765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:41.423765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:41.423765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:41.423765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:41.423765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:41.423765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:41.424564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:41.424564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:41.424564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:41.424564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:41.424564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:41.424564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:41.424564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:41.424564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:41.424564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:41.424564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:41.424564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:41.424564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:41.431458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 278/556] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 09:25:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:41.432596 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfb56a-9b76-4137-b2af-8fff8c4b845f None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:41.448100 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d88133-d994-4b18-8668-3ec2aa0763e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:41.449275 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d88133-d994-4b18-8668-3ec2aa0763e0 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:41.449692 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d88133-d994-4b18-8668-3ec2aa0763e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:41.449974 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d88133-d994-4b18-8668-3ec2aa0763e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:41.464842 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d88133-d994-4b18-8668-3ec2aa0763e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:41.475125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-45d88133-d994-4b18-8668-3ec2aa0763e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:41.475125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:41.475125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:41.475125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:41.475125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:41.475125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:41.475125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:41.475125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:41.475125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:41.475125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:41.475125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:41.475125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:41.475125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:41.475125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:41.475125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:41.475125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:41.476069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:41.476069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:41.476069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:41.476069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:41.476069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:41.476069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:41.476069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:41.476069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:41.476069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:41.476069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:41.476069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:41.476069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:41.476069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:41.476069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:41.476069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:41.476069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:41.477942 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:41.477942 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:41.477942 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:41.477942 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:41.477942 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:41.477942 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:41.477942 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:41.477942 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:41.477942 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:41.477942 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:41.477942 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:41.477942 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:41.481296 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 279/557] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 09:25:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:41.482045 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d88133-d994-4b18-8668-3ec2aa0763e0 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:41.537656 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:41.550447 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:41.558689 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfb56a-9b76-4137-b2af-8fff8c4b845f None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:41.604405 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e2241-3ae3-4f84-9940-4379f4c4d446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:41.605454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e2241-3ae3-4f84-9940-4379f4c4d446 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:41.605963 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e2241-3ae3-4f84-9940-4379f4c4d446 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:41.606441 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e2241-3ae3-4f84-9940-4379f4c4d446 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:41.607423 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e2241-3ae3-4f84-9940-4379f4c4d446 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:41.607931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e2241-3ae3-4f84-9940-4379f4c4d446 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:41.609527 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e2241-3ae3-4f84-9940-4379f4c4d446 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:41.610452 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d88133-d994-4b18-8668-3ec2aa0763e0 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:41.625715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 279/558] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:41.629554 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e2241-3ae3-4f84-9940-4379f4c4d446 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:41.668606 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738b26f-5fc6-4b6b-b27d-3c9b5ec3daa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:41.669284 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738b26f-5fc6-4b6b-b27d-3c9b5ec3daa5 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:41.669567 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738b26f-5fc6-4b6b-b27d-3c9b5ec3daa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:41.670071 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738b26f-5fc6-4b6b-b27d-3c9b5ec3daa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:41.670833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738b26f-5fc6-4b6b-b27d-3c9b5ec3daa5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:41.671369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738b26f-5fc6-4b6b-b27d-3c9b5ec3daa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:41.673034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738b26f-5fc6-4b6b-b27d-3c9b5ec3daa5 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:41.687344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 280/559] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 09:25:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:41.687344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738b26f-5fc6-4b6b-b27d-3c9b5ec3daa5 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:41.759044 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e2241-3ae3-4f84-9940-4379f4c4d446 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:41.796932 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18211c16-13ab-4323-b999-83b7a44432ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:41.797951 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18211c16-13ab-4323-b999-83b7a44432ef None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:41.798457 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18211c16-13ab-4323-b999-83b7a44432ef None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:41.799123 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18211c16-13ab-4323-b999-83b7a44432ef None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:41.800209 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18211c16-13ab-4323-b999-83b7a44432ef None admin] RBAC: Adding query filter params (name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:41.800700 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18211c16-13ab-4323-b999-83b7a44432ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:41.802275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18211c16-13ab-4323-b999-83b7a44432ef None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:41.815399 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 280/560] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 09:25:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:41.816554 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18211c16-13ab-4323-b999-83b7a44432ef None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:41.825466 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738b26f-5fc6-4b6b-b27d-3c9b5ec3daa5 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:41.838004 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:41.841327 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:41.872262 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa87ba8-7121-45d4-81dd-7487b84ad976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:41.873070 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa87ba8-7121-45d4-81dd-7487b84ad976 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:41.873353 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa87ba8-7121-45d4-81dd-7487b84ad976 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:41.873641 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa87ba8-7121-45d4-81dd-7487b84ad976 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:41.881860 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa87ba8-7121-45d4-81dd-7487b84ad976 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:41.883333 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa87ba8-7121-45d4-81dd-7487b84ad976 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:41.899041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-ffa87ba8-7121-45d4-81dd-7487b84ad976 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:41.899041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:41.899041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:41.899041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:41.899041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:41.899041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:41.899041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:41.899041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:41.899041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:41.899041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:41.899041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:41.899041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:41.899041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:25:41.899041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:25:41.899041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:25:41.899984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:25:41.899984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:41.899984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:41.899984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:41.899984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:41.899984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:41.899984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:41.899984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:41.899984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:41.899984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:41.899984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:41.899984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:41.899984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:41.899984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:41.899984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:41.899984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:41.899984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:41.900828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:25:41.900828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:25:41.900828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:25:41.900828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:25:41.900828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:25:41.900828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:25:41.900828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:41.900828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:41.900828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 281/561] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:41.901301 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa87ba8-7121-45d4-81dd-7487b84ad976 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:41.944279 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18211c16-13ab-4323-b999-83b7a44432ef None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:41.981848 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf50042-23d1-4607-9bcb-28c2415c6fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:41.982657 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf50042-23d1-4607-9bcb-28c2415c6fdf None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:41.982938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf50042-23d1-4607-9bcb-28c2415c6fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:41.983208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf50042-23d1-4607-9bcb-28c2415c6fdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:41.996365 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf50042-23d1-4607-9bcb-28c2415c6fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:41.997822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf50042-23d1-4607-9bcb-28c2415c6fdf None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:42.015324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-cdf50042-23d1-4607-9bcb-28c2415c6fdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:42.015324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:42.015324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:42.015324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:42.015324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:42.015324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:42.015324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:42.015324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:42.015324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:42.015324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:42.015324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:42.015324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:42.015324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:42.015324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:42.015324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:42.016184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:42.016184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:42.016184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:42.016184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:42.016184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:42.016184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:42.016184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:42.016184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:42.016184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:42.016184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:42.016184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:42.016184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:42.016184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:42.016184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:42.016184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:42.016184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:42.016184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:42.017046 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:42.017046 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:42.017046 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:42.017046 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:42.017046 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 281/562] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:42.017751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f4959-b4d2-48d1-baca-13c19bab314c None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:42.017931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f4959-b4d2-48d1-baca-13c19bab314c None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:42.018229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f4959-b4d2-48d1-baca-13c19bab314c None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:42.023425 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 282/563] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:42.023425 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f4959-b4d2-48d1-baca-13c19bab314c None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:42.024638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa87ba8-7121-45d4-81dd-7487b84ad976 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:42.063353 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2378e-bc0d-4c14-b18e-247016adb2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:42.064393 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2378e-bc0d-4c14-b18e-247016adb2ab None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:42.064828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2378e-bc0d-4c14-b18e-247016adb2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:42.066314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2378e-bc0d-4c14-b18e-247016adb2ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:42.076976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2378e-bc0d-4c14-b18e-247016adb2ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:42.078419 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2378e-bc0d-4c14-b18e-247016adb2ab None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:42.097922 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-21e2378e-bc0d-4c14-b18e-247016adb2ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:42.097922 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:42.097922 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:42.097922 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:42.097922 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:42.097922 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:42.097922 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:42.097922 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:42.097922 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:42.097922 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:42.097922 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:42.097922 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:42.097922 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:42.097922 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:42.097922 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:42.098823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:42.098823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:42.098823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:42.098823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:42.098823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:42.098823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:42.098823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:42.098823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:42.098823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:42.098823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:42.098823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:42.098823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:42.098823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:42.098823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:42.098823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:42.098823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:42.098823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:42.099754 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:42.099754 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:42.099754 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:42.099754 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:42.100012 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:42.104048 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 282/564] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:42.104904 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2378e-bc0d-4c14-b18e-247016adb2ab None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:42.130076 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:42.138269 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f4959-b4d2-48d1-baca-13c19bab314c None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:42.173139 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ab94e-4663-45da-b683-77d805c4cda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:42.173802 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ab94e-4663-45da-b683-77d805c4cda2 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:42.174095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ab94e-4663-45da-b683-77d805c4cda2 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:42.174367 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ab94e-4663-45da-b683-77d805c4cda2 None admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:42.175192 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ab94e-4663-45da-b683-77d805c4cda2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:42.175536 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ab94e-4663-45da-b683-77d805c4cda2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:42.176977 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ab94e-4663-45da-b683-77d805c4cda2 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:42.200500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 283/565] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:25:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:42.200500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f74525-58fe-4a29-acf3-70f1d214b214 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:42.200500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f74525-58fe-4a29-acf3-70f1d214b214 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:42.200500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f74525-58fe-4a29-acf3-70f1d214b214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:42.209609 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2378e-bc0d-4c14-b18e-247016adb2ab None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:42.219199 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-e1f74525-58fe-4a29-acf3-70f1d214b214 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:42.220584 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-e1f74525-58fe-4a29-acf3-70f1d214b214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:42.244518 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fad3e5-ef55-4fc1-a654-f3c01cbe30d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:42.245182 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fad3e5-ef55-4fc1-a654-f3c01cbe30d3 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:42.245465 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fad3e5-ef55-4fc1-a654-f3c01cbe30d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:42.245737 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fad3e5-ef55-4fc1-a654-f3c01cbe30d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:42.246480 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fad3e5-ef55-4fc1-a654-f3c01cbe30d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:42.246788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fad3e5-ef55-4fc1-a654-f3c01cbe30d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:42.248172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fad3e5-ef55-4fc1-a654-f3c01cbe30d3 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:42.265599 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 283/566] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:42.265599 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fad3e5-ef55-4fc1-a654-f3c01cbe30d3 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:42.311295 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 284/567] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:42.311295 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f74525-58fe-4a29-acf3-70f1d214b214 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:42.358197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:42.373989 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:42.380401 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fad3e5-ef55-4fc1-a654-f3c01cbe30d3 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:42.417120 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65177e4-4e08-47fc-a400-a9ae72f1a1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:42.417784 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65177e4-4e08-47fc-a400-a9ae72f1a1dd None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:42.418068 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65177e4-4e08-47fc-a400-a9ae72f1a1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:42.418339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65177e4-4e08-47fc-a400-a9ae72f1a1dd None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:42.419048 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65177e4-4e08-47fc-a400-a9ae72f1a1dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:42.419378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65177e4-4e08-47fc-a400-a9ae72f1a1dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:42.420735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65177e4-4e08-47fc-a400-a9ae72f1a1dd None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:42.423109 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f74525-58fe-4a29-acf3-70f1d214b214 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:42.433119 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 284/568] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:42.434249 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65177e4-4e08-47fc-a400-a9ae72f1a1dd None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:42.466962 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e0ada-ff75-426e-8f4f-78967dcf5f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:42.467886 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e0ada-ff75-426e-8f4f-78967dcf5f01 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:42.468494 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e0ada-ff75-426e-8f4f-78967dcf5f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:42.468912 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e0ada-ff75-426e-8f4f-78967dcf5f01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:42.470614 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e0ada-ff75-426e-8f4f-78967dcf5f01 None admin] RBAC: Adding query filter params (role.id=5cde0d2bc9ca433b8904823fc602ab67, scope.project.id=b1d802dc0211467fa4e709cd01d411dc, user.id=351f74222d394f39bda0663e0e4ebde6) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:42.471076 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e0ada-ff75-426e-8f4f-78967dcf5f01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:42.472743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e0ada-ff75-426e-8f4f-78967dcf5f01 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:42.480348 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 285/569] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:25:42 2022] GET /identity/v3/role_assignments?user.id=351f74222d394f39bda0663e0e4ebde6&scope.project.id=b1d802dc0211467fa4e709cd01d411dc&role.id=5cde0d2bc9ca433b8904823fc602ab67 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:42.481878 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e0ada-ff75-426e-8f4f-78967dcf5f01 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:42.572041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65177e4-4e08-47fc-a400-a9ae72f1a1dd None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:42.623091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4cf20-c961-42aa-b500-e430bbbc545f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:42.624482 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4cf20-c961-42aa-b500-e430bbbc545f None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:42.624938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4cf20-c961-42aa-b500-e430bbbc545f None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:42.625353 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4cf20-c961-42aa-b500-e430bbbc545f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:42.638360 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e0ada-ff75-426e-8f4f-78967dcf5f01 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:42.640907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4cf20-c961-42aa-b500-e430bbbc545f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:42.643900 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4cf20-c961-42aa-b500-e430bbbc545f None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:42.664217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-70d4cf20-c961-42aa-b500-e430bbbc545f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 09:25:42.664217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:42.664217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:42.664217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:42.664217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:42.664217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:42.664217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:42.664217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:42.664217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:42.664217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:42.664217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:42.664217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:42.664217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:25:42.664217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:25:42.664217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:25:42.664217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:25:42.665200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:42.665200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:42.665200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:25:42.665200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:42.665200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:25:42.665200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:42.665200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:42.665200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:42.665200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:42.665200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:42.665200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:42.665200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:42.665200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:42.665200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:42.665200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:42.665200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:42.665200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:42.665200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:42.666137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:42.666137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:42.666137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:25:42.666137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:25:42.666137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:25:42.666137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:25:42.666137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:25:42.666137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:25:42.666137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 09:25:42.666137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:42.673540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 285/570] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:42.673540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4cf20-c961-42aa-b500-e430bbbc545f None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:42.676257 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:42.679745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:42.709553 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c59df6-56d8-4a13-aecd-665ed0d912f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:42.710333 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c59df6-56d8-4a13-aecd-665ed0d912f9 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:42.710611 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c59df6-56d8-4a13-aecd-665ed0d912f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:42.715311 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c59df6-56d8-4a13-aecd-665ed0d912f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:42.725724 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c59df6-56d8-4a13-aecd-665ed0d912f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:42.737087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-d1c59df6-56d8-4a13-aecd-665ed0d912f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:42.737087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:42.737087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:42.737087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:42.737087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:42.737087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:42.737087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:42.737087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:42.737087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:42.737087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:42.737087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:42.737087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:42.737087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:42.737087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:42.737087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:42.737087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:42.738696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:42.738696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:42.738696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:42.738696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:42.738696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:42.738696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:42.738696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:42.738696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:42.738696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:42.738696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:42.738696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:42.738696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:42.738696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:42.738696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:42.738696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:42.738696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:42.740282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:42.740282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:42.740282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:42.740282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:42.740282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:42.740282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:42.740282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:42.740282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:42.740282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:42.740282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:42.740282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:42.740282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:42.740282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 286/571] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 09:25:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:42.740282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c59df6-56d8-4a13-aecd-665ed0d912f9 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:42.817101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4cf20-c961-42aa-b500-e430bbbc545f None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:42.867174 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2454b-d53b-4dd9-ab1d-8acf481873a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:42.868374 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2454b-d53b-4dd9-ab1d-8acf481873a8 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:42.868924 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2454b-d53b-4dd9-ab1d-8acf481873a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:42.869204 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2454b-d53b-4dd9-ab1d-8acf481873a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:42.878354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c59df6-56d8-4a13-aecd-665ed0d912f9 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:42.878981 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2454b-d53b-4dd9-ab1d-8acf481873a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:42.880760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2454b-d53b-4dd9-ab1d-8acf481873a8 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:42.900326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-15c2454b-d53b-4dd9-ab1d-8acf481873a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:25:42.900326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:42.900326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:42.900326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:42.900326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:42.900326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:42.900326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:42.900326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:42.900326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:42.900326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:42.900326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:42.900326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:42.900326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:25:42.900326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:25:42.900326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:25:42.900326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:25:42.903208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:42.903208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:42.903208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:25:42.903208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:42.903208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:25:42.903208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:42.903208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:42.903208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:42.903208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:42.903208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:42.903208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:42.903208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:42.903208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:42.903208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:42.903208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:42.903208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:42.903208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:42.903208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:42.905456 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:42.905456 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:42.905456 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:25:42.905456 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:25:42.905456 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:25:42.905456 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:25:42.905456 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:25:42.905456 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:25:42.905456 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:25:42.905456 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:42.905456 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 286/572] 10.222.0.41 () {56 vars in 1093 bytes} [Fri May 27 09:25:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:42.905456 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2454b-d53b-4dd9-ab1d-8acf481873a8 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:42.920679 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996b84a-1e3f-4cd5-9b64-40aa99d60aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:42.921531 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996b84a-1e3f-4cd5-9b64-40aa99d60aef None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:42.921916 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996b84a-1e3f-4cd5-9b64-40aa99d60aef None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:42.922314 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996b84a-1e3f-4cd5-9b64-40aa99d60aef None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:42.923356 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996b84a-1e3f-4cd5-9b64-40aa99d60aef None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:42.923774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996b84a-1e3f-4cd5-9b64-40aa99d60aef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:42.925909 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996b84a-1e3f-4cd5-9b64-40aa99d60aef None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:42.947367 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 287/573] 10.222.0.41 () {56 vars in 1137 bytes} [Fri May 27 09:25:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:42.948367 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996b84a-1e3f-4cd5-9b64-40aa99d60aef None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:42.982856 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:42.999643 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:43.036830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2454b-d53b-4dd9-ab1d-8acf481873a8 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:43.079800 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996b84a-1e3f-4cd5-9b64-40aa99d60aef None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:43.084721 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f8b47-f36d-4e02-92b1-0bed68f67e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:43.085658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f8b47-f36d-4e02-92b1-0bed68f67e2f None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:43.086096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f8b47-f36d-4e02-92b1-0bed68f67e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:43.086556 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f8b47-f36d-4e02-92b1-0bed68f67e2f None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:43.087482 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f8b47-f36d-4e02-92b1-0bed68f67e2f None admin] RBAC: Adding query filter params (name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:43.087953 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f8b47-f36d-4e02-92b1-0bed68f67e2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:43.090005 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f8b47-f36d-4e02-92b1-0bed68f67e2f None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:43.101938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 287/574] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 09:25:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:43.103053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f8b47-f36d-4e02-92b1-0bed68f67e2f None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:43.122103 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce640e-5b8f-4a56-b930-d1db04c398e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:43.122716 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce640e-5b8f-4a56-b930-d1db04c398e2 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:43.123004 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce640e-5b8f-4a56-b930-d1db04c398e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:43.123303 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce640e-5b8f-4a56-b930-d1db04c398e2 None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:43.124156 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce640e-5b8f-4a56-b930-d1db04c398e2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:43.124470 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce640e-5b8f-4a56-b930-d1db04c398e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:43.126306 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce640e-5b8f-4a56-b930-d1db04c398e2 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:43.151652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 288/575] 10.222.0.41 () {56 vars in 1133 bytes} [Fri May 27 09:25:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:43.151652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb936a3-ad46-47e1-b0b8-f4cb5b712d0e None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:43.151652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb936a3-ad46-47e1-b0b8-f4cb5b712d0e None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:43.151652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb936a3-ad46-47e1-b0b8-f4cb5b712d0e None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:43.152801 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 289/576] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:43.153558 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb936a3-ad46-47e1-b0b8-f4cb5b712d0e None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:43.219974 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f8b47-f36d-4e02-92b1-0bed68f67e2f None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:43.246373 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:43.257880 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71ead4-99bb-4dd6-a907-9112442f8dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:43.258790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71ead4-99bb-4dd6-a907-9112442f8dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:43.259073 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71ead4-99bb-4dd6-a907-9112442f8dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:43.259481 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71ead4-99bb-4dd6-a907-9112442f8dd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:43.261740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:43.267153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb936a3-ad46-47e1-b0b8-f4cb5b712d0e None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:43.272415 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71ead4-99bb-4dd6-a907-9112442f8dd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:43.273911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71ead4-99bb-4dd6-a907-9112442f8dd3 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:43.292319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-2a71ead4-99bb-4dd6-a907-9112442f8dd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:43.292319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:43.292319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:43.292319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:43.292319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:43.292319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:43.292319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:43.292319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:43.292319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:43.292319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:43.292319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:43.292319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:43.292319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:43.292319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:43.292319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:43.293205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:43.293205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:43.293205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:43.293205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:43.293205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:43.293205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:43.293205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:43.293205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:43.293205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:43.293205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:43.293205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:43.293205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:43.293205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:43.293205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:43.293205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:43.293205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:43.293205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:43.294062 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:43.294062 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:43.294062 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:43.294062 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:43.294062 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 288/577] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:43.294346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71ead4-99bb-4dd6-a907-9112442f8dd3 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:43.311021 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223559a-993c-4e6d-a5b9-563ad0f1d8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:43.312305 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223559a-993c-4e6d-a5b9-563ad0f1d8ac None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:43.312778 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223559a-993c-4e6d-a5b9-563ad0f1d8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:43.313500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223559a-993c-4e6d-a5b9-563ad0f1d8ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:43.324569 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223559a-993c-4e6d-a5b9-563ad0f1d8ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:43.326031 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223559a-993c-4e6d-a5b9-563ad0f1d8ac None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:43.346112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-9223559a-993c-4e6d-a5b9-563ad0f1d8ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:43.346112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:43.346112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:43.346112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:43.346112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:43.346112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:43.346112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:43.346112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:43.346112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:43.346112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:43.346112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:43.346112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:43.346112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:43.346112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:43.346112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:43.347621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:43.347621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:43.347621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:43.347621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:43.347621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:43.347621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:43.347621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:43.347621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:43.347621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:43.347621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:43.347621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:43.347621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:43.347621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:43.347621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:43.347621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:43.347621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:43.347621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:43.348467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:43.348467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:43.348467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:43.348467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:43.348467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 290/578] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:43.349159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963bfca-dfaf-4b0b-87db-9c5984e1e10c None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:43.349333 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963bfca-dfaf-4b0b-87db-9c5984e1e10c None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:43.349607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963bfca-dfaf-4b0b-87db-9c5984e1e10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:43.366190 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-e963bfca-dfaf-4b0b-87db-9c5984e1e10c None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:43.367425 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-e963bfca-dfaf-4b0b-87db-9c5984e1e10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:43.407082 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71ead4-99bb-4dd6-a907-9112442f8dd3 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:43.441494 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a9c4f-26e5-44a7-ae18-213827f43276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:43.442289 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a9c4f-26e5-44a7-ae18-213827f43276 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:43.442574 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a9c4f-26e5-44a7-ae18-213827f43276 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:43.442851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a9c4f-26e5-44a7-ae18-213827f43276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:43.447542 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 291/579] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:43.448267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963bfca-dfaf-4b0b-87db-9c5984e1e10c None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:43.454715 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a9c4f-26e5-44a7-ae18-213827f43276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:43.456771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a9c4f-26e5-44a7-ae18-213827f43276 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:43.474888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-547a9c4f-26e5-44a7-ae18-213827f43276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:43.474888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:43.474888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:43.474888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:43.474888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:43.474888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:43.474888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:43.474888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:43.474888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:43.474888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:43.474888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:43.474888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:43.474888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:43.474888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:43.474888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:43.475828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:43.475828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:43.475828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:43.475828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:43.475828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:43.475828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:43.475828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:43.475828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:43.475828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:43.475828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:43.475828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:43.475828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:43.475828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:43.475828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:43.475828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:43.475828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:43.475828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:43.481479 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:43.481479 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:43.481479 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:43.481479 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:43.481479 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 289/580] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:43.481479 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a9c4f-26e5-44a7-ae18-213827f43276 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:43.508369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:43.542733 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:43.563856 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963bfca-dfaf-4b0b-87db-9c5984e1e10c None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:43.586180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a9c4f-26e5-44a7-ae18-213827f43276 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:43.600711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7c6a4-3ae3-4823-b347-0351696b9fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:43.601489 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7c6a4-3ae3-4823-b347-0351696b9fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:43.601799 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7c6a4-3ae3-4823-b347-0351696b9fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:43.602134 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7c6a4-3ae3-4823-b347-0351696b9fe7 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:43.602881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7c6a4-3ae3-4823-b347-0351696b9fe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:43.603170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7c6a4-3ae3-4823-b347-0351696b9fe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:43.604582 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7c6a4-3ae3-4823-b347-0351696b9fe7 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:43.616543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 292/581] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:43.617339 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7c6a4-3ae3-4823-b347-0351696b9fe7 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:43.630415 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2452511-20d5-4925-928c-ac5b2630afdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:43.631240 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2452511-20d5-4925-928c-ac5b2630afdb None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:43.631560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2452511-20d5-4925-928c-ac5b2630afdb None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:43.631847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2452511-20d5-4925-928c-ac5b2630afdb None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:43.632567 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2452511-20d5-4925-928c-ac5b2630afdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:43.632880 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2452511-20d5-4925-928c-ac5b2630afdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:43.634320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2452511-20d5-4925-928c-ac5b2630afdb None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:43.647350 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 290/582] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:43.652560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2452511-20d5-4925-928c-ac5b2630afdb None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:43.722965 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7c6a4-3ae3-4823-b347-0351696b9fe7 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:43.748775 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:43.759435 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460680c7-a203-4e43-b077-90b9b894683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:43.760245 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460680c7-a203-4e43-b077-90b9b894683b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:43.760535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460680c7-a203-4e43-b077-90b9b894683b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:43.760817 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460680c7-a203-4e43-b077-90b9b894683b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:43.763313 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2452511-20d5-4925-928c-ac5b2630afdb None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:43.769577 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:43.773250 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460680c7-a203-4e43-b077-90b9b894683b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:43.781739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-460680c7-a203-4e43-b077-90b9b894683b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:43.781739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:43.781739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:43.781739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:43.781739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:43.781739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:43.781739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:43.781739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:43.781739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:43.781739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:43.781739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:43.781739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:43.781739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:43.781739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:43.781739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:43.781739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:43.782669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:43.782669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:43.782669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:43.782669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:43.782669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:43.782669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:43.782669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:43.782669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:43.782669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:43.782669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:43.782669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:43.782669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:43.782669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:43.782669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:43.782669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:43.782669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:43.788701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:43.788701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:43.788701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:43.788701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:43.788701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:43.788701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:43.788701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:43.788701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:43.788701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:43.788701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:43.788701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:43.788701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:43.788701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 293/583] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 09:25:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:43.788701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460680c7-a203-4e43-b077-90b9b894683b None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:43.799348 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366e6ce-744e-4532-a8ae-70f6df2256c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:43.800052 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366e6ce-744e-4532-a8ae-70f6df2256c8 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:43.800335 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366e6ce-744e-4532-a8ae-70f6df2256c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:43.800611 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366e6ce-744e-4532-a8ae-70f6df2256c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:43.801335 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366e6ce-744e-4532-a8ae-70f6df2256c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:43.801643 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366e6ce-744e-4532-a8ae-70f6df2256c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:43.803005 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366e6ce-744e-4532-a8ae-70f6df2256c8 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:43.814358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 291/584] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:43.819938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366e6ce-744e-4532-a8ae-70f6df2256c8 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:43.895018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460680c7-a203-4e43-b077-90b9b894683b None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:43.929285 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366e6ce-744e-4532-a8ae-70f6df2256c8 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:43.930969 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc5cec-f234-4cfa-b9ff-5515438f663d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:43.931789 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc5cec-f234-4cfa-b9ff-5515438f663d None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:43.932068 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc5cec-f234-4cfa-b9ff-5515438f663d None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:43.932344 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc5cec-f234-4cfa-b9ff-5515438f663d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:43.939092 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc5cec-f234-4cfa-b9ff-5515438f663d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:43.941151 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc5cec-f234-4cfa-b9ff-5515438f663d None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:43.955328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-b3dc5cec-f234-4cfa-b9ff-5515438f663d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:43.955328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:43.955328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:43.955328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:43.955328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:43.955328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:43.955328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:43.955328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:43.955328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:43.955328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:43.955328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:43.955328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:43.955328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:25:43.955328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:25:43.955328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:25:43.956431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:25:43.956431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:43.956431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:43.956431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:43.956431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:43.956431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:43.956431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:43.956431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:43.956431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:43.956431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:43.956431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:43.956431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:43.956431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:43.956431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:43.956431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:43.956431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:43.956431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:43.957509 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:25:43.957509 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:25:43.957509 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:25:43.957509 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:25:43.957509 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:25:43.957509 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:25:43.957509 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:43.957509 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:43.961104 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 294/585] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:43.961880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc5cec-f234-4cfa-b9ff-5515438f663d None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:43.968253 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e0446-f9f0-43a5-9421-9974d170a8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:43.969252 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e0446-f9f0-43a5-9421-9974d170a8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:43.969685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e0446-f9f0-43a5-9421-9974d170a8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:43.970117 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e0446-f9f0-43a5-9421-9974d170a8d6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:43.978181 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e0446-f9f0-43a5-9421-9974d170a8d6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:43.979821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e0446-f9f0-43a5-9421-9974d170a8d6 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:43.994830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-cc7e0446-f9f0-43a5-9421-9974d170a8d6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 09:25:43.994830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:43.994830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:43.994830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:43.994830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:43.994830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:43.994830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:43.994830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:43.994830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:43.994830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:43.994830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:43.994830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:43.994830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:25:43.994830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:25:43.994830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:25:43.994830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:25:43.995963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:43.995963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:43.995963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:25:43.995963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:43.995963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:25:43.995963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:43.995963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:43.995963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:43.995963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:43.995963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:43.995963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:43.995963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:43.995963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:43.995963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:43.995963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:43.995963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:43.995963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:43.995963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:43.997084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:43.997084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:43.997084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:25:43.997084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:25:43.997084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:25:43.997084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:25:43.997084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:25:43.997084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:25:43.997084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 09:25:43.997084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:44.000561 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 292/586] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:44.001369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e0446-f9f0-43a5-9421-9974d170a8d6 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:44.012813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:44.027241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:44.074648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc5cec-f234-4cfa-b9ff-5515438f663d None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:44.109559 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e0446-f9f0-43a5-9421-9974d170a8d6 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:44.111060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a34a21-d8bf-4025-adf9-e94b5473b3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:44.112217 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a34a21-d8bf-4025-adf9-e94b5473b3cb None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:44.113117 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a34a21-d8bf-4025-adf9-e94b5473b3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:44.113499 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a34a21-d8bf-4025-adf9-e94b5473b3cb None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:44.114337 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a34a21-d8bf-4025-adf9-e94b5473b3cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:44.114748 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a34a21-d8bf-4025-adf9-e94b5473b3cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:44.116286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a34a21-d8bf-4025-adf9-e94b5473b3cb None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:44.131432 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 295/587] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 09:25:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:44.131432 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a34a21-d8bf-4025-adf9-e94b5473b3cb None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:44.157487 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099c39b-2696-4fc7-8133-2e73a775351d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:44.158289 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099c39b-2696-4fc7-8133-2e73a775351d None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:44.158595 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099c39b-2696-4fc7-8133-2e73a775351d None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:44.158853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099c39b-2696-4fc7-8133-2e73a775351d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:44.165974 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099c39b-2696-4fc7-8133-2e73a775351d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:44.167465 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099c39b-2696-4fc7-8133-2e73a775351d None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:44.182699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-5099c39b-2696-4fc7-8133-2e73a775351d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:44.182699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:44.182699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:44.182699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:44.182699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:44.182699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:44.182699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:44.182699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:44.182699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:44.182699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:44.182699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:44.182699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:44.182699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:25:44.182699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:25:44.182699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:25:44.183629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:25:44.183629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:44.183629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:44.183629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:44.183629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:44.183629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:44.183629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:44.183629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:44.183629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:44.183629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:44.183629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:44.183629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:44.183629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:44.183629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:44.183629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:44.183629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:44.183629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:44.184499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:25:44.184499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:25:44.184499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:25:44.184499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:25:44.184499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:25:44.184499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:25:44.184499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:44.184499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:44.184499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 293/588] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:44.185781 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099c39b-2696-4fc7-8133-2e73a775351d None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:44.233791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a34a21-d8bf-4025-adf9-e94b5473b3cb None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:44.256676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:44.258976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:44.272169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575d9af-63f2-4da4-afbe-778e8e1f9c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:44.273017 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575d9af-63f2-4da4-afbe-778e8e1f9c3c None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:44.273242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575d9af-63f2-4da4-afbe-778e8e1f9c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:44.273527 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575d9af-63f2-4da4-afbe-778e8e1f9c3c None admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:44.274355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575d9af-63f2-4da4-afbe-778e8e1f9c3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:44.274667 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575d9af-63f2-4da4-afbe-778e8e1f9c3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:44.276154 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575d9af-63f2-4da4-afbe-778e8e1f9c3c None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:44.293294 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 296/589] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:25:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:44.293294 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575d9af-63f2-4da4-afbe-778e8e1f9c3c None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:44.299008 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099c39b-2696-4fc7-8133-2e73a775351d None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:44.334842 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e000956-04f1-484f-bd2a-1e201a8bfebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:44.335538 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e000956-04f1-484f-bd2a-1e201a8bfebd None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:44.335819 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e000956-04f1-484f-bd2a-1e201a8bfebd None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:44.336091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e000956-04f1-484f-bd2a-1e201a8bfebd None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:44.336912 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e000956-04f1-484f-bd2a-1e201a8bfebd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:44.337219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e000956-04f1-484f-bd2a-1e201a8bfebd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:44.338650 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e000956-04f1-484f-bd2a-1e201a8bfebd None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:44.357414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 294/590] 10.222.0.41 () {56 vars in 1137 bytes} [Fri May 27 09:25:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:44.360465 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e000956-04f1-484f-bd2a-1e201a8bfebd None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:44.400809 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575d9af-63f2-4da4-afbe-778e8e1f9c3c None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:44.437281 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604de628-ece3-4d71-9aa9-d168e521aac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:44.438084 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604de628-ece3-4d71-9aa9-d168e521aac8 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:44.438821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604de628-ece3-4d71-9aa9-d168e521aac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:44.439106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604de628-ece3-4d71-9aa9-d168e521aac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:44.449859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604de628-ece3-4d71-9aa9-d168e521aac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:44.451330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604de628-ece3-4d71-9aa9-d168e521aac8 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:44.461449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e000956-04f1-484f-bd2a-1e201a8bfebd None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:44.469271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-604de628-ece3-4d71-9aa9-d168e521aac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:44.469271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:44.469271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:44.469271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:44.469271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:44.469271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:44.469271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:44.469271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:44.469271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:44.469271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:44.469271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:44.469271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:44.469271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:44.469271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:44.469271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:44.470174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:44.470174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:44.470174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:44.470174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:44.470174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:44.470174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:44.470174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:44.470174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:44.470174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:44.470174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:44.470174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:44.470174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:44.470174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:44.470174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:44.470174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:44.470174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:44.470174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:44.476500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:44.476500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:44.476500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:44.476500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:44.476500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 297/591] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:44.476500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604de628-ece3-4d71-9aa9-d168e521aac8 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:44.495629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:44.506450 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012eb67-a2e0-4487-9e5f-980475feb2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:44.507109 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012eb67-a2e0-4487-9e5f-980475feb2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:44.507443 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012eb67-a2e0-4487-9e5f-980475feb2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:44.507712 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012eb67-a2e0-4487-9e5f-980475feb2c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:44.508458 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012eb67-a2e0-4487-9e5f-980475feb2c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:44.508765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012eb67-a2e0-4487-9e5f-980475feb2c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:44.509891 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:44.510175 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012eb67-a2e0-4487-9e5f-980475feb2c7 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:44.522951 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 295/592] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:25:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:44.528188 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012eb67-a2e0-4487-9e5f-980475feb2c7 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:44.579333 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604de628-ece3-4d71-9aa9-d168e521aac8 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:44.623805 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d02363-4c67-48ad-aa29-fdae1c42f6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:44.624710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d02363-4c67-48ad-aa29-fdae1c42f6f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:44.624990 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d02363-4c67-48ad-aa29-fdae1c42f6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:44.625267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d02363-4c67-48ad-aa29-fdae1c42f6f9 None admin] PATH_INFO: `/v3/projects/b1d802dc0211467fa4e709cd01d411dc/users/192c3d179fdb43c9885f637446c83a89/roles/5cde0d2bc9ca433b8904823fc602ab67` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:44.641445 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d02363-4c67-48ad-aa29-fdae1c42f6f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1d802dc0211467fa4e709cd01d411dc, user_id=192c3d179fdb43c9885f637446c83a89, role_id=5cde0d2bc9ca433b8904823fc602ab67)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:44.642889 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d02363-4c67-48ad-aa29-fdae1c42f6f9 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:44.643812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012eb67-a2e0-4487-9e5f-980475feb2c7 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:44.667304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 298/593] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:25:44 2022] PUT /identity/v3/projects/b1d802dc0211467fa4e709cd01d411dc/users/192c3d179fdb43c9885f637446c83a89/roles/5cde0d2bc9ca433b8904823fc602ab67 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:25:44.667304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d02363-4c67-48ad-aa29-fdae1c42f6f9 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:44.689560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa656a-ce65-4f9a-b39d-b97afe7b0bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:44.690647 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa656a-ce65-4f9a-b39d-b97afe7b0bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:44.690999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa656a-ce65-4f9a-b39d-b97afe7b0bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:44.691366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa656a-ce65-4f9a-b39d-b97afe7b0bc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:44.704375 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa656a-ce65-4f9a-b39d-b97afe7b0bc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:44.706671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa656a-ce65-4f9a-b39d-b97afe7b0bc3 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:44.726771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-0efa656a-ce65-4f9a-b39d-b97afe7b0bc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:44.726771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:44.726771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:44.726771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:44.726771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:44.726771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:44.726771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:44.726771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:44.726771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:44.726771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:44.726771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:44.726771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:44.726771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:44.726771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:44.726771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:44.727917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:44.727917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:44.727917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:44.727917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:44.727917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:44.727917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:44.727917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:44.727917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:44.727917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:44.727917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:44.727917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:44.727917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:44.727917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:44.727917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:44.727917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:44.727917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:44.727917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:44.728827 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:44.728827 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:44.728827 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:44.728827 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:44.728827 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 296/594] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:44.729115 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa656a-ce65-4f9a-b39d-b97afe7b0bc3 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:44.788616 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:44.796833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:44.807447 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d02363-4c67-48ad-aa29-fdae1c42f6f9 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:44.850382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e39e5e-a309-4dcd-879a-f720bea9c65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:44.851163 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e39e5e-a309-4dcd-879a-f720bea9c65e None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:44.851554 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e39e5e-a309-4dcd-879a-f720bea9c65e None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:44.851892 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e39e5e-a309-4dcd-879a-f720bea9c65e None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:44.853157 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e39e5e-a309-4dcd-879a-f720bea9c65e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:44.853550 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e39e5e-a309-4dcd-879a-f720bea9c65e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:44.855031 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e39e5e-a309-4dcd-879a-f720bea9c65e None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:44.868405 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 299/595] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:44.869475 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e39e5e-a309-4dcd-879a-f720bea9c65e None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:44.873064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa656a-ce65-4f9a-b39d-b97afe7b0bc3 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:44.917985 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c1c83-0f0f-4b4b-8d3d-1d2292b0e588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:44.919799 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c1c83-0f0f-4b4b-8d3d-1d2292b0e588 None admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:44.920262 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c1c83-0f0f-4b4b-8d3d-1d2292b0e588 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:44.920853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c1c83-0f0f-4b4b-8d3d-1d2292b0e588 None admin] PATH_INFO: `/v3/projects/b1d802dc0211467fa4e709cd01d411dc/users/d2b1c12e88c549208894fc0dd0c60b88/roles/5cde0d2bc9ca433b8904823fc602ab67` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:44.938294 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c1c83-0f0f-4b4b-8d3d-1d2292b0e588 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1d802dc0211467fa4e709cd01d411dc, user_id=d2b1c12e88c549208894fc0dd0c60b88, role_id=5cde0d2bc9ca433b8904823fc602ab67)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:44.939786 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c1c83-0f0f-4b4b-8d3d-1d2292b0e588 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:44.959313 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 297/596] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:25:44 2022] PUT /identity/v3/projects/b1d802dc0211467fa4e709cd01d411dc/users/d2b1c12e88c549208894fc0dd0c60b88/roles/5cde0d2bc9ca433b8904823fc602ab67 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:25:44.959313 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e346b-8e10-4701-88f7-2f3e8cf5616f None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:44.959313 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e346b-8e10-4701-88f7-2f3e8cf5616f None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:44.959313 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e346b-8e10-4701-88f7-2f3e8cf5616f None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:44.963292 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 298/597] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:44.964792 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e346b-8e10-4701-88f7-2f3e8cf5616f None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:44.983211 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e39e5e-a309-4dcd-879a-f720bea9c65e None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:45.023900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09323d63-3140-43e0-a6fd-a8bb3840bfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:45.024716 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09323d63-3140-43e0-a6fd-a8bb3840bfd4 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:45.025072 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09323d63-3140-43e0-a6fd-a8bb3840bfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:45.025425 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09323d63-3140-43e0-a6fd-a8bb3840bfd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:45.026251 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09323d63-3140-43e0-a6fd-a8bb3840bfd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:45.026640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09323d63-3140-43e0-a6fd-a8bb3840bfd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:45.028302 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09323d63-3140-43e0-a6fd-a8bb3840bfd4 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:45.047402 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 300/598] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:45.047894 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f69fc-d5e1-4d67-90a7-c6291a22e47a None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:45.048287 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f69fc-d5e1-4d67-90a7-c6291a22e47a None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:45.048615 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f69fc-d5e1-4d67-90a7-c6291a22e47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:45.056202 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:45.071611 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-ae8f69fc-d5e1-4d67-90a7-c6291a22e47a None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:45.072833 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-ae8f69fc-d5e1-4d67-90a7-c6291a22e47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:45.104518 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:45.120641 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e346b-8e10-4701-88f7-2f3e8cf5616f None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:45.157146 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 301/599] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:45.158426 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f69fc-d5e1-4d67-90a7-c6291a22e47a None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:45.162936 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42837380-029d-4508-b2d1-bccbee45a62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:45.163510 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42837380-029d-4508-b2d1-bccbee45a62d None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:45.163797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42837380-029d-4508-b2d1-bccbee45a62d None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:45.164074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42837380-029d-4508-b2d1-bccbee45a62d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:45.172080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42837380-029d-4508-b2d1-bccbee45a62d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:45.173676 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42837380-029d-4508-b2d1-bccbee45a62d None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:45.191892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-42837380-029d-4508-b2d1-bccbee45a62d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 09:25:45.191892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:45.191892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:45.191892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:45.191892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:45.191892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:45.191892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:45.191892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:45.191892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:45.191892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:45.191892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:45.191892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:45.191892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:25:45.191892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:25:45.191892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:25:45.191892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:25:45.192864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:45.192864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:45.192864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:25:45.192864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:45.192864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:25:45.192864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:45.192864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:45.192864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:45.192864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:45.192864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:45.192864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:45.192864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:45.192864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:45.192864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:45.192864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:45.192864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:45.192864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:45.192864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:45.193873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:45.193873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:45.193873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:25:45.193873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:25:45.193873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:25:45.193873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:25:45.193873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:25:45.193873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:25:45.193873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 09:25:45.193873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:45.193873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 299/600] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 09:25:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:45.194454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42837380-029d-4508-b2d1-bccbee45a62d None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:45.288449 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f69fc-d5e1-4d67-90a7-c6291a22e47a None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:45.307559 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42837380-029d-4508-b2d1-bccbee45a62d None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:45.335756 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae324fce-8cd1-4f2b-afa2-6f81e683a340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:45.336570 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae324fce-8cd1-4f2b-afa2-6f81e683a340 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:45.336857 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae324fce-8cd1-4f2b-afa2-6f81e683a340 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:45.337136 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae324fce-8cd1-4f2b-afa2-6f81e683a340 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:45.340481 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:45.347356 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae324fce-8cd1-4f2b-afa2-6f81e683a340 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:45.348893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae324fce-8cd1-4f2b-afa2-6f81e683a340 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:45.352859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf74986-9ec0-4180-aab3-ee174ad04841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:45.353900 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf74986-9ec0-4180-aab3-ee174ad04841 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:45.354409 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf74986-9ec0-4180-aab3-ee174ad04841 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:45.354892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf74986-9ec0-4180-aab3-ee174ad04841 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:45.364239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-ae324fce-8cd1-4f2b-afa2-6f81e683a340 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:45.364239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:45.364239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:45.364239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:45.364239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:45.364239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:45.364239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:45.364239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:45.364239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:45.364239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:45.364239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:45.364239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:45.364239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:25:45.364239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:25:45.364239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:25:45.365131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:25:45.365131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:45.365131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:45.365131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:45.365131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:45.365131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:45.365131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:45.365131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:45.365131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:45.365131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:45.365131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:45.365131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:45.365131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:45.365131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:45.365131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:45.365131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:45.365131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:45.365997 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:25:45.365997 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:25:45.365997 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:25:45.365997 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:25:45.365997 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:25:45.365997 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:25:45.365997 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:45.365997 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:45.365997 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 302/601] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:45.366479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae324fce-8cd1-4f2b-afa2-6f81e683a340 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:45.371390 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf74986-9ec0-4180-aab3-ee174ad04841 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:45.379956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-1cf74986-9ec0-4180-aab3-ee174ad04841 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:45.379956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:45.379956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:45.379956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:45.379956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:45.379956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:45.379956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:45.379956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:45.379956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:45.379956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:45.379956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:45.379956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:45.379956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:45.379956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:45.379956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:45.379956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:45.380877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:45.380877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:45.380877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:45.380877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:45.380877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:45.380877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:45.380877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:45.380877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:45.380877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:45.380877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:45.380877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:45.380877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:45.380877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:45.380877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:45.380877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:45.380877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:45.381773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:45.381773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:45.381773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:45.381773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:45.381773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:45.381773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:45.381773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:45.381773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:45.381773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:45.381773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:45.381773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:45.381773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:45.381773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 300/602] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 09:25:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:45.382472 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf74986-9ec0-4180-aab3-ee174ad04841 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:45.399185 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:45.497698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf74986-9ec0-4180-aab3-ee174ad04841 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:45.513443 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae324fce-8cd1-4f2b-afa2-6f81e683a340 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:45.533724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3518ea-e7ca-40b7-acfd-df861352e13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:45.535664 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3518ea-e7ca-40b7-acfd-df861352e13f None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:45.535664 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3518ea-e7ca-40b7-acfd-df861352e13f None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:45.535664 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3518ea-e7ca-40b7-acfd-df861352e13f None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:45.535913 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3518ea-e7ca-40b7-acfd-df861352e13f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:45.536229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3518ea-e7ca-40b7-acfd-df861352e13f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:45.537665 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3518ea-e7ca-40b7-acfd-df861352e13f None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:45.552267 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 301/603] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:25:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:45.553173 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3518ea-e7ca-40b7-acfd-df861352e13f None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:45.555206 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a3fe4-31fb-4b1b-853e-21050666dd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:45.556101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a3fe4-31fb-4b1b-853e-21050666dd54 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:45.556522 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a3fe4-31fb-4b1b-853e-21050666dd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:45.556961 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a3fe4-31fb-4b1b-853e-21050666dd54 None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:45.558142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a3fe4-31fb-4b1b-853e-21050666dd54 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:45.558402 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a3fe4-31fb-4b1b-853e-21050666dd54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:45.559923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a3fe4-31fb-4b1b-853e-21050666dd54 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:45.579180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 303/604] 10.222.0.41 () {56 vars in 1139 bytes} [Fri May 27 09:25:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:45.580271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a3fe4-31fb-4b1b-853e-21050666dd54 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:45.639927 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:45.643691 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:45.684972 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3518ea-e7ca-40b7-acfd-df861352e13f None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:45.692924 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a3fe4-31fb-4b1b-853e-21050666dd54 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:45.729399 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fa930-0b13-48db-a337-d4290a6c191f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:45.730323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21613870-4e31-4b74-ab24-0760e5e81237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:45.730564 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fa930-0b13-48db-a337-d4290a6c191f None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:45.730987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fa930-0b13-48db-a337-d4290a6c191f None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:45.731442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fa930-0b13-48db-a337-d4290a6c191f None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:45.731625 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21613870-4e31-4b74-ab24-0760e5e81237 None admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:45.732006 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21613870-4e31-4b74-ab24-0760e5e81237 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:45.732383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21613870-4e31-4b74-ab24-0760e5e81237 None admin] PATH_INFO: `/v3/projects/b1d802dc0211467fa4e709cd01d411dc/users/38e04575437341df8127860a5e5abc50/roles/5cde0d2bc9ca433b8904823fc602ab67` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:45.732772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fa930-0b13-48db-a337-d4290a6c191f None admin] RBAC: Adding query filter params (name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:45.733310 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fa930-0b13-48db-a337-d4290a6c191f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:45.735264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fa930-0b13-48db-a337-d4290a6c191f None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:45.747095 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 302/605] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 09:25:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:45.748535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fa930-0b13-48db-a337-d4290a6c191f None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:45.755560 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21613870-4e31-4b74-ab24-0760e5e81237 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1d802dc0211467fa4e709cd01d411dc, user_id=38e04575437341df8127860a5e5abc50, role_id=5cde0d2bc9ca433b8904823fc602ab67)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:45.757270 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21613870-4e31-4b74-ab24-0760e5e81237 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:45.774823 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 304/606] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:25:45 2022] PUT /identity/v3/projects/b1d802dc0211467fa4e709cd01d411dc/users/38e04575437341df8127860a5e5abc50/roles/5cde0d2bc9ca433b8904823fc602ab67 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:25:45.776008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21613870-4e31-4b74-ab24-0760e5e81237 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:45.936587 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fa930-0b13-48db-a337-d4290a6c191f None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:45.975660 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:45.982586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543547c-b586-4a12-a632-265b12b03d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:45.983976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543547c-b586-4a12-a632-265b12b03d62 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:45.986231 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543547c-b586-4a12-a632-265b12b03d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:45.988131 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543547c-b586-4a12-a632-265b12b03d62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:45.991888 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21613870-4e31-4b74-ab24-0760e5e81237 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:45.995505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:46.013717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543547c-b586-4a12-a632-265b12b03d62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:46.015725 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543547c-b586-4a12-a632-265b12b03d62 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:46.034698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-e543547c-b586-4a12-a632-265b12b03d62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:46.034698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:46.034698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:46.034698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:46.034698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:46.034698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:46.034698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:46.034698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:46.034698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:46.034698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:46.034698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:46.034698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:46.034698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:46.034698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:46.034698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:46.035706 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:46.035706 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:46.035706 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:46.035706 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:46.035706 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:46.035706 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:46.035706 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:46.035706 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:46.035706 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:46.035706 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:46.035706 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:46.035706 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:46.035706 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:46.035706 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:46.035706 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:46.035706 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:46.035706 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:46.036571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:46.036571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:46.036571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:46.036571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:46.037212 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 303/607] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:46.042528 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543547c-b586-4a12-a632-265b12b03d62 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:46.058294 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800001d6-e6d4-4b1a-9f1e-ee6d65379de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:46.059575 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800001d6-e6d4-4b1a-9f1e-ee6d65379de2 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:46.062952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800001d6-e6d4-4b1a-9f1e-ee6d65379de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:46.063494 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800001d6-e6d4-4b1a-9f1e-ee6d65379de2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:46.076174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800001d6-e6d4-4b1a-9f1e-ee6d65379de2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:46.078061 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800001d6-e6d4-4b1a-9f1e-ee6d65379de2 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:46.098323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-800001d6-e6d4-4b1a-9f1e-ee6d65379de2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:46.098323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:46.098323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:46.098323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:46.098323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:46.098323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:46.098323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:46.098323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:46.098323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:46.098323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:46.098323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:46.098323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:46.098323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:46.098323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:46.098323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:46.099232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:46.099232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:46.099232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:46.099232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:46.099232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:46.099232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:46.099232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:46.099232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:46.099232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:46.099232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:46.099232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:46.099232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:46.099232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:46.099232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:46.099232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:46.099232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:46.099232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:46.100222 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:46.100222 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:46.100222 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:46.100222 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:46.102496 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 305/608] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:46.108192 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800001d6-e6d4-4b1a-9f1e-ee6d65379de2 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:46.152618 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543547c-b586-4a12-a632-265b12b03d62 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:46.187806 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf3a95-f9e7-4263-ac0b-faf4778e2c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:46.188390 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf3a95-f9e7-4263-ac0b-faf4778e2c96 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:46.188675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf3a95-f9e7-4263-ac0b-faf4778e2c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:46.188950 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf3a95-f9e7-4263-ac0b-faf4778e2c96 None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:46.189670 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf3a95-f9e7-4263-ac0b-faf4778e2c96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:46.189974 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf3a95-f9e7-4263-ac0b-faf4778e2c96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:46.191407 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf3a95-f9e7-4263-ac0b-faf4778e2c96 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:46.207299 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 304/609] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:46.209664 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf3a95-f9e7-4263-ac0b-faf4778e2c96 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:46.242163 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800001d6-e6d4-4b1a-9f1e-ee6d65379de2 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:46.287664 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:46.321543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a73e7-737c-4e61-9d75-5650d680ecf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:46.322246 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a73e7-737c-4e61-9d75-5650d680ecf1 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:46.322486 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a73e7-737c-4e61-9d75-5650d680ecf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:46.322758 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a73e7-737c-4e61-9d75-5650d680ecf1 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:46.323501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a73e7-737c-4e61-9d75-5650d680ecf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:46.323807 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a73e7-737c-4e61-9d75-5650d680ecf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:46.325193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a73e7-737c-4e61-9d75-5650d680ecf1 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:46.348254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 306/610] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:46.354407 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a73e7-737c-4e61-9d75-5650d680ecf1 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:46.379572 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:46.386271 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf3a95-f9e7-4263-ac0b-faf4778e2c96 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:46.427221 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e51d5-c3d2-4c82-9250-3f69cf7aff62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:46.428546 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e51d5-c3d2-4c82-9250-3f69cf7aff62 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:46.429295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e51d5-c3d2-4c82-9250-3f69cf7aff62 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:46.429791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e51d5-c3d2-4c82-9250-3f69cf7aff62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:46.438068 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e51d5-c3d2-4c82-9250-3f69cf7aff62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:46.439928 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e51d5-c3d2-4c82-9250-3f69cf7aff62 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:46.456573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-567e51d5-c3d2-4c82-9250-3f69cf7aff62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:46.456573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:46.456573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:46.456573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:46.456573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:46.456573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:46.456573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:46.456573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:46.456573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:46.456573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:46.456573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:46.456573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:46.456573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:25:46.456573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:25:46.456573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:25:46.457523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:25:46.457523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:46.457523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:46.457523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:46.457523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:46.457523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:46.457523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:46.457523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:46.457523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:46.457523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:46.457523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:46.457523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:46.457523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:46.457523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:46.457523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:46.457523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:46.457523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:46.458414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:25:46.458414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:25:46.458414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:25:46.458414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:25:46.458414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:25:46.458414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:25:46.458414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:46.458414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:46.461917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 305/611] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:46.468196 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e51d5-c3d2-4c82-9250-3f69cf7aff62 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:46.590616 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e51d5-c3d2-4c82-9250-3f69cf7aff62 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:46.592967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:46.622107 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a73e7-737c-4e61-9d75-5650d680ecf1 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:46.634841 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29012f2-e058-45fa-b645-6167b84da32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:46.636355 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29012f2-e058-45fa-b645-6167b84da32c None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:46.636853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29012f2-e058-45fa-b645-6167b84da32c None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:46.637339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29012f2-e058-45fa-b645-6167b84da32c None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:46.638338 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29012f2-e058-45fa-b645-6167b84da32c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:46.638851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29012f2-e058-45fa-b645-6167b84da32c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:46.640542 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29012f2-e058-45fa-b645-6167b84da32c None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:46.654882 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 306/612] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:25:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:46.661936 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29012f2-e058-45fa-b645-6167b84da32c None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:46.756662 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec755db-a8b6-4312-9c18-90c57bd74d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:46.757399 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec755db-a8b6-4312-9c18-90c57bd74d05 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:46.757685 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec755db-a8b6-4312-9c18-90c57bd74d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:46.757965 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec755db-a8b6-4312-9c18-90c57bd74d05 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:46.771875 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29012f2-e058-45fa-b645-6167b84da32c None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:46.775652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec755db-a8b6-4312-9c18-90c57bd74d05 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:46.776924 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec755db-a8b6-4312-9c18-90c57bd74d05 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:46.813871 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4cc33-0ef1-4b50-bd31-8938ca5391c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:46.815150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-5ec755db-a8b6-4312-9c18-90c57bd74d05 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 09:25:46.815150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:46.815150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:46.815150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:46.815150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:46.815150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:46.815150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:46.815150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:46.815150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:46.815150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:46.815150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:46.815150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:46.815150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:25:46.815150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:25:46.815150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:25:46.815150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:25:46.816119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:46.816119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:46.816119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:25:46.816119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:46.816119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:25:46.816119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:46.816119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:46.816119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:46.816119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:46.816119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:46.816119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:46.816119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:46.816119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:46.816119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:46.816119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:46.816119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:46.816119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:46.816119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:46.817043 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:46.817043 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:46.817043 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:25:46.817043 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:25:46.817043 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:25:46.817043 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:25:46.817043 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:25:46.817043 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:25:46.817043 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 09:25:46.817043 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:46.818042 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4cc33-0ef1-4b50-bd31-8938ca5391c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:46.818542 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4cc33-0ef1-4b50-bd31-8938ca5391c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:46.819029 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4cc33-0ef1-4b50-bd31-8938ca5391c8 None admin] PATH_INFO: `/v3/projects/b1d802dc0211467fa4e709cd01d411dc/users/c1103a08484048da82c5e4627552253e/roles/5cde0d2bc9ca433b8904823fc602ab67` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:46.824842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 307/613] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:25:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 471 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:25:46.836310 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec755db-a8b6-4312-9c18-90c57bd74d05 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:46.841208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4cc33-0ef1-4b50-bd31-8938ca5391c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1d802dc0211467fa4e709cd01d411dc, user_id=c1103a08484048da82c5e4627552253e, role_id=5cde0d2bc9ca433b8904823fc602ab67)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:46.842887 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4cc33-0ef1-4b50-bd31-8938ca5391c8 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:46.874060 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 307/614] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:25:46 2022] PUT /identity/v3/projects/b1d802dc0211467fa4e709cd01d411dc/users/c1103a08484048da82c5e4627552253e/roles/5cde0d2bc9ca433b8904823fc602ab67 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:25:46.927453 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:46.955564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec755db-a8b6-4312-9c18-90c57bd74d05 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:46.994868 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a88f3-0fd5-41b5-9c8c-d9d1e192ecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:46.995590 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a88f3-0fd5-41b5-9c8c-d9d1e192ecf9 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:46.995871 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a88f3-0fd5-41b5-9c8c-d9d1e192ecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:46.996146 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a88f3-0fd5-41b5-9c8c-d9d1e192ecf9 None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:46.996993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a88f3-0fd5-41b5-9c8c-d9d1e192ecf9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:46.997302 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a88f3-0fd5-41b5-9c8c-d9d1e192ecf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:46.998772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a88f3-0fd5-41b5-9c8c-d9d1e192ecf9 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:47.019886 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 308/615] 10.222.0.41 () {56 vars in 1135 bytes} [Fri May 27 09:25:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:47.029210 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4cc33-0ef1-4b50-bd31-8938ca5391c8 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:47.044985 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd2a56-3460-4eeb-afbe-f73e7efe10e4 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:47.045310 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd2a56-3460-4eeb-afbe-f73e7efe10e4 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:47.045563 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd2a56-3460-4eeb-afbe-f73e7efe10e4 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:47.047165 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 309/616] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:47.055304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77e6c1-d6b6-46b5-aec3-46f8ba54f834 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:47.055616 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77e6c1-d6b6-46b5-aec3-46f8ba54f834 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:47.055881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77e6c1-d6b6-46b5-aec3-46f8ba54f834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:47.095717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:47.103032 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-af77e6c1-d6b6-46b5-aec3-46f8ba54f834 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:47.104308 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-af77e6c1-d6b6-46b5-aec3-46f8ba54f834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:47.155660 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4cc33-0ef1-4b50-bd31-8938ca5391c8 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:47.182074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 310/617] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:47.199019 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3995c4f-b02f-474d-b6e6-b60708686918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:47.199846 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3995c4f-b02f-474d-b6e6-b60708686918 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:47.200128 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3995c4f-b02f-474d-b6e6-b60708686918 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:47.200406 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3995c4f-b02f-474d-b6e6-b60708686918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:47.205310 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77e6c1-d6b6-46b5-aec3-46f8ba54f834 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:47.216734 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3995c4f-b02f-474d-b6e6-b60708686918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:47.218208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3995c4f-b02f-474d-b6e6-b60708686918 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:47.238091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-a3995c4f-b02f-474d-b6e6-b60708686918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:47.238091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:47.238091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:47.238091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:47.238091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:47.238091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:47.238091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:47.238091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:47.238091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:47.238091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:47.238091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:47.238091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:47.238091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:47.238091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:47.238091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:47.238999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:47.238999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:47.238999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:47.238999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:47.238999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:47.238999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:47.238999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:47.238999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:47.238999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:47.238999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:47.238999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:47.238999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:47.238999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:47.238999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:47.238999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:47.238999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:47.238999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:47.239911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:47.239911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:47.239911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:47.239911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:47.239911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 308/618] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:47.246115 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3995c4f-b02f-474d-b6e6-b60708686918 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:47.290812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:47.338005 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:47.355452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77e6c1-d6b6-46b5-aec3-46f8ba54f834 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:47.376895 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3995c4f-b02f-474d-b6e6-b60708686918 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:47.414253 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7896daa-a0c2-4888-9971-00cabd1310fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:47.415163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7896daa-a0c2-4888-9971-00cabd1310fc None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:47.415163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7896daa-a0c2-4888-9971-00cabd1310fc None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:47.415499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7896daa-a0c2-4888-9971-00cabd1310fc None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:47.416177 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7896daa-a0c2-4888-9971-00cabd1310fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:47.416482 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7896daa-a0c2-4888-9971-00cabd1310fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:47.417840 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7896daa-a0c2-4888-9971-00cabd1310fc None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:47.429703 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 309/619] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:47.432925 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730ee76-749b-44b9-8073-9702ec6334ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:47.433731 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730ee76-749b-44b9-8073-9702ec6334ea None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:47.434011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730ee76-749b-44b9-8073-9702ec6334ea None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:47.434278 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730ee76-749b-44b9-8073-9702ec6334ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:47.436447 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7896daa-a0c2-4888-9971-00cabd1310fc None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:47.457377 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730ee76-749b-44b9-8073-9702ec6334ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:47.465775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-e730ee76-749b-44b9-8073-9702ec6334ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:47.465775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:47.465775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:47.465775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:47.465775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:47.465775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:47.465775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:47.465775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:47.465775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:47.465775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:47.465775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:47.465775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:47.465775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:47.465775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:47.465775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:47.465775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:47.466690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:47.466690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:47.466690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:47.466690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:47.466690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:47.466690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:47.466690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:47.466690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:47.466690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:47.466690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:47.466690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:47.466690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:47.466690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:47.466690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:47.466690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:47.466690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:47.467525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:47.467525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:47.467525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:47.467525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:47.467525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:47.467525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:47.467525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:47.467525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:47.467525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:47.467525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:47.467525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:47.467525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:47.470261 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 311/620] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 09:25:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:25:47.476120 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730ee76-749b-44b9-8073-9702ec6334ea None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:47.543058 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7896daa-a0c2-4888-9971-00cabd1310fc None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:47.583643 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:47.591554 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583c596-866b-49f3-8f6b-1d111c7ebb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:47.592523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583c596-866b-49f3-8f6b-1d111c7ebb7d None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:47.592877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583c596-866b-49f3-8f6b-1d111c7ebb7d None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:47.593225 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583c596-866b-49f3-8f6b-1d111c7ebb7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:47.595381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730ee76-749b-44b9-8073-9702ec6334ea None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:47.600617 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583c596-866b-49f3-8f6b-1d111c7ebb7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:47.602433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583c596-866b-49f3-8f6b-1d111c7ebb7d None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:47.617993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-7583c596-866b-49f3-8f6b-1d111c7ebb7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:47.617993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:47.617993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:47.617993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:47.617993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:47.617993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:47.617993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:47.617993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:47.617993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:47.617993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:47.617993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:47.617993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:47.617993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:25:47.617993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:25:47.617993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:25:47.618943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:25:47.618943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:47.618943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:47.618943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:47.618943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:47.618943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:47.618943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:47.618943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:47.618943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:47.618943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:47.618943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:47.618943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:47.618943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:47.618943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:47.618943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:47.618943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:47.618943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:47.619864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:25:47.619864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:25:47.619864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:25:47.619864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:25:47.619864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:25:47.619864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:25:47.619864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:47.619864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:47.619864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 310/621] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:25:47.621397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4222fb-597b-452b-a887-800fe4ed6bb2 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:47.621763 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4222fb-597b-452b-a887-800fe4ed6bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:47.622156 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4222fb-597b-452b-a887-800fe4ed6bb2 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:47.628312 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 311/622] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:47.628988 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:47.630298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4222fb-597b-452b-a887-800fe4ed6bb2 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:47.639078 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb4ce4-384a-4fb8-91f7-30cbffaf8c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:47.639795 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb4ce4-384a-4fb8-91f7-30cbffaf8c6e None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:47.640084 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb4ce4-384a-4fb8-91f7-30cbffaf8c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:47.640361 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb4ce4-384a-4fb8-91f7-30cbffaf8c6e None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:47.641115 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb4ce4-384a-4fb8-91f7-30cbffaf8c6e None admin] RBAC: Adding query filter params (name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:47.641422 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb4ce4-384a-4fb8-91f7-30cbffaf8c6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:47.643305 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb4ce4-384a-4fb8-91f7-30cbffaf8c6e None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:47.654791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 312/623] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 09:25:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:47.660723 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9bf44-cef7-4f8d-9a1d-f5d43e2c104a None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:47.660723 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9bf44-cef7-4f8d-9a1d-f5d43e2c104a None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:47.660951 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9bf44-cef7-4f8d-9a1d-f5d43e2c104a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:47.681576 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-b3f9bf44-cef7-4f8d-9a1d-f5d43e2c104a None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:47.682981 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-b3f9bf44-cef7-4f8d-9a1d-f5d43e2c104a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:47.767312 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 313/624] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:47.767312 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9bf44-cef7-4f8d-9a1d-f5d43e2c104a None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:47.791787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4222fb-597b-452b-a887-800fe4ed6bb2 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:47.831086 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bc73f-eba9-48aa-876c-906500a98ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:47.832142 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bc73f-eba9-48aa-876c-906500a98ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:47.832616 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bc73f-eba9-48aa-876c-906500a98ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:47.833096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bc73f-eba9-48aa-876c-906500a98ac7 None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:47.834165 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bc73f-eba9-48aa-876c-906500a98ac7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:47.834688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bc73f-eba9-48aa-876c-906500a98ac7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:47.836432 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bc73f-eba9-48aa-876c-906500a98ac7 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:47.848871 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 312/625] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:25:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:47.849961 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bc73f-eba9-48aa-876c-906500a98ac7 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:47.880970 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9bf44-cef7-4f8d-9a1d-f5d43e2c104a None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:47.896909 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:47.903535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:47.920293 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16248712-a762-498d-8ade-80e2613a06b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:47.921348 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16248712-a762-498d-8ade-80e2613a06b7 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:47.921471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16248712-a762-498d-8ade-80e2613a06b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:47.921722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16248712-a762-498d-8ade-80e2613a06b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:47.934260 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16248712-a762-498d-8ade-80e2613a06b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:47.935767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16248712-a762-498d-8ade-80e2613a06b7 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:47.955529 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-16248712-a762-498d-8ade-80e2613a06b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:47.955529 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:47.955529 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:47.955529 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:47.955529 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:47.955529 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:47.955529 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:47.955529 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:47.955529 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:47.955529 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:47.955529 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:47.955529 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:47.955529 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:47.955529 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:47.955529 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:47.956485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:47.956485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:47.956485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:47.956485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:47.956485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:47.956485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:47.956485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:47.956485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:47.956485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:47.956485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:47.956485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:47.956485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:47.956485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:47.956485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:47.956485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:47.956485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:47.956485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:47.957350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:47.957350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:47.957350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:47.957350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:47.961476 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 314/626] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:47.962449 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16248712-a762-498d-8ade-80e2613a06b7 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:47.965864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bc73f-eba9-48aa-876c-906500a98ac7 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:48.001766 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bb879-54dc-496f-a4aa-23ce556325d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:48.003508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bb879-54dc-496f-a4aa-23ce556325d5 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:48.003989 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bb879-54dc-496f-a4aa-23ce556325d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:48.004455 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bb879-54dc-496f-a4aa-23ce556325d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:48.015363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bb879-54dc-496f-a4aa-23ce556325d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:48.023625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-b37bb879-54dc-496f-a4aa-23ce556325d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:48.023625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:48.023625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:48.023625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:48.023625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:48.023625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:48.023625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:48.023625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:48.023625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:48.023625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:48.023625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:48.023625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:48.023625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:48.023625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:48.023625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:48.023625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:48.024529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:48.024529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:48.024529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:48.024529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:48.024529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:48.024529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:48.024529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:48.024529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:48.024529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:48.024529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:48.024529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:48.024529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:48.024529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:48.024529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:48.024529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:48.024529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:48.025352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:48.025352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:48.025352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:48.025352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:48.025352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:48.025352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:48.025352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:48.025352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:48.025352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:48.025352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:48.025352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:48.025352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:48.031375 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 313/627] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 09:25:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:48.032512 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bb879-54dc-496f-a4aa-23ce556325d5 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:48.074981 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16248712-a762-498d-8ade-80e2613a06b7 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:48.113760 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4ba7a-e457-4683-8a12-9a815390a14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:48.114582 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4ba7a-e457-4683-8a12-9a815390a14c None admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:48.114865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4ba7a-e457-4683-8a12-9a815390a14c None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:48.115142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4ba7a-e457-4683-8a12-9a815390a14c None admin] PATH_INFO: `/v3/projects/b1d802dc0211467fa4e709cd01d411dc/users/351f74222d394f39bda0663e0e4ebde6/roles/5cde0d2bc9ca433b8904823fc602ab67` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:48.131148 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4ba7a-e457-4683-8a12-9a815390a14c None admin] RBAC: Authorizing `identity:create_grant(project_id=b1d802dc0211467fa4e709cd01d411dc, user_id=351f74222d394f39bda0663e0e4ebde6, role_id=5cde0d2bc9ca433b8904823fc602ab67)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:48.132641 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4ba7a-e457-4683-8a12-9a815390a14c None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:48.144863 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bb879-54dc-496f-a4aa-23ce556325d5 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:48.148280 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:48.150988 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 315/628] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:25:47 2022] PUT /identity/v3/projects/b1d802dc0211467fa4e709cd01d411dc/users/351f74222d394f39bda0663e0e4ebde6/roles/5cde0d2bc9ca433b8904823fc602ab67 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:25:48.152252 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4ba7a-e457-4683-8a12-9a815390a14c None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:48.175528 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:48.248183 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2d974-0d41-4114-96ab-ee9cebfdb7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:48.249113 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2d974-0d41-4114-96ab-ee9cebfdb7df None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:48.249241 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2d974-0d41-4114-96ab-ee9cebfdb7df None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:48.249438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2d974-0d41-4114-96ab-ee9cebfdb7df None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:48.250165 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2d974-0d41-4114-96ab-ee9cebfdb7df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:48.250477 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2d974-0d41-4114-96ab-ee9cebfdb7df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:48.251900 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2d974-0d41-4114-96ab-ee9cebfdb7df None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:48.276767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4ba7a-e457-4683-8a12-9a815390a14c None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:48.289640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 314/629] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:48.295255 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2d974-0d41-4114-96ab-ee9cebfdb7df None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:48.329608 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13435aff-b09e-40d2-9970-b5d3ac637116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:48.330783 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13435aff-b09e-40d2-9970-b5d3ac637116 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:48.331390 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13435aff-b09e-40d2-9970-b5d3ac637116 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:48.331900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13435aff-b09e-40d2-9970-b5d3ac637116 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:48.332907 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13435aff-b09e-40d2-9970-b5d3ac637116 None admin] RBAC: Adding query filter params (name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:48.333472 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13435aff-b09e-40d2-9970-b5d3ac637116 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:48.336085 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13435aff-b09e-40d2-9970-b5d3ac637116 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:48.349114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 316/630] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 09:25:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:48.355352 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13435aff-b09e-40d2-9970-b5d3ac637116 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:48.463792 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:48.482633 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13435aff-b09e-40d2-9970-b5d3ac637116 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:48.500185 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2d974-0d41-4114-96ab-ee9cebfdb7df None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:48.519592 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ab24d-e3cc-47e2-a510-c833777af593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:48.520397 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ab24d-e3cc-47e2-a510-c833777af593 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:48.520679 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ab24d-e3cc-47e2-a510-c833777af593 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:48.520953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ab24d-e3cc-47e2-a510-c833777af593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:48.531791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ab24d-e3cc-47e2-a510-c833777af593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:48.533290 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ab24d-e3cc-47e2-a510-c833777af593 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:48.546174 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d395f4e-24c0-470e-b8e4-514cf5257472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:48.547321 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d395f4e-24c0-470e-b8e4-514cf5257472 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:48.547831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d395f4e-24c0-470e-b8e4-514cf5257472 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:48.548307 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d395f4e-24c0-470e-b8e4-514cf5257472 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:48.552233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-b74ab24d-e3cc-47e2-a510-c833777af593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:48.552233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:48.552233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:48.552233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:48.552233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:48.552233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:48.552233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:48.552233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:48.552233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:48.552233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:48.552233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:48.552233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:48.552233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:48.552233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:48.552233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:48.553082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:48.553082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:48.553082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:48.553082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:48.553082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:48.553082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:48.553082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:48.553082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:48.553082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:48.553082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:48.553082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:48.553082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:48.553082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:48.553082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:48.553082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:48.553082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:48.553082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:48.553946 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:48.553946 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:48.553946 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:48.553946 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:48.553946 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 317/631] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:48.559013 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d395f4e-24c0-470e-b8e4-514cf5257472 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:48.559142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ab24d-e3cc-47e2-a510-c833777af593 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:48.560846 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d395f4e-24c0-470e-b8e4-514cf5257472 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:48.585541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-5d395f4e-24c0-470e-b8e4-514cf5257472 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 09:25:48.585541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:48.585541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:48.585541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:48.585541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:48.585541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:48.585541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:48.585541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:48.585541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:48.585541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:48.585541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:48.585541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:48.585541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:25:48.585541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:25:48.585541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:25:48.585541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:25:48.586557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:48.586557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:48.586557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:25:48.586557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:48.586557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:25:48.586557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:48.586557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:48.586557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:48.586557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:48.586557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:48.586557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:48.586557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:48.586557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:48.586557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:48.586557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:48.586557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:48.586557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:48.586557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:48.587540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:48.587540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:48.587540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:25:48.587540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:25:48.587540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:25:48.587540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:25:48.587540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:25:48.587540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:25:48.587540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 09:25:48.587540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:48.593045 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 315/632] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:48.594172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d395f4e-24c0-470e-b8e4-514cf5257472 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:48.621206 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:48.675360 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ab24d-e3cc-47e2-a510-c833777af593 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:48.702735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d395f4e-24c0-470e-b8e4-514cf5257472 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:48.714758 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44284ce0-fb42-4591-b053-13e6057ec310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:48.715562 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44284ce0-fb42-4591-b053-13e6057ec310 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:48.715984 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44284ce0-fb42-4591-b053-13e6057ec310 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:48.716482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44284ce0-fb42-4591-b053-13e6057ec310 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:48.717278 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:48.718238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44284ce0-fb42-4591-b053-13e6057ec310 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:48.718689 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44284ce0-fb42-4591-b053-13e6057ec310 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:48.720340 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44284ce0-fb42-4591-b053-13e6057ec310 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:48.739962 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 318/633] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:48.741867 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfacfa-d039-4c0d-8edf-85e641d481f1 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:48.742257 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfacfa-d039-4c0d-8edf-85e641d481f1 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:48.742596 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfacfa-d039-4c0d-8edf-85e641d481f1 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:48.748662 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 319/634] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:48.748662 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfacfa-d039-4c0d-8edf-85e641d481f1 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:48.749660 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad59ec3-7af8-4235-919f-9b1963e136ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:48.750551 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad59ec3-7af8-4235-919f-9b1963e136ce None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:48.751004 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad59ec3-7af8-4235-919f-9b1963e136ce None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:48.751491 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad59ec3-7af8-4235-919f-9b1963e136ce None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:48.752530 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad59ec3-7af8-4235-919f-9b1963e136ce None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:48.753136 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad59ec3-7af8-4235-919f-9b1963e136ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:48.754749 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad59ec3-7af8-4235-919f-9b1963e136ce None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:48.776975 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 316/635] 10.222.0.41 () {56 vars in 1137 bytes} [Fri May 27 09:25:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:48.782891 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfd88a-23a5-4cf1-abfb-737a51ac2597 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:48.783449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfd88a-23a5-4cf1-abfb-737a51ac2597 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:48.783949 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfd88a-23a5-4cf1-abfb-737a51ac2597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:48.801851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-80bfd88a-23a5-4cf1-abfb-737a51ac2597 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:48.803357 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-80bfd88a-23a5-4cf1-abfb-737a51ac2597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:48.860942 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfacfa-d039-4c0d-8edf-85e641d481f1 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:48.877578 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 317/636] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:48.879312 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfd88a-23a5-4cf1-abfb-737a51ac2597 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:48.894743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:48.912550 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44719ce3-74db-4b01-b309-3d93703f052c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:48.913344 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44719ce3-74db-4b01-b309-3d93703f052c None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:48.913646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44719ce3-74db-4b01-b309-3d93703f052c None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:48.914320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44719ce3-74db-4b01-b309-3d93703f052c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:48.922367 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44719ce3-74db-4b01-b309-3d93703f052c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:48.925113 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44719ce3-74db-4b01-b309-3d93703f052c None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:48.945071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-44719ce3-74db-4b01-b309-3d93703f052c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:25:48.945071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:48.945071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:48.945071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:48.945071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:48.945071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:48.945071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:48.945071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:48.945071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:48.945071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:48.945071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:48.945071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:48.945071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:25:48.945071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:25:48.945071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:25:48.945071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:25:48.946070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:48.946070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:48.946070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:25:48.946070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:48.946070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:25:48.946070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:48.946070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:48.946070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:48.946070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:48.946070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:48.946070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:48.946070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:48.946070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:48.946070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:48.946070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:48.946070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:48.946070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:48.946070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:48.947025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:48.947025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:48.947025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:25:48.947025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:25:48.947025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:25:48.947025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:25:48.947025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:25:48.947025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:25:48.947025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:25:48.947025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:48.947025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 320/637] 10.222.0.41 () {56 vars in 1093 bytes} [Fri May 27 09:25:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:48.951648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44719ce3-74db-4b01-b309-3d93703f052c None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:49.009812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfd88a-23a5-4cf1-abfb-737a51ac2597 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:49.022959 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:49.053500 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447de92-300f-47cd-93dc-96f5911ead9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:49.054519 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447de92-300f-47cd-93dc-96f5911ead9c None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:49.055005 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447de92-300f-47cd-93dc-96f5911ead9c None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:49.055501 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447de92-300f-47cd-93dc-96f5911ead9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:49.097163 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44719ce3-74db-4b01-b309-3d93703f052c None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:49.138411 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447de92-300f-47cd-93dc-96f5911ead9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:49.140282 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447de92-300f-47cd-93dc-96f5911ead9c None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:49.145162 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45098e24-0cd9-4c34-8a2a-20a9916cb13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:49.145960 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45098e24-0cd9-4c34-8a2a-20a9916cb13b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:49.146241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45098e24-0cd9-4c34-8a2a-20a9916cb13b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:49.146512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45098e24-0cd9-4c34-8a2a-20a9916cb13b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:49.157170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:49.161558 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45098e24-0cd9-4c34-8a2a-20a9916cb13b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:49.172383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-45098e24-0cd9-4c34-8a2a-20a9916cb13b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:49.172383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:49.172383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:49.172383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:49.172383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:49.172383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:49.172383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:49.172383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:49.172383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:49.172383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:49.172383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:49.172383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:49.172383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:49.172383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:49.172383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:49.172383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:49.173355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:49.173355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:49.173355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:49.173355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:49.173355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:49.173355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:49.173355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:49.173355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:49.173355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:49.173355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:49.173355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:49.173355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:49.173355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:49.173355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:49.173355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:49.173355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:49.174187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:49.174187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:49.174187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:49.174187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:49.174187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:49.174187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:49.174187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:49.174187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:49.174187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:49.174187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:49.174187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:49.174187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:49.179318 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 321/638] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 09:25:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:49.180465 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45098e24-0cd9-4c34-8a2a-20a9916cb13b None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:49.269442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 318/639] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:25:49.269442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447de92-300f-47cd-93dc-96f5911ead9c None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:49.359180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45098e24-0cd9-4c34-8a2a-20a9916cb13b None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:49.374052 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:49.407190 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447de92-300f-47cd-93dc-96f5911ead9c None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:49.408588 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2eb968-2598-4cba-9a3f-0bd9641023fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:49.409463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eb968-2598-4cba-9a3f-0bd9641023fa None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:49.409912 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eb968-2598-4cba-9a3f-0bd9641023fa None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:49.410345 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eb968-2598-4cba-9a3f-0bd9641023fa None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:49.411350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2eb968-2598-4cba-9a3f-0bd9641023fa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:49.411831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2eb968-2598-4cba-9a3f-0bd9641023fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:49.413437 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2eb968-2598-4cba-9a3f-0bd9641023fa None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:49.441064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:49.446585 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 322/640] 10.222.0.41 () {56 vars in 1133 bytes} [Fri May 27 09:25:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:49.448955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2eb968-2598-4cba-9a3f-0bd9641023fa None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:49.479333 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6adb48-506b-4213-932b-48da7207d538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:49.480375 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6adb48-506b-4213-932b-48da7207d538 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:49.481010 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6adb48-506b-4213-932b-48da7207d538 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:49.481486 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6adb48-506b-4213-932b-48da7207d538 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:49.482495 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6adb48-506b-4213-932b-48da7207d538 None admin] RBAC: Adding query filter params (name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:49.483004 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6adb48-506b-4213-932b-48da7207d538 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:49.484981 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6adb48-506b-4213-932b-48da7207d538 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:49.495609 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 319/641] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 09:25:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:49.497108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6adb48-506b-4213-932b-48da7207d538 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:49.581966 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2eb968-2598-4cba-9a3f-0bd9641023fa None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:49.616245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6adb48-506b-4213-932b-48da7207d538 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:49.622192 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecfdf3-2cf2-4a43-95f2-d645f6b16b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:49.623047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecfdf3-2cf2-4a43-95f2-d645f6b16b52 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:49.623363 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecfdf3-2cf2-4a43-95f2-d645f6b16b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:49.623648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecfdf3-2cf2-4a43-95f2-d645f6b16b52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:49.638049 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecfdf3-2cf2-4a43-95f2-d645f6b16b52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:49.639533 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecfdf3-2cf2-4a43-95f2-d645f6b16b52 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:49.662808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-9cecfdf3-2cf2-4a43-95f2-d645f6b16b52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:49.662808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:49.662808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:49.662808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:49.662808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:49.662808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:49.662808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:49.662808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:49.662808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:49.662808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:49.662808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:49.662808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:49.662808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:49.662808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:49.662808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:49.663844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:49.663844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:49.663844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:49.663844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:49.663844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:49.663844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:49.663844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:49.663844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:49.663844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:49.663844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:49.663844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:49.663844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:49.663844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:49.663844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:49.663844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:49.663844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:49.663844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:49.664725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:49.664725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:49.664725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:49.664725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:49.667246 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e40525-4002-4e9e-a141-1e605028659b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:49.667933 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e40525-4002-4e9e-a141-1e605028659b None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:49.668219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e40525-4002-4e9e-a141-1e605028659b None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:49.668496 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e40525-4002-4e9e-a141-1e605028659b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:49.671387 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 323/642] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:49.672706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e620b-dfe6-45f7-8204-aad70ec04976 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:49.672999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e620b-dfe6-45f7-8204-aad70ec04976 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:49.673332 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e620b-dfe6-45f7-8204-aad70ec04976 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:49.675511 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 324/643] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:49.676243 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e620b-dfe6-45f7-8204-aad70ec04976 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:49.698376 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:49.726778 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:49.765095 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e40525-4002-4e9e-a141-1e605028659b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:49.768184 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e40525-4002-4e9e-a141-1e605028659b None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:49.807342 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e620b-dfe6-45f7-8204-aad70ec04976 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:49.843767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe57776-37f1-4b3c-ab62-312098376929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:49.844480 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe57776-37f1-4b3c-ab62-312098376929 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:49.844768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe57776-37f1-4b3c-ab62-312098376929 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:49.845046 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe57776-37f1-4b3c-ab62-312098376929 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:49.855412 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe57776-37f1-4b3c-ab62-312098376929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:49.856890 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe57776-37f1-4b3c-ab62-312098376929 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:49.875737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-4fe57776-37f1-4b3c-ab62-312098376929 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:49.875737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:49.875737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:49.875737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:49.875737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:49.875737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:49.875737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:49.875737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:49.875737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:49.875737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:49.875737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:49.875737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:49.875737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:49.875737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:49.875737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:49.876648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:49.876648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:49.876648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:49.876648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:49.876648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:49.876648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:49.876648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:49.876648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:49.876648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:49.876648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:49.876648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:49.876648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:49.876648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:49.876648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:49.876648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:49.876648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:49.876648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:49.885742 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:49.885742 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:49.885742 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:49.885742 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:49.886018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 320/645] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:25:49.886117 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 325/645] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:49.886205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e40525-4002-4e9e-a141-1e605028659b None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:49.886285 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc546cb4-de8c-4a1c-964f-ee8b4348bce1 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:49.886285 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc546cb4-de8c-4a1c-964f-ee8b4348bce1 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:49.886285 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc546cb4-de8c-4a1c-964f-ee8b4348bce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:49.901202 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-fc546cb4-de8c-4a1c-964f-ee8b4348bce1 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:49.902525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-fc546cb4-de8c-4a1c-964f-ee8b4348bce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:49.965705 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:49.983415 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 326/646] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:49.984404 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc546cb4-de8c-4a1c-964f-ee8b4348bce1 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:49.988685 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:49.993199 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e40525-4002-4e9e-a141-1e605028659b None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:50.030797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fcacf-be37-4237-b776-7ba76767628c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:50.031855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fcacf-be37-4237-b776-7ba76767628c None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:50.032145 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fcacf-be37-4237-b776-7ba76767628c None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:50.032420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fcacf-be37-4237-b776-7ba76767628c None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:50.033142 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fcacf-be37-4237-b776-7ba76767628c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:50.033466 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fcacf-be37-4237-b776-7ba76767628c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:50.035523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fcacf-be37-4237-b776-7ba76767628c None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:50.047253 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 321/647] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:50.048278 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fcacf-be37-4237-b776-7ba76767628c None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:50.105220 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc546cb4-de8c-4a1c-964f-ee8b4348bce1 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:50.139755 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d48557-0497-4894-897e-54e7a3a11216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:50.140552 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d48557-0497-4894-897e-54e7a3a11216 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:50.140831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d48557-0497-4894-897e-54e7a3a11216 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:50.141120 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d48557-0497-4894-897e-54e7a3a11216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:50.151590 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d48557-0497-4894-897e-54e7a3a11216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:50.153061 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d48557-0497-4894-897e-54e7a3a11216 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:50.158749 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fcacf-be37-4237-b776-7ba76767628c None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:50.170452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-46d48557-0497-4894-897e-54e7a3a11216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:50.170452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:50.170452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:50.170452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:50.170452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:50.170452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:50.170452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:50.170452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:50.170452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:50.170452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:50.170452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:50.170452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:50.170452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:50.170452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:50.170452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:50.171379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:50.171379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:50.171379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:50.171379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:50.171379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:50.171379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:50.171379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:50.171379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:50.171379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:50.171379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:50.171379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:50.171379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:50.171379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:50.171379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:50.171379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:50.171379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:50.171379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:50.172255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:50.172255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:50.172255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:50.172255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:50.172255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 327/648] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:50.172543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d48557-0497-4894-897e-54e7a3a11216 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:50.197085 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ea8e8-21f6-4767-88ef-578db650acf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:50.198135 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ea8e8-21f6-4767-88ef-578db650acf2 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:50.198606 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ea8e8-21f6-4767-88ef-578db650acf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:50.199033 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ea8e8-21f6-4767-88ef-578db650acf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:50.200057 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ea8e8-21f6-4767-88ef-578db650acf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:50.200368 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ea8e8-21f6-4767-88ef-578db650acf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:50.201846 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ea8e8-21f6-4767-88ef-578db650acf2 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:50.203491 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:50.218773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 322/649] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:50.218773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ea8e8-21f6-4767-88ef-578db650acf2 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:50.240278 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:50.288013 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d48557-0497-4894-897e-54e7a3a11216 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:50.325018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ea8e8-21f6-4767-88ef-578db650acf2 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:50.328628 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bf988-7f14-4dde-ba02-2e7b9c96f462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:50.329482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bf988-7f14-4dde-ba02-2e7b9c96f462 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:50.329766 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bf988-7f14-4dde-ba02-2e7b9c96f462 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:50.330168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bf988-7f14-4dde-ba02-2e7b9c96f462 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:50.340904 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bf988-7f14-4dde-ba02-2e7b9c96f462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:50.349180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-1b7bf988-7f14-4dde-ba02-2e7b9c96f462 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:50.349180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:50.349180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:50.349180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:50.349180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:50.349180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:50.349180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:50.349180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:50.349180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:50.349180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:50.349180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:50.349180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:50.349180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:50.349180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:50.349180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:50.349180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:50.350065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:50.350065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:50.350065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:50.350065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:50.350065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:50.350065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:50.350065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:50.350065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:50.350065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:50.350065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:50.350065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:50.350065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:50.350065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:50.350065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:50.350065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:50.350065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:50.350885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:50.350885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:50.350885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:50.350885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:50.350885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:50.350885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:50.350885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:50.350885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:50.350885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:50.350885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:50.350885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:50.350885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:50.350885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 328/650] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 09:25:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:50.352363 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bf988-7f14-4dde-ba02-2e7b9c96f462 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:50.363506 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36abb4-0f22-479c-a10e-414c5aef40e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:50.364234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36abb4-0f22-479c-a10e-414c5aef40e3 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:50.364514 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36abb4-0f22-479c-a10e-414c5aef40e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:50.364785 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36abb4-0f22-479c-a10e-414c5aef40e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:50.371913 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36abb4-0f22-479c-a10e-414c5aef40e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:50.373334 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36abb4-0f22-479c-a10e-414c5aef40e3 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:50.390642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-7a36abb4-0f22-479c-a10e-414c5aef40e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:50.390642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:50.390642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:50.390642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:50.390642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:50.390642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:50.390642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:50.390642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:50.390642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:50.390642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:50.390642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:50.390642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:50.390642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:25:50.390642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:25:50.390642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:25:50.392654 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:25:50.392654 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:50.392654 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:50.392654 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:50.392654 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:50.392654 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:50.392654 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:50.392654 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:50.392654 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:50.392654 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:50.392654 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:50.392654 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:50.392654 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:50.392654 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:50.392654 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:50.392654 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:50.392654 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:50.393604 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:25:50.393604 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:25:50.393604 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:25:50.393604 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:25:50.393604 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:25:50.393604 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:25:50.393604 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:50.393604 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:50.393604 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 323/651] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:50.393604 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36abb4-0f22-479c-a10e-414c5aef40e3 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:50.454937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:50.468391 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bf988-7f14-4dde-ba02-2e7b9c96f462 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:50.483442 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:50.506013 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36abb4-0f22-479c-a10e-414c5aef40e3 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:50.506908 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a423905-969a-45bf-8d45-b36cefe3eab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:50.507605 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a423905-969a-45bf-8d45-b36cefe3eab9 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:50.507890 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a423905-969a-45bf-8d45-b36cefe3eab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:50.508162 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a423905-969a-45bf-8d45-b36cefe3eab9 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:50.508887 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a423905-969a-45bf-8d45-b36cefe3eab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:50.509193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a423905-969a-45bf-8d45-b36cefe3eab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:50.510560 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a423905-969a-45bf-8d45-b36cefe3eab9 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:50.527079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 329/652] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:50.527079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a423905-969a-45bf-8d45-b36cefe3eab9 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:50.546359 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda3f34-3616-4545-aba3-83b66ca1ee0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:50.547213 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda3f34-3616-4545-aba3-83b66ca1ee0a None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:50.547526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda3f34-3616-4545-aba3-83b66ca1ee0a None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:50.547802 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda3f34-3616-4545-aba3-83b66ca1ee0a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:50.556990 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda3f34-3616-4545-aba3-83b66ca1ee0a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:50.558582 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda3f34-3616-4545-aba3-83b66ca1ee0a None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:50.573264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-6dda3f34-3616-4545-aba3-83b66ca1ee0a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 09:25:50.573264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:50.573264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:50.573264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:50.573264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:50.573264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:50.573264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:50.573264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:50.573264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:50.573264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:50.573264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:50.573264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:50.573264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:25:50.573264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:25:50.573264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:25:50.573264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:25:50.574205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:50.574205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:50.574205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:25:50.574205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:50.574205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:25:50.574205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:50.574205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:50.574205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:50.574205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:50.574205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:50.574205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:50.574205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:50.574205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:50.574205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:50.574205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:50.574205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:50.574205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:50.574205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:50.575147 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:50.575147 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:50.575147 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:25:50.575147 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:25:50.575147 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:25:50.575147 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:25:50.575147 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:25:50.575147 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:25:50.575147 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 09:25:50.575147 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:50.575147 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 324/653] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:50.576290 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda3f34-3616-4545-aba3-83b66ca1ee0a None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:50.629363 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a423905-969a-45bf-8d45-b36cefe3eab9 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:50.663293 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf1971-841c-48ec-af9c-f52d1cd139cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:50.663976 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf1971-841c-48ec-af9c-f52d1cd139cd None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:50.664264 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf1971-841c-48ec-af9c-f52d1cd139cd None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:50.664547 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf1971-841c-48ec-af9c-f52d1cd139cd None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:50.665287 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf1971-841c-48ec-af9c-f52d1cd139cd None admin] RBAC: Adding query filter params (name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:50.665599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf1971-841c-48ec-af9c-f52d1cd139cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:50.667035 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf1971-841c-48ec-af9c-f52d1cd139cd None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:50.673153 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda3f34-3616-4545-aba3-83b66ca1ee0a None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:50.675735 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 330/654] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 09:25:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:50.676517 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf1971-841c-48ec-af9c-f52d1cd139cd None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:50.691792 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:50.710741 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:50.712926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1231c-c78d-41a3-ab79-4d8ad6ed1b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:50.713629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1231c-c78d-41a3-ab79-4d8ad6ed1b7c None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:50.713915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1231c-c78d-41a3-ab79-4d8ad6ed1b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:50.714249 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1231c-c78d-41a3-ab79-4d8ad6ed1b7c None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:50.714980 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1231c-c78d-41a3-ab79-4d8ad6ed1b7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:50.715319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1231c-c78d-41a3-ab79-4d8ad6ed1b7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:50.716739 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1231c-c78d-41a3-ab79-4d8ad6ed1b7c None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:50.729255 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 325/655] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:25:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:50.729919 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1231c-c78d-41a3-ab79-4d8ad6ed1b7c None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:50.774199 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf1971-841c-48ec-af9c-f52d1cd139cd None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:50.807144 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be51519-2dc1-4361-be7b-5d5dada69cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:50.807979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be51519-2dc1-4361-be7b-5d5dada69cbd None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:50.808261 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be51519-2dc1-4361-be7b-5d5dada69cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:50.808528 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be51519-2dc1-4361-be7b-5d5dada69cbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:50.815147 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be51519-2dc1-4361-be7b-5d5dada69cbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:50.816635 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be51519-2dc1-4361-be7b-5d5dada69cbd None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:50.828329 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1231c-c78d-41a3-ab79-4d8ad6ed1b7c None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:50.830461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-7be51519-2dc1-4361-be7b-5d5dada69cbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:50.830461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:50.830461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:50.830461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:50.830461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:50.830461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:50.830461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:50.830461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:50.830461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:50.830461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:50.830461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:50.830461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:50.830461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:25:50.830461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:25:50.830461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:25:50.832057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:25:50.832057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:50.832057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:50.832057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:50.832057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:50.832057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:50.832057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:50.832057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:50.832057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:50.832057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:50.832057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:50.832057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:50.832057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:50.832057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:50.832057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:50.832057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:50.832057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:50.832930 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:25:50.832930 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:25:50.832930 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:25:50.832930 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:25:50.832930 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:25:50.832930 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:25:50.832930 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:50.832930 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:50.832930 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 331/656] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:50.833793 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c35430-9073-452d-ae20-c651edb87a23 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:50.833899 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c35430-9073-452d-ae20-c651edb87a23 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:50.834110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c35430-9073-452d-ae20-c651edb87a23 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:50.835501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 332/657] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:50.837614 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c35430-9073-452d-ae20-c651edb87a23 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:50.864796 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd7071-3d4f-4672-ac96-71d5cf8eef05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:50.865468 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd7071-3d4f-4672-ac96-71d5cf8eef05 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:50.865752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd7071-3d4f-4672-ac96-71d5cf8eef05 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:50.866031 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd7071-3d4f-4672-ac96-71d5cf8eef05 None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:50.866884 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd7071-3d4f-4672-ac96-71d5cf8eef05 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:50.867367 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd7071-3d4f-4672-ac96-71d5cf8eef05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:50.868969 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd7071-3d4f-4672-ac96-71d5cf8eef05 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:50.885787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 326/658] 10.222.0.41 () {56 vars in 1137 bytes} [Fri May 27 09:25:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:50.886510 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd7071-3d4f-4672-ac96-71d5cf8eef05 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:50.919300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:50.943490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:50.950718 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c35430-9073-452d-ae20-c651edb87a23 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:50.984549 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398fb62-ce50-418e-9f88-6d469876f19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:50.985584 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398fb62-ce50-418e-9f88-6d469876f19f None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:50.985862 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398fb62-ce50-418e-9f88-6d469876f19f None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:50.986131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398fb62-ce50-418e-9f88-6d469876f19f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:50.986821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd7071-3d4f-4672-ac96-71d5cf8eef05 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:50.996025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398fb62-ce50-418e-9f88-6d469876f19f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:50.997469 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398fb62-ce50-418e-9f88-6d469876f19f None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:51.014827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-b398fb62-ce50-418e-9f88-6d469876f19f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:51.014827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:51.014827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:51.014827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:51.014827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:51.014827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:51.014827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:51.014827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:51.014827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:51.014827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:51.014827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:51.014827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:51.014827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:51.014827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:51.014827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:51.015921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:51.015921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:51.015921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:51.015921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:51.015921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:51.015921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:51.015921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:51.015921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:51.015921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:51.015921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:51.015921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:51.015921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:51.015921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:51.015921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:51.015921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:51.015921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:51.015921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:51.016790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:51.016790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:51.016790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:51.016790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:51.016790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 333/659] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:51.016790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398fb62-ce50-418e-9f88-6d469876f19f None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:51.024766 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d902fef-91b0-4e42-80b0-4238897ae0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:51.025417 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d902fef-91b0-4e42-80b0-4238897ae0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:51.025713 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d902fef-91b0-4e42-80b0-4238897ae0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:51.025965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d902fef-91b0-4e42-80b0-4238897ae0d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:51.026778 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d902fef-91b0-4e42-80b0-4238897ae0d3 None admin] RBAC: Adding query filter params (role.id=5cde0d2bc9ca433b8904823fc602ab67, scope.project.id=b1d802dc0211467fa4e709cd01d411dc, user.id=192c3d179fdb43c9885f637446c83a89) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:51.027086 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d902fef-91b0-4e42-80b0-4238897ae0d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:51.028537 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d902fef-91b0-4e42-80b0-4238897ae0d3 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:51.043491 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 327/660] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:25:50 2022] GET /identity/v3/role_assignments?user.id=192c3d179fdb43c9885f637446c83a89&scope.project.id=b1d802dc0211467fa4e709cd01d411dc&role.id=5cde0d2bc9ca433b8904823fc602ab67 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:51.045661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee1942-2b64-4e47-9b22-d5a0a5d86beb None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:51.045959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee1942-2b64-4e47-9b22-d5a0a5d86beb None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:51.046387 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee1942-2b64-4e47-9b22-d5a0a5d86beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:51.063987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-c3ee1942-2b64-4e47-9b22-d5a0a5d86beb None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:51.065746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-c3ee1942-2b64-4e47-9b22-d5a0a5d86beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:51.136588 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398fb62-ce50-418e-9f88-6d469876f19f None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:51.151317 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 328/661] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:51.151317 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee1942-2b64-4e47-9b22-d5a0a5d86beb None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:51.174857 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26130bad-7ec1-41fb-a702-f4d85d23fa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:51.175575 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26130bad-7ec1-41fb-a702-f4d85d23fa69 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:51.175862 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26130bad-7ec1-41fb-a702-f4d85d23fa69 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:51.176138 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26130bad-7ec1-41fb-a702-f4d85d23fa69 None admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:51.177089 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26130bad-7ec1-41fb-a702-f4d85d23fa69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:51.177313 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26130bad-7ec1-41fb-a702-f4d85d23fa69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:51.178732 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26130bad-7ec1-41fb-a702-f4d85d23fa69 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:51.183725 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:51.193093 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 334/662] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:25:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:51.193787 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26130bad-7ec1-41fb-a702-f4d85d23fa69 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:51.206660 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:51.275662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee1942-2b64-4e47-9b22-d5a0a5d86beb None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:51.310103 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe976f04-ae5f-4280-889a-b7a36ea6fda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:51.310762 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe976f04-ae5f-4280-889a-b7a36ea6fda5 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:51.311048 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe976f04-ae5f-4280-889a-b7a36ea6fda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:51.311351 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe976f04-ae5f-4280-889a-b7a36ea6fda5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:51.313631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26130bad-7ec1-41fb-a702-f4d85d23fa69 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:51.348970 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9353d1-55b4-4fdc-adf1-0ba13e09e3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:51.349641 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9353d1-55b4-4fdc-adf1-0ba13e09e3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:51.349926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9353d1-55b4-4fdc-adf1-0ba13e09e3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:51.350203 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9353d1-55b4-4fdc-adf1-0ba13e09e3b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:51.350925 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9353d1-55b4-4fdc-adf1-0ba13e09e3b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:51.351234 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9353d1-55b4-4fdc-adf1-0ba13e09e3b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:51.352640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9353d1-55b4-4fdc-adf1-0ba13e09e3b2 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:51.369043 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 335/663] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:51.369043 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9353d1-55b4-4fdc-adf1-0ba13e09e3b2 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:51.386018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe976f04-ae5f-4280-889a-b7a36ea6fda5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:51.387568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe976f04-ae5f-4280-889a-b7a36ea6fda5 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:51.417696 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:51.448041 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:51.484165 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9353d1-55b4-4fdc-adf1-0ba13e09e3b2 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:51.499049 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 329/664] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:25:51.499049 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe976f04-ae5f-4280-889a-b7a36ea6fda5 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:51.525537 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6168bbf-b110-48e0-8a95-8646db9450cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:51.526440 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6168bbf-b110-48e0-8a95-8646db9450cf None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:51.526720 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6168bbf-b110-48e0-8a95-8646db9450cf None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:51.526998 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6168bbf-b110-48e0-8a95-8646db9450cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:51.538616 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6168bbf-b110-48e0-8a95-8646db9450cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:51.546774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-c6168bbf-b110-48e0-8a95-8646db9450cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:51.546774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:51.546774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:51.546774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:51.546774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:51.546774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:51.546774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:51.546774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:51.546774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:51.546774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:51.546774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:51.546774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:51.546774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:51.546774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:51.546774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:51.546774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:51.547715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:51.547715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:51.547715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:51.547715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:51.547715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:51.547715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:51.547715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:51.547715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:51.547715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:51.547715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:51.547715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:51.547715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:51.547715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:51.547715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:51.547715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:51.547715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:51.548548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:51.548548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:51.548548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:51.548548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:51.548548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:51.548548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:51.548548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:51.548548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:51.548548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:51.548548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:51.548548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:25:51.548548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:51.548548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 336/665] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 09:25:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:51.549233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6168bbf-b110-48e0-8a95-8646db9450cf None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:51.601056 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe976f04-ae5f-4280-889a-b7a36ea6fda5 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:51.629171 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:51.638282 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58888a0d-4ee4-4521-b12e-a2e8532b9d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:51.638871 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58888a0d-4ee4-4521-b12e-a2e8532b9d8a None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:51.639151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58888a0d-4ee4-4521-b12e-a2e8532b9d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:51.639517 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58888a0d-4ee4-4521-b12e-a2e8532b9d8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:51.640340 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58888a0d-4ee4-4521-b12e-a2e8532b9d8a None admin] RBAC: Adding query filter params (role.id=5cde0d2bc9ca433b8904823fc602ab67, scope.project.id=b1d802dc0211467fa4e709cd01d411dc, user.id=d2b1c12e88c549208894fc0dd0c60b88) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:51.640649 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58888a0d-4ee4-4521-b12e-a2e8532b9d8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:51.642065 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58888a0d-4ee4-4521-b12e-a2e8532b9d8a None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:51.655317 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 330/666] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:25:51 2022] GET /identity/v3/role_assignments?user.id=d2b1c12e88c549208894fc0dd0c60b88&scope.project.id=b1d802dc0211467fa4e709cd01d411dc&role.id=5cde0d2bc9ca433b8904823fc602ab67 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:51.655317 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58888a0d-4ee4-4521-b12e-a2e8532b9d8a None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:51.666678 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6168bbf-b110-48e0-8a95-8646db9450cf None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:51.698847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:51.706345 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f3855-322b-4921-a5ba-745540f47e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:51.707172 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f3855-322b-4921-a5ba-745540f47e2b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:51.707483 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f3855-322b-4921-a5ba-745540f47e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:51.707757 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f3855-322b-4921-a5ba-745540f47e2b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:51.717193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f3855-322b-4921-a5ba-745540f47e2b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:51.719097 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f3855-322b-4921-a5ba-745540f47e2b None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:51.735452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-7f8f3855-322b-4921-a5ba-745540f47e2b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 09:25:51.735452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:51.735452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:51.735452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:51.735452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:51.735452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:51.735452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:51.735452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:51.735452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:51.735452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:51.735452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:51.735452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:51.735452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:25:51.735452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:25:51.735452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:25:51.735452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:25:51.736467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:51.736467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:51.736467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:25:51.736467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:51.736467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:25:51.736467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:51.736467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:51.736467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:51.736467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:51.736467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:51.736467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:51.736467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:51.736467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:51.736467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:51.736467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:51.736467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:51.736467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:51.736467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:51.737940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:51.737940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:51.737940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:25:51.737940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:25:51.737940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:25:51.737940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:25:51.737940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:25:51.737940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:25:51.737940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 09:25:51.737940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:51.745146 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 337/667] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 09:25:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:51.746449 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f3855-322b-4921-a5ba-745540f47e2b None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:51.782856 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58888a0d-4ee4-4521-b12e-a2e8532b9d8a None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:51.823052 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224000d-0895-4c10-bd5b-696a4a76e13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:51.823814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224000d-0895-4c10-bd5b-696a4a76e13e None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:51.824094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224000d-0895-4c10-bd5b-696a4a76e13e None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:51.824366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224000d-0895-4c10-bd5b-696a4a76e13e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:51.836552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224000d-0895-4c10-bd5b-696a4a76e13e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:51.838086 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224000d-0895-4c10-bd5b-696a4a76e13e None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:51.858473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-5224000d-0895-4c10-bd5b-696a4a76e13e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:51.858473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:51.858473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:51.858473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:51.858473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:51.858473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:51.858473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:51.858473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:51.858473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:51.858473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:51.858473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:51.858473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:51.858473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:51.858473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:51.858473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:51.859862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:51.859862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:51.859862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:51.859862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:51.859862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:51.859862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:51.859862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:51.859862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:51.859862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:51.859862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:51.859862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:51.859862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:51.859862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:51.859862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:51.859862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:51.859862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:51.859862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:51.860735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:51.860735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:51.860735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:51.860735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:51.864086 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 331/668] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:51.864425 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224000d-0895-4c10-bd5b-696a4a76e13e None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:51.864919 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f3855-322b-4921-a5ba-745540f47e2b None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:51.911739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a1dfd-98d5-4ee7-8d1c-c667c5400ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:51.912669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a1dfd-98d5-4ee7-8d1c-c667c5400ebd None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:51.913096 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a1dfd-98d5-4ee7-8d1c-c667c5400ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:51.913516 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a1dfd-98d5-4ee7-8d1c-c667c5400ebd None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:51.914403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a1dfd-98d5-4ee7-8d1c-c667c5400ebd None admin] RBAC: Adding query filter params (name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:51.914866 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a1dfd-98d5-4ee7-8d1c-c667c5400ebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:51.916201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:51.916480 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a1dfd-98d5-4ee7-8d1c-c667c5400ebd None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:51.931317 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 338/669] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 09:25:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:51.931317 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a1dfd-98d5-4ee7-8d1c-c667c5400ebd None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:51.994611 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224000d-0895-4c10-bd5b-696a4a76e13e None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:51.995121 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:52.052433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a1dfd-98d5-4ee7-8d1c-c667c5400ebd None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:52.056975 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c386e-ffb3-49fc-b669-2b007616a84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:52.057772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c386e-ffb3-49fc-b669-2b007616a84e None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:52.058156 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c386e-ffb3-49fc-b669-2b007616a84e None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:52.058538 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c386e-ffb3-49fc-b669-2b007616a84e None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:52.059506 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c386e-ffb3-49fc-b669-2b007616a84e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:52.060492 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c386e-ffb3-49fc-b669-2b007616a84e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:52.062522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c386e-ffb3-49fc-b669-2b007616a84e None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:52.087365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 332/670] 10.222.0.41 () {56 vars in 1139 bytes} [Fri May 27 09:25:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:52.088562 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c386e-ffb3-49fc-b669-2b007616a84e None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:52.091822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84c4de-88d4-42c1-ae59-70d83872fbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:52.092775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84c4de-88d4-42c1-ae59-70d83872fbf7 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:52.093058 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84c4de-88d4-42c1-ae59-70d83872fbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:52.093330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84c4de-88d4-42c1-ae59-70d83872fbf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:52.094052 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84c4de-88d4-42c1-ae59-70d83872fbf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:52.094360 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84c4de-88d4-42c1-ae59-70d83872fbf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:52.095765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84c4de-88d4-42c1-ae59-70d83872fbf7 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:52.108296 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 339/671] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:52.108939 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84c4de-88d4-42c1-ae59-70d83872fbf7 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:52.223794 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:52.226119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84c4de-88d4-42c1-ae59-70d83872fbf7 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:52.231462 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c386e-ffb3-49fc-b669-2b007616a84e None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:52.238733 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:52.264891 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591654ad-9902-4821-82cf-13bccf3850a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:52.265544 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591654ad-9902-4821-82cf-13bccf3850a4 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:52.265823 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591654ad-9902-4821-82cf-13bccf3850a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:52.266101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591654ad-9902-4821-82cf-13bccf3850a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:52.281331 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3904021-753b-445f-998e-1e2316b19047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:52.283141 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3904021-753b-445f-998e-1e2316b19047 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:52.283660 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3904021-753b-445f-998e-1e2316b19047 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:52.284381 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3904021-753b-445f-998e-1e2316b19047 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:52.299263 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3904021-753b-445f-998e-1e2316b19047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:52.301832 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3904021-753b-445f-998e-1e2316b19047 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:52.324849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-d3904021-753b-445f-998e-1e2316b19047 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:52.324849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:52.324849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:52.324849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:52.324849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:52.324849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:52.324849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:52.324849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:52.324849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:52.324849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:52.324849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:52.324849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:52.324849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:52.324849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:52.324849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:52.325881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:52.325881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:52.325881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:52.325881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:52.325881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:52.325881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:52.325881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:52.325881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:52.325881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:52.325881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:52.325881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:52.325881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:52.325881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:52.325881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:52.325881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:52.325881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:52.325881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:52.326739 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:52.326739 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:52.326739 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:52.326739 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:52.333619 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 333/672] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:52.333619 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3904021-753b-445f-998e-1e2316b19047 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:52.355390 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591654ad-9902-4821-82cf-13bccf3850a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:52.358013 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591654ad-9902-4821-82cf-13bccf3850a4 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:52.457137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3904021-753b-445f-998e-1e2316b19047 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:52.489640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 340/673] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:25:52.490806 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591654ad-9902-4821-82cf-13bccf3850a4 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:52.498107 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaed8c8-c44c-436f-acdc-a5aad4504903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:52.498916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaed8c8-c44c-436f-acdc-a5aad4504903 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:52.499199 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaed8c8-c44c-436f-acdc-a5aad4504903 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:52.499517 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaed8c8-c44c-436f-acdc-a5aad4504903 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:52.506516 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:52.507503 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaed8c8-c44c-436f-acdc-a5aad4504903 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:52.509026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaed8c8-c44c-436f-acdc-a5aad4504903 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:52.523377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-6aaed8c8-c44c-436f-acdc-a5aad4504903 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:52.523377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:52.523377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:52.523377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:52.523377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:52.523377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:52.523377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:52.523377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:52.523377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:52.523377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:52.523377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:52.523377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:52.523377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:25:52.523377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:25:52.523377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:25:52.524298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:25:52.524298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:52.524298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:52.524298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:52.524298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:52.524298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:52.524298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:52.524298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:52.524298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:52.524298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:52.524298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:52.524298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:52.524298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:52.524298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:52.524298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:52.524298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:52.524298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:52.525186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:25:52.525186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:25:52.525186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:25:52.525186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:25:52.525186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:25:52.525186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:25:52.525186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:52.525186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:52.525186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 334/674] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:52.525967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaed8c8-c44c-436f-acdc-a5aad4504903 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:52.542966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:52.634510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591654ad-9902-4821-82cf-13bccf3850a4 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:52.636860 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaed8c8-c44c-436f-acdc-a5aad4504903 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:52.672090 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c686ba-bd83-4e03-9764-e93f10710cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:52.673025 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c686ba-bd83-4e03-9764-e93f10710cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:52.673414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c686ba-bd83-4e03-9764-e93f10710cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:52.673810 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c686ba-bd83-4e03-9764-e93f10710cb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:52.678750 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2bddc-1cfd-4509-b88f-a974f66f0aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:52.679445 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2bddc-1cfd-4509-b88f-a974f66f0aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:52.679728 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2bddc-1cfd-4509-b88f-a974f66f0aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:52.680007 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2bddc-1cfd-4509-b88f-a974f66f0aa0 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:52.680722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2bddc-1cfd-4509-b88f-a974f66f0aa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:52.681028 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2bddc-1cfd-4509-b88f-a974f66f0aa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:52.682917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2bddc-1cfd-4509-b88f-a974f66f0aa0 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:52.686886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c686ba-bd83-4e03-9764-e93f10710cb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:52.688492 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c686ba-bd83-4e03-9764-e93f10710cb7 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:52.699583 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 341/675] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:52.700804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2bddc-1cfd-4509-b88f-a974f66f0aa0 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:52.708549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-69c686ba-bd83-4e03-9764-e93f10710cb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:52.708549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:52.708549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:52.708549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:52.708549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:52.708549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:52.708549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:52.708549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:52.708549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:52.708549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:52.708549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:52.708549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:52.708549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:52.708549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:52.708549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:52.709733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:52.709733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:52.709733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:52.709733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:52.709733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:52.709733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:52.709733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:52.709733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:52.709733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:52.709733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:52.709733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:52.709733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:52.709733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:52.709733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:52.709733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:52.709733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:52.709733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:52.711661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:52.711661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:52.711661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:52.711661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:52.715974 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 335/676] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:52.716837 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c686ba-bd83-4e03-9764-e93f10710cb7 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:52.784802 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:52.793530 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:52.832219 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2bddc-1cfd-4509-b88f-a974f66f0aa0 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:52.832539 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c686ba-bd83-4e03-9764-e93f10710cb7 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:52.874085 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7cfb4-1a4b-44fd-bb1c-114a9e49735d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:52.875171 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7cfb4-1a4b-44fd-bb1c-114a9e49735d None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:52.875607 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7cfb4-1a4b-44fd-bb1c-114a9e49735d None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:52.875927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7cfb4-1a4b-44fd-bb1c-114a9e49735d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:52.879680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732541f-c9e7-49b2-8308-10764bc8d2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:52.880614 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732541f-c9e7-49b2-8308-10764bc8d2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:52.881106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732541f-c9e7-49b2-8308-10764bc8d2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:52.881579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732541f-c9e7-49b2-8308-10764bc8d2b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:52.882589 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732541f-c9e7-49b2-8308-10764bc8d2b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:52.883101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732541f-c9e7-49b2-8308-10764bc8d2b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:52.884576 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7cfb4-1a4b-44fd-bb1c-114a9e49735d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:52.885335 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732541f-c9e7-49b2-8308-10764bc8d2b6 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:52.886015 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7cfb4-1a4b-44fd-bb1c-114a9e49735d None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:52.899196 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 342/677] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:25:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:52.900417 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732541f-c9e7-49b2-8308-10764bc8d2b6 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:52.902026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-cea7cfb4-1a4b-44fd-bb1c-114a9e49735d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 09:25:52.902026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:52.902026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:52.902026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:52.902026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:52.902026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:52.902026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:52.902026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:52.902026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:52.902026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:52.902026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:52.902026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:52.902026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:25:52.902026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:25:52.902026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:25:52.902026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:25:52.902934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:52.902934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:52.902934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:25:52.902934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:52.902934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:25:52.902934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:52.902934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:52.902934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:52.902934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:52.902934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:52.902934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:52.902934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:52.902934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:52.902934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:52.902934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:52.902934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:52.902934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:52.902934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:52.903876 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:52.903876 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:52.903876 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:25:52.903876 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:25:52.903876 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:25:52.903876 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:25:52.903876 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:25:52.903876 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:25:52.903876 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 09:25:52.903876 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:52.907749 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 336/678] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:25:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:52.908522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7cfb4-1a4b-44fd-bb1c-114a9e49735d None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:53.036528 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7cfb4-1a4b-44fd-bb1c-114a9e49735d None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:53.036859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732541f-c9e7-49b2-8308-10764bc8d2b6 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:53.066395 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:53.071900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:53.079168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2fcc0-d03a-4d98-93f0-a86668e0cafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:53.079471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d1f42-1a95-4870-bdff-367b76a851cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:53.080241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d1f42-1a95-4870-bdff-367b76a851cb None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:53.080525 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2fcc0-d03a-4d98-93f0-a86668e0cafd None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:53.080637 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d1f42-1a95-4870-bdff-367b76a851cb None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:53.081450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d1f42-1a95-4870-bdff-367b76a851cb None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:53.081782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2fcc0-d03a-4d98-93f0-a86668e0cafd None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:53.082179 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d1f42-1a95-4870-bdff-367b76a851cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:53.082324 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2fcc0-d03a-4d98-93f0-a86668e0cafd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:53.082490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d1f42-1a95-4870-bdff-367b76a851cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:53.083465 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2fcc0-d03a-4d98-93f0-a86668e0cafd None admin] RBAC: Adding query filter params (role.id=5cde0d2bc9ca433b8904823fc602ab67, scope.project.id=b1d802dc0211467fa4e709cd01d411dc, user.id=38e04575437341df8127860a5e5abc50) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:53.083903 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d1f42-1a95-4870-bdff-367b76a851cb None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:53.084048 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2fcc0-d03a-4d98-93f0-a86668e0cafd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:53.085574 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2fcc0-d03a-4d98-93f0-a86668e0cafd None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:53.098812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 337/679] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:25:52 2022] GET /identity/v3/role_assignments?user.id=38e04575437341df8127860a5e5abc50&scope.project.id=b1d802dc0211467fa4e709cd01d411dc&role.id=5cde0d2bc9ca433b8904823fc602ab67 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:53.100094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2fcc0-d03a-4d98-93f0-a86668e0cafd None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:53.104657 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 343/680] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:53.113946 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d1f42-1a95-4870-bdff-367b76a851cb None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:53.218555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2fcc0-d03a-4d98-93f0-a86668e0cafd None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:53.256787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b76c4-b658-4d16-a110-edcdd2d20d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:53.257874 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b76c4-b658-4d16-a110-edcdd2d20d21 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:53.258367 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b76c4-b658-4d16-a110-edcdd2d20d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:53.258853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b76c4-b658-4d16-a110-edcdd2d20d21 None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:53.259944 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b76c4-b658-4d16-a110-edcdd2d20d21 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:53.260461 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b76c4-b658-4d16-a110-edcdd2d20d21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:53.262127 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b76c4-b658-4d16-a110-edcdd2d20d21 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:53.274788 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d1f42-1a95-4870-bdff-367b76a851cb None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:53.305889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 338/681] 10.222.0.41 () {56 vars in 1135 bytes} [Fri May 27 09:25:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:53.311663 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b76c4-b658-4d16-a110-edcdd2d20d21 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:53.324714 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8865a-a498-4f7b-9255-b69faa2ffaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:53.325553 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8865a-a498-4f7b-9255-b69faa2ffaeb None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:53.325844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8865a-a498-4f7b-9255-b69faa2ffaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:53.326129 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8865a-a498-4f7b-9255-b69faa2ffaeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:53.344257 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8865a-a498-4f7b-9255-b69faa2ffaeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:53.345732 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8865a-a498-4f7b-9255-b69faa2ffaeb None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:53.365293 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:53.366155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-56b8865a-a498-4f7b-9255-b69faa2ffaeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:53.366155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:53.366155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:53.366155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:53.366155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:53.366155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:53.366155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:53.366155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:53.366155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:53.366155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:53.366155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:53.366155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:53.366155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:25:53.366155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:25:53.366155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:25:53.367000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:25:53.367000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:53.367000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:53.367000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:53.367000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:53.367000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:53.367000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:53.367000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:53.367000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:53.367000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:53.367000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:53.367000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:53.367000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:53.367000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:53.367000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:53.367000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:53.367000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:53.368471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:25:53.368471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:25:53.368471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:25:53.368471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:25:53.368471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:25:53.368471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:25:53.368471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:53.368471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:53.368471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 344/682] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:53.374258 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8865a-a498-4f7b-9255-b69faa2ffaeb None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:53.444578 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b76c4-b658-4d16-a110-edcdd2d20d21 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:53.450815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:53.496444 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff570a4-68cb-419d-a0fd-40dce831dc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:53.497450 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff570a4-68cb-419d-a0fd-40dce831dc4b None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:53.497892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff570a4-68cb-419d-a0fd-40dce831dc4b None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:53.498170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff570a4-68cb-419d-a0fd-40dce831dc4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:53.511013 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8865a-a498-4f7b-9255-b69faa2ffaeb None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:53.550171 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4612f-ec4c-40e1-9f83-7fb38fde1f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:53.551266 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4612f-ec4c-40e1-9f83-7fb38fde1f81 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:53.551632 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4612f-ec4c-40e1-9f83-7fb38fde1f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:53.551916 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4612f-ec4c-40e1-9f83-7fb38fde1f81 None admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:53.553079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4612f-ec4c-40e1-9f83-7fb38fde1f81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:53.553396 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4612f-ec4c-40e1-9f83-7fb38fde1f81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:53.555519 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4612f-ec4c-40e1-9f83-7fb38fde1f81 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:53.572771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 345/683] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:25:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:53.574335 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41929ca3-b618-4caf-bac8-87b1b3edac15 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:53.574790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41929ca3-b618-4caf-bac8-87b1b3edac15 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:53.575073 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41929ca3-b618-4caf-bac8-87b1b3edac15 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:53.577147 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 346/684] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:53.577851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41929ca3-b618-4caf-bac8-87b1b3edac15 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:53.587061 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff570a4-68cb-419d-a0fd-40dce831dc4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:53.588547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff570a4-68cb-419d-a0fd-40dce831dc4b None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:53.647192 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:53.703009 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41929ca3-b618-4caf-bac8-87b1b3edac15 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:53.715303 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:53.727699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 339/685] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 09:25:53.729379 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702a9bf-57a2-4638-aec2-5f251e9f9df2 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:53.729665 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702a9bf-57a2-4638-aec2-5f251e9f9df2 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:53.729939 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702a9bf-57a2-4638-aec2-5f251e9f9df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:53.742702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cb50f-df4a-4001-89a9-4a5e404049b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:53.743646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cb50f-df4a-4001-89a9-4a5e404049b2 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:53.744073 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cb50f-df4a-4001-89a9-4a5e404049b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:53.744447 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cb50f-df4a-4001-89a9-4a5e404049b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:53.745392 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cb50f-df4a-4001-89a9-4a5e404049b2 None admin] RBAC: Adding query filter params (role.id=5cde0d2bc9ca433b8904823fc602ab67, scope.project.id=b1d802dc0211467fa4e709cd01d411dc, user.id=c1103a08484048da82c5e4627552253e) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:53.745848 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cb50f-df4a-4001-89a9-4a5e404049b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:53.747639 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cb50f-df4a-4001-89a9-4a5e404049b2 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:53.750635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-f702a9bf-57a2-4638-aec2-5f251e9f9df2 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:53.753242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f702a9bf-57a2-4638-aec2-5f251e9f9df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:53.755452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 347/686] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:25:53 2022] GET /identity/v3/role_assignments?user.id=c1103a08484048da82c5e4627552253e&scope.project.id=b1d802dc0211467fa4e709cd01d411dc&role.id=5cde0d2bc9ca433b8904823fc602ab67 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:53.756456 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cb50f-df4a-4001-89a9-4a5e404049b2 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:53.882637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 340/687] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:53.906830 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cb50f-df4a-4001-89a9-4a5e404049b2 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:53.941223 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702a9bf-57a2-4638-aec2-5f251e9f9df2 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:53.968789 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7fa94-ef86-44d0-b7f4-76eda248f287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:53.969629 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7fa94-ef86-44d0-b7f4-76eda248f287 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:53.969916 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7fa94-ef86-44d0-b7f4-76eda248f287 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:53.970188 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7fa94-ef86-44d0-b7f4-76eda248f287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:53.988790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7fa94-ef86-44d0-b7f4-76eda248f287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:53.990538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7fa94-ef86-44d0-b7f4-76eda248f287 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:54.020130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-84a7fa94-ef86-44d0-b7f4-76eda248f287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:54.020130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:54.020130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:54.020130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:54.020130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:54.020130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:54.020130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:54.020130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:54.020130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:54.020130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:54.020130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:54.020130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:54.020130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:54.020130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:54.020130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:54.021060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:54.021060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:54.021060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:54.021060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:54.021060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:54.021060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:54.021060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:54.021060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:54.021060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:54.021060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:54.021060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:54.021060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:54.021060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:54.021060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:54.021060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:54.021060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:54.021060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:54.021933 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:54.021933 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:54.021933 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:54.021933 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:54.024149 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 348/688] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:54.032907 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7fa94-ef86-44d0-b7f4-76eda248f287 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:54.077519 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:54.078408 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:54.111602 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702a9bf-57a2-4638-aec2-5f251e9f9df2 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:54.148206 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0e9ba-d578-4d9d-9168-05c8558ed51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:54.148942 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0e9ba-d578-4d9d-9168-05c8558ed51c None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:54.149224 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0e9ba-d578-4d9d-9168-05c8558ed51c None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:54.149501 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0e9ba-d578-4d9d-9168-05c8558ed51c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:54.150152 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0e9ba-d578-4d9d-9168-05c8558ed51c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:54.151552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0e9ba-d578-4d9d-9168-05c8558ed51c None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:54.157147 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7fa94-ef86-44d0-b7f4-76eda248f287 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:54.167343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-f5d0e9ba-d578-4d9d-9168-05c8558ed51c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:25:54.167343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:54.167343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:25:54.167343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:25:54.167343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:25:54.167343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:25:54.167343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:25:54.167343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:25:54.167343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:25:54.167343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:54.167343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:25:54.167343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:54.167343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:54.167343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:54.167343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:54.167343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:54.168331 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:54.168331 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:54.168331 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:54.168331 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:54.168331 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:54.168331 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:54.168331 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:54.168331 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:25:54.168331 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:25:54.168331 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:25:54.168331 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:25:54.168331 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:54.168331 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:54.168331 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:54.168331 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:54.168331 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:54.169186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:54.169186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:54.169186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:54.169186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:54.169186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:54.169186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:54.169186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:54.169186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:54.169186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:54.169186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:54.169186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:54.169186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:25:54.169186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:25:54.169186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:25:54.169186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:54.169186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 341/689] 10.222.0.41 () {56 vars in 1129 bytes} [Fri May 27 09:25:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:25:54.174500 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0e9ba-d578-4d9d-9168-05c8558ed51c None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:54.202837 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e14cc5-5ffd-461a-9499-0e3d9399b75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:54.203917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e14cc5-5ffd-461a-9499-0e3d9399b75b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:54.204424 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e14cc5-5ffd-461a-9499-0e3d9399b75b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:54.204921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e14cc5-5ffd-461a-9499-0e3d9399b75b None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:54.205881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e14cc5-5ffd-461a-9499-0e3d9399b75b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:54.206391 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e14cc5-5ffd-461a-9499-0e3d9399b75b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:54.207997 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e14cc5-5ffd-461a-9499-0e3d9399b75b None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:54.220561 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 349/690] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:54.222842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ab11b-d831-46f6-ab03-1e7ad07945a3 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:54.223359 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ab11b-d831-46f6-ab03-1e7ad07945a3 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:54.223881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ab11b-d831-46f6-ab03-1e7ad07945a3 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:54.229796 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 350/691] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:54.230864 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ab11b-d831-46f6-ab03-1e7ad07945a3 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:54.298877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0e9ba-d578-4d9d-9168-05c8558ed51c None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:54.323689 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:54.341683 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ab11b-d831-46f6-ab03-1e7ad07945a3 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:54.343022 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1364f-8623-460b-9d54-18ff02b06071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:54.343732 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1364f-8623-460b-9d54-18ff02b06071 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:54.344163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1364f-8623-460b-9d54-18ff02b06071 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:54.344464 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1364f-8623-460b-9d54-18ff02b06071 None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:54.345184 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1364f-8623-460b-9d54-18ff02b06071 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:54.346324 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1364f-8623-460b-9d54-18ff02b06071 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:54.347734 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1364f-8623-460b-9d54-18ff02b06071 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:54.358282 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 342/692] 10.222.0.41 () {56 vars in 1124 bytes} [Fri May 27 09:25:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:54.358282 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d3713-de1e-4df0-b193-19df671cc38f None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:54.358282 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d3713-de1e-4df0-b193-19df671cc38f None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:54.358282 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d3713-de1e-4df0-b193-19df671cc38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:54.379619 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:54.380841 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048e105-0003-4f78-b62b-3bc76db8821c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:54.381632 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048e105-0003-4f78-b62b-3bc76db8821c None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:54.381912 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048e105-0003-4f78-b62b-3bc76db8821c None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:54.382184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048e105-0003-4f78-b62b-3bc76db8821c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:54.383220 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-210d3713-de1e-4df0-b193-19df671cc38f None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:54.385422 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-210d3713-de1e-4df0-b193-19df671cc38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:54.389949 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048e105-0003-4f78-b62b-3bc76db8821c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:54.391486 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048e105-0003-4f78-b62b-3bc76db8821c None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:54.420289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-6048e105-0003-4f78-b62b-3bc76db8821c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:54.420289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:54.420289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:54.420289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:54.420289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:54.420289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:54.420289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:54.420289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:54.420289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:54.420289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:54.420289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:54.420289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:54.420289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:25:54.420289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:25:54.420289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:25:54.421208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:25:54.421208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:54.421208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:54.421208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:54.421208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:54.421208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:54.421208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:54.421208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:54.421208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:54.421208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:54.421208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:54.421208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:54.421208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:54.421208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:54.421208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:54.421208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:54.421208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:54.422074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:25:54.422074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:25:54.422074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:25:54.422074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:25:54.422074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:25:54.422074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:25:54.422074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:54.422074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:54.422074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 351/693] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:54.422783 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048e105-0003-4f78-b62b-3bc76db8821c None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:54.477249 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 343/694] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:54.478104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d3713-de1e-4df0-b193-19df671cc38f None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:54.529318 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048e105-0003-4f78-b62b-3bc76db8821c None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:54.566407 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c6c62-e3f7-4703-9733-779fe7f75786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:54.567085 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c6c62-e3f7-4703-9733-779fe7f75786 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:54.567402 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c6c62-e3f7-4703-9733-779fe7f75786 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:54.567685 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c6c62-e3f7-4703-9733-779fe7f75786 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:54.568400 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c6c62-e3f7-4703-9733-779fe7f75786 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:54.568710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c6c62-e3f7-4703-9733-779fe7f75786 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:54.570301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c6c62-e3f7-4703-9733-779fe7f75786 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:54.576702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 352/695] 10.222.0.41 () {56 vars in 1124 bytes} [Fri May 27 09:25:54 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:54.577633 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c6c62-e3f7-4703-9733-779fe7f75786 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:54.588918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d3713-de1e-4df0-b193-19df671cc38f None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:54.591168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:54.658960 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adfc89-f17f-446a-af79-d73c1116ab96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:54.659785 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adfc89-f17f-446a-af79-d73c1116ab96 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:54.660074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adfc89-f17f-446a-af79-d73c1116ab96 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:54.660355 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adfc89-f17f-446a-af79-d73c1116ab96 None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:54.661158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adfc89-f17f-446a-af79-d73c1116ab96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:54.661484 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adfc89-f17f-446a-af79-d73c1116ab96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:54.662977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adfc89-f17f-446a-af79-d73c1116ab96 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:54.667636 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:54.692114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 344/696] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:25:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:54.693568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adfc89-f17f-446a-af79-d73c1116ab96 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:54.694857 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c6c62-e3f7-4703-9733-779fe7f75786 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:54.731441 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6d6c7-6614-4017-8972-92bbf48c7445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:54.732248 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6d6c7-6614-4017-8972-92bbf48c7445 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:54.732541 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6d6c7-6614-4017-8972-92bbf48c7445 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:54.732820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6d6c7-6614-4017-8972-92bbf48c7445 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:54.746402 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6d6c7-6614-4017-8972-92bbf48c7445 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:54.755235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-cbe6d6c7-6614-4017-8972-92bbf48c7445 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:25:54.755235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:54.755235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:54.755235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:54.755235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:54.755235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:54.755235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:54.755235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:54.755235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:54.755235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:54.755235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:54.755235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:54.755235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:54.755235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:54.755235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:54.755235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:54.756743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:54.756743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:54.756743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:54.756743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:54.756743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:54.756743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:54.756743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:54.756743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:54.756743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:54.756743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:54.756743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:54.756743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:54.756743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:54.756743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:54.756743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:54.756743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:54.757581 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:54.757581 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:54.757581 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:54.757581 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:54.757581 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:54.757581 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:54.757581 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:54.757581 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:54.757581 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:54.757581 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:54.757581 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:25:54.757581 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:54.757581 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 353/697] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:25:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:54.762548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6d6c7-6614-4017-8972-92bbf48c7445 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:54.859917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:54.878966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adfc89-f17f-446a-af79-d73c1116ab96 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:54.892812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6d6c7-6614-4017-8972-92bbf48c7445 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:54.917674 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcf0c4-49a4-42fd-ab2a-798bae9c2681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:54.918348 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcf0c4-49a4-42fd-ab2a-798bae9c2681 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:54.918636 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcf0c4-49a4-42fd-ab2a-798bae9c2681 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:54.918913 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcf0c4-49a4-42fd-ab2a-798bae9c2681 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:54.919784 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bcf0c4-49a4-42fd-ab2a-798bae9c2681 None admin] RBAC: Adding query filter params (role.id=5cde0d2bc9ca433b8904823fc602ab67, scope.project.id=b1d802dc0211467fa4e709cd01d411dc, user.id=351f74222d394f39bda0663e0e4ebde6) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:54.920102 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bcf0c4-49a4-42fd-ab2a-798bae9c2681 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:54.921533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bcf0c4-49a4-42fd-ab2a-798bae9c2681 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:54.935075 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c83444-0845-4ebc-a00a-02380fa5cbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:54.935419 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 345/698] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:25:54 2022] GET /identity/v3/role_assignments?user.id=351f74222d394f39bda0663e0e4ebde6&scope.project.id=b1d802dc0211467fa4e709cd01d411dc&role.id=5cde0d2bc9ca433b8904823fc602ab67 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:54.935790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c83444-0845-4ebc-a00a-02380fa5cbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:54.936077 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c83444-0845-4ebc-a00a-02380fa5cbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:54.936356 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c83444-0845-4ebc-a00a-02380fa5cbc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:54.937110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c83444-0845-4ebc-a00a-02380fa5cbc8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:54.937422 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c83444-0845-4ebc-a00a-02380fa5cbc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:54.938841 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c83444-0845-4ebc-a00a-02380fa5cbc8 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:54.949016 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 354/699] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:54.956447 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcf0c4-49a4-42fd-ab2a-798bae9c2681 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:55.051263 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:55.129893 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcf0c4-49a4-42fd-ab2a-798bae9c2681 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:55.173878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355aebb-f1b8-435f-8736-fed7cf3f607b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:55.175261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355aebb-f1b8-435f-8736-fed7cf3f607b None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:55.175579 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355aebb-f1b8-435f-8736-fed7cf3f607b None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:55.175852 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355aebb-f1b8-435f-8736-fed7cf3f607b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:55.187799 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355aebb-f1b8-435f-8736-fed7cf3f607b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:55.189268 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355aebb-f1b8-435f-8736-fed7cf3f607b None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:55.208508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-5355aebb-f1b8-435f-8736-fed7cf3f607b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:55.208508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:55.208508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:55.208508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:55.208508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:55.208508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:55.208508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:55.208508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:55.208508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:55.208508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:55.208508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:55.208508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:55.208508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:55.208508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:55.208508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:55.210586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:55.210586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:55.210586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:55.210586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:55.210586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:55.210586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:55.210586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:55.210586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:55.210586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:55.210586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:55.210586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:55.210586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:55.210586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:55.210586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:55.210586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:55.210586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:55.210586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:55.212734 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:55.212734 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:55.212734 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:55.212734 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:55.212734 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 346/700] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:55.220407 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c83444-0845-4ebc-a00a-02380fa5cbc8 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:55.342894 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c83444-0845-4ebc-a00a-02380fa5cbc8 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:55.376811 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:55.380344 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd625359-4102-44ad-b0b9-4ba5141a4981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:55.381226 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd625359-4102-44ad-b0b9-4ba5141a4981 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:55.381694 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd625359-4102-44ad-b0b9-4ba5141a4981 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:55.382170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd625359-4102-44ad-b0b9-4ba5141a4981 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:55.382902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd625359-4102-44ad-b0b9-4ba5141a4981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:55.383215 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd625359-4102-44ad-b0b9-4ba5141a4981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:55.384632 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd625359-4102-44ad-b0b9-4ba5141a4981 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:55.398163 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 355/701] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:55.403117 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355aebb-f1b8-435f-8736-fed7cf3f607b None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:55.508126 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355aebb-f1b8-435f-8736-fed7cf3f607b None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:55.523935 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:55.544221 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffe96c-7d19-4a46-94ab-1a30d5aa7f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:55.545038 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffe96c-7d19-4a46-94ab-1a30d5aa7f27 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:55.545304 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffe96c-7d19-4a46-94ab-1a30d5aa7f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:55.545681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffe96c-7d19-4a46-94ab-1a30d5aa7f27 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:55.553585 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffe96c-7d19-4a46-94ab-1a30d5aa7f27 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:55.555031 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffe96c-7d19-4a46-94ab-1a30d5aa7f27 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:55.569524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-20ffe96c-7d19-4a46-94ab-1a30d5aa7f27 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:25:55.569524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:55.569524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:55.569524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:55.569524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:55.569524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:55.569524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:55.569524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:55.569524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:55.569524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:55.569524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:55.569524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:55.569524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:25:55.569524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:25:55.569524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:25:55.569524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:25:55.570535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:55.570535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:55.570535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:25:55.570535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:55.570535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:25:55.570535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:55.570535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:55.570535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:55.570535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:55.570535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:55.570535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:55.570535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:55.570535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:55.570535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:55.570535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:55.570535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:55.570535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:55.570535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:55.571938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:55.571938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:55.571938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:25:55.571938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:25:55.571938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:25:55.571938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:25:55.571938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:25:55.571938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:25:55.571938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:25:55.571938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:55.571938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 347/702] 10.222.0.41 () {56 vars in 1093 bytes} [Fri May 27 09:25:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:55.577659 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd625359-4102-44ad-b0b9-4ba5141a4981 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:55.686148 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd625359-4102-44ad-b0b9-4ba5141a4981 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:55.723549 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afd18f-156d-414e-8df1-0b2c7e5ebb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:55.724291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afd18f-156d-414e-8df1-0b2c7e5ebb3e None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:55.724583 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afd18f-156d-414e-8df1-0b2c7e5ebb3e None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:55.724924 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afd18f-156d-414e-8df1-0b2c7e5ebb3e None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:55.725775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afd18f-156d-414e-8df1-0b2c7e5ebb3e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:55.726116 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afd18f-156d-414e-8df1-0b2c7e5ebb3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:55.727608 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afd18f-156d-414e-8df1-0b2c7e5ebb3e None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:55.747640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 356/703] 10.222.0.41 () {56 vars in 1133 bytes} [Fri May 27 09:25:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:55.753463 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffe96c-7d19-4a46-94ab-1a30d5aa7f27 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:55.860306 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffe96c-7d19-4a46-94ab-1a30d5aa7f27 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:55.890652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978abf2-9a77-45d2-b968-a4c5023970b8 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:55.890983 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978abf2-9a77-45d2-b968-a4c5023970b8 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:55.891216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978abf2-9a77-45d2-b968-a4c5023970b8 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:55.892592 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 357/704] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:55.898477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f537ad6-bc17-4fdc-8390-13fd3825426f None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:55.898770 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f537ad6-bc17-4fdc-8390-13fd3825426f None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:55.899051 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f537ad6-bc17-4fdc-8390-13fd3825426f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:55.904243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0821e-1be9-4595-b013-285577d786bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:55.905662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0821e-1be9-4595-b013-285577d786bd None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:55.906090 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0821e-1be9-4595-b013-285577d786bd None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:55.906554 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0821e-1be9-4595-b013-285577d786bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:55.948297 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-7f537ad6-bc17-4fdc-8390-13fd3825426f None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:55.949485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-7f537ad6-bc17-4fdc-8390-13fd3825426f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:55.959629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:55.984090 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0821e-1be9-4595-b013-285577d786bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:55.986275 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0821e-1be9-4595-b013-285577d786bd None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:56.051814 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:56.093106 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 348/705] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:25:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:25:56.098173 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0821e-1be9-4595-b013-285577d786bd None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:56.100897 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 358/706] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 27 09:25:56.176506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f537ad6-bc17-4fdc-8390-13fd3825426f None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:56.199643 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:56.229148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0821e-1be9-4595-b013-285577d786bd None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:56.266475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620ae59-e70f-428b-b8b2-c02b476e13a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:56.267633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620ae59-e70f-428b-b8b2-c02b476e13a5 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:56.268091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620ae59-e70f-428b-b8b2-c02b476e13a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:56.268720 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620ae59-e70f-428b-b8b2-c02b476e13a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:56.279796 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620ae59-e70f-428b-b8b2-c02b476e13a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:56.281942 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620ae59-e70f-428b-b8b2-c02b476e13a5 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:56.300724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-9620ae59-e70f-428b-b8b2-c02b476e13a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:56.300724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:56.300724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:56.300724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:56.300724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:56.300724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:56.300724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:56.300724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:56.300724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:56.300724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:56.300724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:56.300724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:56.300724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:56.300724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:56.300724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:56.301791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:56.301791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:56.301791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:56.301791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:56.301791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:56.301791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:56.301791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:56.301791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:56.301791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:56.301791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:56.301791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:56.301791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:56.301791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:56.301791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:56.301791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:56.301791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:56.301791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:56.302650 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:56.302650 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:56.302650 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:56.302650 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:56.304874 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 349/707] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:56.312286 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620ae59-e70f-428b-b8b2-c02b476e13a5 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:56.337411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f537ad6-bc17-4fdc-8390-13fd3825426f None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:56.402148 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588581f8-4de2-4934-a431-3e0909c9973d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:56.402953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588581f8-4de2-4934-a431-3e0909c9973d None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:56.403226 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588581f8-4de2-4934-a431-3e0909c9973d None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:56.403526 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588581f8-4de2-4934-a431-3e0909c9973d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:56.423422 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588581f8-4de2-4934-a431-3e0909c9973d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:56.426342 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588581f8-4de2-4934-a431-3e0909c9973d None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:56.461938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-588581f8-4de2-4934-a431-3e0909c9973d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:56.461938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:56.461938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:56.461938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:56.461938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:56.461938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:56.461938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:56.461938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:56.461938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:56.461938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:56.461938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:56.461938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:56.461938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:56.461938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:56.461938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:56.462863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:56.462863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:56.462863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:56.462863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:56.462863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:56.462863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:56.462863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:56.462863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:56.462863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:56.462863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:56.462863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:56.462863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:56.462863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:56.462863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:56.462863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:56.462863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:56.462863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:56.463769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:56.463769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:56.463769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:56.463769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:56.471084 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 359/708] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:56.472505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588581f8-4de2-4934-a431-3e0909c9973d None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:56.505369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620ae59-e70f-428b-b8b2-c02b476e13a5 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:56.539672 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:56.552434 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:56.566093 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae4202-6b06-4c40-9c20-0505a0fdd588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:56.566765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae4202-6b06-4c40-9c20-0505a0fdd588 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:56.567050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae4202-6b06-4c40-9c20-0505a0fdd588 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:56.567373 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae4202-6b06-4c40-9c20-0505a0fdd588 None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:56.568096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae4202-6b06-4c40-9c20-0505a0fdd588 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:56.568402 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae4202-6b06-4c40-9c20-0505a0fdd588 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:56.569917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae4202-6b06-4c40-9c20-0505a0fdd588 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:56.582777 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 350/709] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:56.584338 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b9856-3a19-4a7f-a1d8-649c7913ec7b None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:56.584632 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b9856-3a19-4a7f-a1d8-649c7913ec7b None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:56.584909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b9856-3a19-4a7f-a1d8-649c7913ec7b None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:56.590249 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 351/710] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:56.591081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b9856-3a19-4a7f-a1d8-649c7913ec7b None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:56.626106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588581f8-4de2-4934-a431-3e0909c9973d None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:56.672251 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79609f08-e6e7-40e5-bc1e-b1c0923e76fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:56.673044 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79609f08-e6e7-40e5-bc1e-b1c0923e76fd None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:56.673332 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79609f08-e6e7-40e5-bc1e-b1c0923e76fd None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:56.673610 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79609f08-e6e7-40e5-bc1e-b1c0923e76fd None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:56.675057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79609f08-e6e7-40e5-bc1e-b1c0923e76fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:56.676168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79609f08-e6e7-40e5-bc1e-b1c0923e76fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:56.677564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79609f08-e6e7-40e5-bc1e-b1c0923e76fd None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:56.692266 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 360/711] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:56.693561 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47a6b5-1baa-4c95-99c2-cc64d6969285 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:56.693852 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47a6b5-1baa-4c95-99c2-cc64d6969285 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:56.694131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47a6b5-1baa-4c95-99c2-cc64d6969285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:56.709595 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b9856-3a19-4a7f-a1d8-649c7913ec7b None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:56.715836 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-5d47a6b5-1baa-4c95-99c2-cc64d6969285 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:56.716956 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-5d47a6b5-1baa-4c95-99c2-cc64d6969285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:56.749352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6410a4-44f9-45b7-b3f6-a1d39ffa7a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:56.750924 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6410a4-44f9-45b7-b3f6-a1d39ffa7a67 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:56.751305 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6410a4-44f9-45b7-b3f6-a1d39ffa7a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:56.751911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6410a4-44f9-45b7-b3f6-a1d39ffa7a67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:56.763197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6410a4-44f9-45b7-b3f6-a1d39ffa7a67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:56.764863 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6410a4-44f9-45b7-b3f6-a1d39ffa7a67 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:56.781685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-bb6410a4-44f9-45b7-b3f6-a1d39ffa7a67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:56.781685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:56.781685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:56.781685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:56.781685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:56.781685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:56.781685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:56.781685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:56.781685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:56.781685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:56.781685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:56.781685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:56.781685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:25:56.781685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:25:56.781685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:25:56.783180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:25:56.783180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:56.783180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:56.783180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:56.783180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:56.783180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:56.783180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:56.783180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:56.783180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:56.783180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:56.783180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:56.783180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:56.783180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:56.783180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:56.783180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:56.783180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:56.783180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:56.786089 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:25:56.786089 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:25:56.786089 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:25:56.786089 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:25:56.786089 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:25:56.786089 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:25:56.786089 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:25:56.786089 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:56.786089 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 352/712] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:56.786089 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6410a4-44f9-45b7-b3f6-a1d39ffa7a67 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:56.804208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 361/713] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:56.805139 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47a6b5-1baa-4c95-99c2-cc64d6969285 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:56.832230 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:56.858197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:56.911267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47a6b5-1baa-4c95-99c2-cc64d6969285 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:56.923372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6410a4-44f9-45b7-b3f6-a1d39ffa7a67 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:56.945549 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625d4e0-ba3f-442e-9c15-b85f46de436a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:56.946214 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625d4e0-ba3f-442e-9c15-b85f46de436a None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:56.946496 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625d4e0-ba3f-442e-9c15-b85f46de436a None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:56.946775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625d4e0-ba3f-442e-9c15-b85f46de436a None admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:56.947578 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625d4e0-ba3f-442e-9c15-b85f46de436a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:56.947982 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625d4e0-ba3f-442e-9c15-b85f46de436a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:56.949434 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625d4e0-ba3f-442e-9c15-b85f46de436a None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:56.962098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 362/714] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:25:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:56.962963 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625d4e0-ba3f-442e-9c15-b85f46de436a None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:56.963676 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbede07-8ff1-4e6d-8339-4bbe931ae2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:56.964831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbede07-8ff1-4e6d-8339-4bbe931ae2e6 None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:56.965258 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbede07-8ff1-4e6d-8339-4bbe931ae2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:56.965695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbede07-8ff1-4e6d-8339-4bbe931ae2e6 None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:56.966689 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbede07-8ff1-4e6d-8339-4bbe931ae2e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:56.968534 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbede07-8ff1-4e6d-8339-4bbe931ae2e6 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:56.997292 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 353/715] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 09:25:56 2022] POST /identity/v3/users => generated 254 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:25:56.998412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbede07-8ff1-4e6d-8339-4bbe931ae2e6 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:57.152949 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:57.157950 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbede07-8ff1-4e6d-8339-4bbe931ae2e6 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:57.158402 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:57.203303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f08dd-52a0-49cc-8467-64dd26b08baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:57.203303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f08dd-52a0-49cc-8467-64dd26b08baa None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:57.203303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f08dd-52a0-49cc-8467-64dd26b08baa None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:57.203303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f08dd-52a0-49cc-8467-64dd26b08baa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:57.203762 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f08dd-52a0-49cc-8467-64dd26b08baa None admin] RBAC: Adding query filter params (role.id=bb6c5483d9be4a16ac64750536c5e2e2, scope.project.id=b1d802dc0211467fa4e709cd01d411dc, user.id=d2b1c12e88c549208894fc0dd0c60b88) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:57.203762 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f08dd-52a0-49cc-8467-64dd26b08baa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:57.203762 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f08dd-52a0-49cc-8467-64dd26b08baa None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:57.209757 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 354/716] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:25:56 2022] GET /identity/v3/role_assignments?user.id=d2b1c12e88c549208894fc0dd0c60b88&scope.project.id=b1d802dc0211467fa4e709cd01d411dc&role.id=bb6c5483d9be4a16ac64750536c5e2e2 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:57.210154 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625d4e0-ba3f-442e-9c15-b85f46de436a None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:57.275496 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd4a69-87f6-431a-a921-5a7057c6d52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:57.276420 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd4a69-87f6-431a-a921-5a7057c6d52b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:57.276747 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd4a69-87f6-431a-a921-5a7057c6d52b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:57.277029 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd4a69-87f6-431a-a921-5a7057c6d52b None admin] PATH_INFO: `/v3/services/network` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:57.277699 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd4a69-87f6-431a-a921-5a7057c6d52b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:57.279143 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd4a69-87f6-431a-a921-5a7057c6d52b None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:57.294902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-00dd4a69-87f6-431a-a921-5a7057c6d52b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:25:57.294902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:57.294902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:25:57.294902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:25:57.294902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:25:57.294902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:25:57.294902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:25:57.294902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:25:57.294902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:25:57.294902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:57.294902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:25:57.294902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:57.294902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:57.294902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:57.294902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:57.294902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:57.294902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:57.296019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:57.296019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:57.296019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:57.296019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:57.296019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:57.296019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:57.296019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:25:57.296019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:25:57.296019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:25:57.296019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:25:57.296019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:57.296019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:57.296019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:57.296019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:57.296019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:57.296019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:57.296842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:57.296842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:25:57.296842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:57.296842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:57.296842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:57.296842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:57.296842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:57.296842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:57.296842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:57.296842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:57.296842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:25:57.296842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:25:57.296842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:25:57.296842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:25:57.299136 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 363/717] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:25:56 2022] GET /identity/v3/services/network => generated 88 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:57.305656 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f08dd-52a0-49cc-8467-64dd26b08baa None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:57.323054 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888f0f2-2836-49cf-8d5f-ba8f85524c6c None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:57.323427 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888f0f2-2836-49cf-8d5f-ba8f85524c6c None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:57.323665 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888f0f2-2836-49cf-8d5f-ba8f85524c6c None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:57.325317 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 364/718] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:57.332796 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6785f7b-4be4-4355-9b44-ac73293dd027 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:57.333093 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6785f7b-4be4-4355-9b44-ac73293dd027 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:57.333348 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6785f7b-4be4-4355-9b44-ac73293dd027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:57.353589 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-d6785f7b-4be4-4355-9b44-ac73293dd027 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:57.354856 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d6785f7b-4be4-4355-9b44-ac73293dd027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:57.446782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f08dd-52a0-49cc-8467-64dd26b08baa None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:57.449927 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 365/719] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:25:57.479165 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6785f7b-4be4-4355-9b44-ac73293dd027 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:57.484791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa27ba-2519-4ba3-8f52-3d9a785f86a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:57.485719 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa27ba-2519-4ba3-8f52-3d9a785f86a2 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:57.486201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa27ba-2519-4ba3-8f52-3d9a785f86a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:57.486696 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa27ba-2519-4ba3-8f52-3d9a785f86a2 None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:57.487669 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa27ba-2519-4ba3-8f52-3d9a785f86a2 None admin] RBAC: Adding query filter params (name=network) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:57.488175 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa27ba-2519-4ba3-8f52-3d9a785f86a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:57.489750 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa27ba-2519-4ba3-8f52-3d9a785f86a2 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:57.495198 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 355/720] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 09:25:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:57.500437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa27ba-2519-4ba3-8f52-3d9a785f86a2 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:57.529859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:57.604984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa27ba-2519-4ba3-8f52-3d9a785f86a2 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:57.639327 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d4843-93eb-4187-a713-31fd8877a39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:57.640398 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d4843-93eb-4187-a713-31fd8877a39a None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:57.640877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d4843-93eb-4187-a713-31fd8877a39a None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:57.641415 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d4843-93eb-4187-a713-31fd8877a39a None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:57.642356 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d4843-93eb-4187-a713-31fd8877a39a None admin] RBAC: Adding query filter params (type=network) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:57.642858 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d4843-93eb-4187-a713-31fd8877a39a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:57.644959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d4843-93eb-4187-a713-31fd8877a39a None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:57.651334 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 356/721] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 09:25:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:25:57.653306 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:57.712693 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6785f7b-4be4-4355-9b44-ac73293dd027 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:57.773492 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff205d-c15c-4b00-a59f-ed2556b28864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:57.774182 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff205d-c15c-4b00-a59f-ed2556b28864 None admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:57.774466 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff205d-c15c-4b00-a59f-ed2556b28864 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:57.774737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff205d-c15c-4b00-a59f-ed2556b28864 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:57.775491 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff205d-c15c-4b00-a59f-ed2556b28864 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:57.776886 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff205d-c15c-4b00-a59f-ed2556b28864 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:57.813626 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 366/722] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 09:25:57 2022] POST /identity/v3/services => generated 251 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:25:58.337310 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f584f-0a4b-44cc-9b25-74f40b5905d4 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:58.339862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f584f-0a4b-44cc-9b25-74f40b5905d4 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:58.339862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f584f-0a4b-44cc-9b25-74f40b5905d4 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:58.340288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 357/723] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:25:58.345977 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df41b7b-8eaa-4a1c-bc43-9ba396c43c5b None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:58.346463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df41b7b-8eaa-4a1c-bc43-9ba396c43c5b None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:58.346913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df41b7b-8eaa-4a1c-bc43-9ba396c43c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:58.364871 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-7df41b7b-8eaa-4a1c-bc43-9ba396c43c5b None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:58.366350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-7df41b7b-8eaa-4a1c-bc43-9ba396c43c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:25:58.454044 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 367/724] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:58 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:25:58.487807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f584f-0a4b-44cc-9b25-74f40b5905d4 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:58.612749 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:58.623383 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f584f-0a4b-44cc-9b25-74f40b5905d4 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:58.658405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1802d-1a5c-428f-9071-bdac21729daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:58.659764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1802d-1a5c-428f-9071-bdac21729daa None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:58.660043 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1802d-1a5c-428f-9071-bdac21729daa None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:58.660316 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1802d-1a5c-428f-9071-bdac21729daa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:58.671101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b1802d-1a5c-428f-9071-bdac21729daa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:25:58.679365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-70b1802d-1a5c-428f-9071-bdac21729daa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:25:58.679365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:58.679365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:58.679365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:58.679365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:58.679365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:58.679365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:58.679365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:58.679365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:58.679365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:58.679365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:58.679365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:58.679365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:25:58.679365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:25:58.679365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:25:58.679365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:25:58.680274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:25:58.680274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:25:58.680274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:25:58.680274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:25:58.680274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:58.680274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:58.680274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:58.680274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:58.680274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:58.680274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:58.680274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:58.680274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:58.680274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:58.680274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:58.680274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:58.680274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:58.681167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:58.681167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:58.681167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:58.681167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:58.681167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:25:58.681167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:25:58.681167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:25:58.681167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:25:58.681167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:25:58.681167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:25:58.681167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:25:58.681167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:58.681167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 358/725] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:25:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:58.687741 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df41b7b-8eaa-4a1c-bc43-9ba396c43c5b None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:58.774449 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:58.831337 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df41b7b-8eaa-4a1c-bc43-9ba396c43c5b None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:58.882863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87399f-1050-40ad-9af0-06f6c82a18f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:58.883496 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87399f-1050-40ad-9af0-06f6c82a18f7 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:58.883785 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87399f-1050-40ad-9af0-06f6c82a18f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:58.884057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87399f-1050-40ad-9af0-06f6c82a18f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:58.884804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87399f-1050-40ad-9af0-06f6c82a18f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:58.885117 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87399f-1050-40ad-9af0-06f6c82a18f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:58.886498 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87399f-1050-40ad-9af0-06f6c82a18f7 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:58.898647 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 368/726] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:25:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:58.903928 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1802d-1a5c-428f-9071-bdac21729daa None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:59.050555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1802d-1a5c-428f-9071-bdac21729daa None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:59.090313 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe7987-d227-4097-a34a-153c6cde0239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:59.091112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe7987-d227-4097-a34a-153c6cde0239 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:59.091420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe7987-d227-4097-a34a-153c6cde0239 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:59.091864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe7987-d227-4097-a34a-153c6cde0239 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:59.107537 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe7987-d227-4097-a34a-153c6cde0239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:59.108996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe7987-d227-4097-a34a-153c6cde0239 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:59.136568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-5cbe7987-d227-4097-a34a-153c6cde0239 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:59.136568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:59.136568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:59.136568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:59.136568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:59.136568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:59.136568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:59.136568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:59.136568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:59.136568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:59.136568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:59.136568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:59.136568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:25:59.136568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:25:59.136568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:25:59.137502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:25:59.137502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:59.137502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:59.137502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:59.137502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:59.137502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:59.137502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:59.137502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:59.137502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:59.137502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:59.137502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:59.137502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:59.137502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:59.137502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:59.137502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:59.137502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:59.137502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:59.139057 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:25:59.139057 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:25:59.139057 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:25:59.139057 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:59.139057 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 359/727] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:59.148371 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87399f-1050-40ad-9af0-06f6c82a18f7 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:59.312301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87399f-1050-40ad-9af0-06f6c82a18f7 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:59.347785 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:59.358825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf121e9-89a6-4966-81ab-a286a6984ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:59.360201 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf121e9-89a6-4966-81ab-a286a6984ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:59.360489 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf121e9-89a6-4966-81ab-a286a6984ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:59.360772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf121e9-89a6-4966-81ab-a286a6984ea1 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:59.361500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf121e9-89a6-4966-81ab-a286a6984ea1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:59.361840 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf121e9-89a6-4966-81ab-a286a6984ea1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:59.363255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf121e9-89a6-4966-81ab-a286a6984ea1 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:59.381238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 369/728] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:25:59.386322 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe7987-d227-4097-a34a-153c6cde0239 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:59.394214 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:25:59.653247 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe7987-d227-4097-a34a-153c6cde0239 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:59.702614 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75186a4f-b76c-47bb-8d8b-4c48e3e81f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:59.703458 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75186a4f-b76c-47bb-8d8b-4c48e3e81f92 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:59.703740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75186a4f-b76c-47bb-8d8b-4c48e3e81f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:59.704007 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75186a4f-b76c-47bb-8d8b-4c48e3e81f92 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:59.716703 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75186a4f-b76c-47bb-8d8b-4c48e3e81f92 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:59.718170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75186a4f-b76c-47bb-8d8b-4c48e3e81f92 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:59.736502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-75186a4f-b76c-47bb-8d8b-4c48e3e81f92 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 09:25:59.736502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:25:59.736502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:25:59.736502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:25:59.736502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:25:59.736502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:25:59.736502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:25:59.736502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:25:59.736502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:25:59.736502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:25:59.736502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:25:59.736502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:25:59.736502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:25:59.736502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:25:59.736502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:25:59.736502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:25:59.737996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:25:59.737996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:25:59.737996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:25:59.737996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:59.737996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:25:59.737996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:25:59.737996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:25:59.737996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:25:59.737996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:25:59.737996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:25:59.737996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:25:59.737996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:25:59.737996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:25:59.737996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:25:59.737996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:25:59.737996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:25:59.737996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:25:59.737996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:25:59.738894 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:25:59.738894 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:25:59.738894 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:25:59.738894 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:25:59.738894 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:25:59.738894 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:25:59.738894 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:25:59.738894 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:25:59.738894 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 09:25:59.738894 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:25:59.738894 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 360/729] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:25:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:25:59.745214 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf121e9-89a6-4966-81ab-a286a6984ea1 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:25:59.915164 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf121e9-89a6-4966-81ab-a286a6984ea1 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:25:59.941074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb054b9-554e-4d5c-89b0-0e35eab7f5bb None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:59.941476 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb054b9-554e-4d5c-89b0-0e35eab7f5bb None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:59.941754 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb054b9-554e-4d5c-89b0-0e35eab7f5bb None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:59.943246 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 361/730] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:25:59.948072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69cc29-a9f2-4461-a76d-6f30d5362ae5 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:59.948421 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69cc29-a9f2-4461-a76d-6f30d5362ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:59.948628 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69cc29-a9f2-4461-a76d-6f30d5362ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:59.970501 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-7d69cc29-a9f2-4461-a76d-6f30d5362ae5 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:25:59.974214 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3023e-b1ed-4ed9-84f6-6e3e4713de9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:25:59.975140 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3023e-b1ed-4ed9-84f6-6e3e4713de9b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:25:59.975639 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3023e-b1ed-4ed9-84f6-6e3e4713de9b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:25:59.976107 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3023e-b1ed-4ed9-84f6-6e3e4713de9b None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:25:59.977150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3023e-b1ed-4ed9-84f6-6e3e4713de9b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:25:59.977672 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3023e-b1ed-4ed9-84f6-6e3e4713de9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:25:59.979329 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3023e-b1ed-4ed9-84f6-6e3e4713de9b None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:25:59.980047 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-7d69cc29-a9f2-4461-a76d-6f30d5362ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:00.000656 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 370/731] 10.222.0.41 () {56 vars in 1135 bytes} [Fri May 27 09:25:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:00.008296 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3023e-b1ed-4ed9-84f6-6e3e4713de9b None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:00.085975 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:00.095302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 362/732] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:25:59 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:26:00.095302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce62b6d-da32-40e6-8eea-4701838e0b7d None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:00.095302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce62b6d-da32-40e6-8eea-4701838e0b7d None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:00.095302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce62b6d-da32-40e6-8eea-4701838e0b7d None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:00.095302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 363/733] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:00.100662 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:00.113980 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac0dfc-352c-45cb-aa0b-168d7d67d268 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:00.114858 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac0dfc-352c-45cb-aa0b-168d7d67d268 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:00.115117 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac0dfc-352c-45cb-aa0b-168d7d67d268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:00.138038 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-7dac0dfc-352c-45cb-aa0b-168d7d67d268 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:00.139342 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-7dac0dfc-352c-45cb-aa0b-168d7d67d268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:00.171783 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3023e-b1ed-4ed9-84f6-6e3e4713de9b None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:00.210204 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1ef52-2e14-4339-a84a-a424b113a071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:00.210855 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1ef52-2e14-4339-a84a-a424b113a071 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:00.211141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1ef52-2e14-4339-a84a-a424b113a071 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:00.211467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1ef52-2e14-4339-a84a-a424b113a071 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:00.232922 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 364/734] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 09:26:00.234079 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac0dfc-352c-45cb-aa0b-168d7d67d268 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:00.308863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b1ef52-2e14-4339-a84a-a424b113a071 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:00.310323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b1ef52-2e14-4339-a84a-a424b113a071 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:00.354526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac0dfc-352c-45cb-aa0b-168d7d67d268 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:00.362766 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:00.380648 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:00.393181 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ae46f-76c9-4f8d-b5ab-c63edb7461cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:00.394078 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ae46f-76c9-4f8d-b5ab-c63edb7461cc None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:00.394365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ae46f-76c9-4f8d-b5ab-c63edb7461cc None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:00.394636 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ae46f-76c9-4f8d-b5ab-c63edb7461cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:00.405465 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ae46f-76c9-4f8d-b5ab-c63edb7461cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:26:00.414168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-6a2ae46f-76c9-4f8d-b5ab-c63edb7461cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:26:00.414168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:00.414168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:00.414168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:00.414168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:00.414168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:00.414168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:00.414168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:00.414168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:00.414168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:00.414168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:00.414168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:00.414168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:26:00.414168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:26:00.414168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:26:00.414168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:26:00.415084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:26:00.415084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:26:00.415084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:26:00.415084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:26:00.415084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:00.415084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:00.415084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:00.415084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:00.415084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:00.415084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:00.415084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:00.415084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:00.415084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:00.415084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:00.415084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:00.415084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:00.415929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:00.415929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:00.415929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:00.415929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:00.415929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:26:00.415929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:26:00.415929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:26:00.415929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:26:00.415929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:26:00.415929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:26:00.415929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:26:00.415929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:00.415929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 365/735] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:26:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:00.416609 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ae46f-76c9-4f8d-b5ab-c63edb7461cc None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:00.427645 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 371/736] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:26:00 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 09:26:00.428493 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1ef52-2e14-4339-a84a-a424b113a071 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:00.527391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ae46f-76c9-4f8d-b5ab-c63edb7461cc None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:00.539753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1ef52-2e14-4339-a84a-a424b113a071 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:00.564321 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88a29f-04fb-4fd5-9e18-e750f0a8ede8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:00.565298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88a29f-04fb-4fd5-9e18-e750f0a8ede8 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:00.565581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88a29f-04fb-4fd5-9e18-e750f0a8ede8 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:00.565885 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88a29f-04fb-4fd5-9e18-e750f0a8ede8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:00.574275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42bc97-3dc7-4976-8145-c27420d3988c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:00.574941 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42bc97-3dc7-4976-8145-c27420d3988c None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:00.575225 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42bc97-3dc7-4976-8145-c27420d3988c None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:00.575593 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42bc97-3dc7-4976-8145-c27420d3988c None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:00.576258 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42bc97-3dc7-4976-8145-c27420d3988c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:00.576418 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88a29f-04fb-4fd5-9e18-e750f0a8ede8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:26:00.576646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42bc97-3dc7-4976-8145-c27420d3988c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:00.577945 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42bc97-3dc7-4976-8145-c27420d3988c None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:00.584640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-1a88a29f-04fb-4fd5-9e18-e750f0a8ede8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:26:00.584640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:00.584640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:00.584640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:00.584640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:00.584640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:00.584640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:00.584640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:00.584640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:00.584640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:00.584640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:00.584640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:00.584640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:26:00.584640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:26:00.584640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:26:00.584640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:26:00.586959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:26:00.586959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:26:00.586959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:26:00.586959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:26:00.586959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:00.586959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:00.586959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:00.586959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:00.586959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:00.586959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:00.586959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:00.586959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:00.586959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:00.586959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:00.586959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:00.586959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:00.588973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:00.588973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:00.588973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:00.588973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:00.588973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:26:00.588973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:26:00.588973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:26:00.588973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:26:00.588973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:26:00.588973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:26:00.588973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:26:00.588973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:00.588973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 366/737] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 09:26:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:00.588973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88a29f-04fb-4fd5-9e18-e750f0a8ede8 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:00.592342 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 372/738] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:26:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:00.593408 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be606aa-2f98-448b-8693-7c2c37fe7090 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:00.593705 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be606aa-2f98-448b-8693-7c2c37fe7090 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:00.593989 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be606aa-2f98-448b-8693-7c2c37fe7090 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:00.595403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 373/739] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:00.596027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be606aa-2f98-448b-8693-7c2c37fe7090 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:00.601270 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:00.639792 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:00.698263 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88a29f-04fb-4fd5-9e18-e750f0a8ede8 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:00.709415 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be606aa-2f98-448b-8693-7c2c37fe7090 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:00.730954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e203674-6a31-427c-a572-7f4373e8486a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:00.731767 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e203674-6a31-427c-a572-7f4373e8486a None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:00.732045 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e203674-6a31-427c-a572-7f4373e8486a None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:00.732555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e203674-6a31-427c-a572-7f4373e8486a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:00.743498 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e203674-6a31-427c-a572-7f4373e8486a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:00.743660 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b5fa7-6c2c-4236-9af5-c4a8b22b6875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:00.744410 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b5fa7-6c2c-4236-9af5-c4a8b22b6875 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:00.744696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b5fa7-6c2c-4236-9af5-c4a8b22b6875 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:00.744975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b5fa7-6c2c-4236-9af5-c4a8b22b6875 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:00.745068 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e203674-6a31-427c-a572-7f4373e8486a None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:00.745740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b5fa7-6c2c-4236-9af5-c4a8b22b6875 None admin] RBAC: Adding query filter params (name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:00.746048 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b5fa7-6c2c-4236-9af5-c4a8b22b6875 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:00.747447 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b5fa7-6c2c-4236-9af5-c4a8b22b6875 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:00.755358 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 374/740] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 09:26:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:00.756142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b5fa7-6c2c-4236-9af5-c4a8b22b6875 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:00.761764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-1e203674-6a31-427c-a572-7f4373e8486a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:00.761764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:00.761764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:00.761764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:00.761764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:00.761764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:00.761764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:00.761764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:00.761764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:00.761764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:00.761764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:00.761764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:00.761764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:00.761764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:00.761764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:00.762787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:00.762787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:00.762787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:00.762787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:00.762787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:00.762787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:00.762787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:00.762787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:00.762787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:00.762787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:00.762787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:00.762787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:00.762787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:00.762787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:00.762787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:00.762787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:00.762787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:00.763735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:00.763735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:00.763735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:00.763735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:00.763735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 367/741] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:00.764381 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589b25d-8782-44b1-979f-3006cb17568b None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:00.764661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589b25d-8782-44b1-979f-3006cb17568b None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:00.764937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589b25d-8782-44b1-979f-3006cb17568b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:00.781374 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-2589b25d-8782-44b1-979f-3006cb17568b None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:00.782543 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-2589b25d-8782-44b1-979f-3006cb17568b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:00.822166 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:00.848747 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 368/742] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:26:00.850055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d80131-4ab8-447a-b6cf-fef7f84cfcfb None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:00.850351 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d80131-4ab8-447a-b6cf-fef7f84cfcfb None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:00.850625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d80131-4ab8-447a-b6cf-fef7f84cfcfb None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:00.851902 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 369/743] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:00.852584 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d80131-4ab8-447a-b6cf-fef7f84cfcfb None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:00.860517 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b5fa7-6c2c-4236-9af5-c4a8b22b6875 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:00.889392 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:00.895286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f23a5-a021-4a74-af12-db0e073f6171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:00.896094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f23a5-a021-4a74-af12-db0e073f6171 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:00.896382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f23a5-a021-4a74-af12-db0e073f6171 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:00.896656 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f23a5-a021-4a74-af12-db0e073f6171 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:00.906790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f23a5-a021-4a74-af12-db0e073f6171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:00.908285 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f23a5-a021-4a74-af12-db0e073f6171 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:00.925352 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-b96f23a5-a021-4a74-af12-db0e073f6171 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:00.925352 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:00.925352 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:00.925352 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:00.925352 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:00.925352 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:00.925352 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:00.925352 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:00.925352 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:00.925352 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:00.925352 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:00.925352 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:00.925352 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:00.925352 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:00.925352 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:00.926668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:00.926668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:00.926668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:00.926668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:00.926668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:00.926668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:00.926668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:00.926668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:00.926668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:00.926668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:00.926668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:00.926668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:00.926668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:00.926668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:00.926668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:00.926668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:00.926668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:00.927555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:00.927555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:00.927555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:00.927555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:00.927555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 375/744] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:00.927555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f23a5-a021-4a74-af12-db0e073f6171 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:00.969491 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d80131-4ab8-447a-b6cf-fef7f84cfcfb None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:01.001860 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6232f-d632-461c-bae2-925bbbe5affd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:01.003211 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6232f-d632-461c-bae2-925bbbe5affd None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:01.003522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6232f-d632-461c-bae2-925bbbe5affd None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:01.003795 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6232f-d632-461c-bae2-925bbbe5affd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:01.013789 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6232f-d632-461c-bae2-925bbbe5affd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:01.015229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6232f-d632-461c-bae2-925bbbe5affd None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:01.025443 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f23a5-a021-4a74-af12-db0e073f6171 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:01.033889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-acd6232f-d632-461c-bae2-925bbbe5affd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:01.033889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:01.033889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:01.033889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:01.033889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:01.033889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:01.033889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:01.033889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:01.033889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:01.033889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:01.033889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:01.033889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:01.033889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:01.033889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:01.033889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:01.034967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:01.034967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:01.034967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:01.034967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:01.034967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:01.034967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:01.034967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:01.034967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:01.034967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:01.034967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:01.034967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:01.034967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:01.034967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:01.034967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:01.034967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:01.034967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:01.034967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:01.036187 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:01.036187 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:01.036187 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:01.036187 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:01.036187 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 370/745] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:01.039566 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b82fd2-859e-4d7e-b2c2-09b0971cd4d9 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:01.039855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b82fd2-859e-4d7e-b2c2-09b0971cd4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:01.040126 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b82fd2-859e-4d7e-b2c2-09b0971cd4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:01.044643 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:01.056407 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-11b82fd2-859e-4d7e-b2c2-09b0971cd4d9 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:01.057567 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-11b82fd2-859e-4d7e-b2c2-09b0971cd4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:01.065849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88886c36-d4e7-45fa-8463-46c34bf9de84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:01.066525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88886c36-d4e7-45fa-8463-46c34bf9de84 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:01.066812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88886c36-d4e7-45fa-8463-46c34bf9de84 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:01.067096 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88886c36-d4e7-45fa-8463-46c34bf9de84 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:01.067861 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88886c36-d4e7-45fa-8463-46c34bf9de84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:01.068173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88886c36-d4e7-45fa-8463-46c34bf9de84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:01.069551 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88886c36-d4e7-45fa-8463-46c34bf9de84 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:01.081909 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 376/746] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:01.082676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88886c36-d4e7-45fa-8463-46c34bf9de84 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:01.127894 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 371/747] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 09:26:01.128710 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b82fd2-859e-4d7e-b2c2-09b0971cd4d9 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:01.145963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:01.184939 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88886c36-d4e7-45fa-8463-46c34bf9de84 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:01.217663 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f6c5a-b0a5-4424-8285-510f1886eaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:01.218324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f6c5a-b0a5-4424-8285-510f1886eaa5 None admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:01.218610 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f6c5a-b0a5-4424-8285-510f1886eaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:01.218943 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f6c5a-b0a5-4424-8285-510f1886eaa5 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:01.219699 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f6c5a-b0a5-4424-8285-510f1886eaa5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:01.221012 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f6c5a-b0a5-4424-8285-510f1886eaa5 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:01.234191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 377/748] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 09:26:01 2022] POST /identity/v3/services => generated 240 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:26:01.234690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b82fd2-859e-4d7e-b2c2-09b0971cd4d9 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:01.235340 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f6c5a-b0a5-4424-8285-510f1886eaa5 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:01.287685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bdd0a-4b05-495c-a828-1cd6f45d75ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:01.288742 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bdd0a-4b05-495c-a828-1cd6f45d75ad None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:01.289304 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bdd0a-4b05-495c-a828-1cd6f45d75ad None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:01.289778 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bdd0a-4b05-495c-a828-1cd6f45d75ad None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:01.290721 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605bdd0a-4b05-495c-a828-1cd6f45d75ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:01.291168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:01.291351 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605bdd0a-4b05-495c-a828-1cd6f45d75ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:01.292714 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605bdd0a-4b05-495c-a828-1cd6f45d75ad None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:01.306988 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 372/749] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:01.307763 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bdd0a-4b05-495c-a828-1cd6f45d75ad None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:01.371393 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:01.372405 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f6c5a-b0a5-4424-8285-510f1886eaa5 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:01.411333 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde72cb-16fb-4c75-abd9-bbb3809aaab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:01.412018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde72cb-16fb-4c75-abd9-bbb3809aaab6 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:01.412659 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bdd0a-4b05-495c-a828-1cd6f45d75ad None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:01.413126 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde72cb-16fb-4c75-abd9-bbb3809aaab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:01.413126 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde72cb-16fb-4c75-abd9-bbb3809aaab6 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:01.413388 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde72cb-16fb-4c75-abd9-bbb3809aaab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:01.413740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde72cb-16fb-4c75-abd9-bbb3809aaab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:01.415263 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde72cb-16fb-4c75-abd9-bbb3809aaab6 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:01.429860 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 378/750] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:01.430494 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde72cb-16fb-4c75-abd9-bbb3809aaab6 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:01.450149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10986ca7-a6b3-4e18-b0e3-a88fe3188117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:01.450946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10986ca7-a6b3-4e18-b0e3-a88fe3188117 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:01.451225 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10986ca7-a6b3-4e18-b0e3-a88fe3188117 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:01.451530 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10986ca7-a6b3-4e18-b0e3-a88fe3188117 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:01.458567 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10986ca7-a6b3-4e18-b0e3-a88fe3188117 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:01.460133 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10986ca7-a6b3-4e18-b0e3-a88fe3188117 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:01.474526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-10986ca7-a6b3-4e18-b0e3-a88fe3188117 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:01.474526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:01.474526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:01.474526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:01.474526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:01.474526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:01.474526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:01.474526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:01.474526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:01.474526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:01.474526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:01.474526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:01.474526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:26:01.474526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:26:01.474526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:26:01.475474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:26:01.475474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:01.475474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:01.475474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:01.475474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:01.475474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:01.475474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:01.475474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:01.475474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:01.475474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:01.475474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:01.475474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:01.475474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:01.475474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:01.475474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:01.475474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:01.475474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:01.476762 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:26:01.476762 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:26:01.476762 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:26:01.476762 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:26:01.476762 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:26:01.476762 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:26:01.476762 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:01.476762 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:01.476762 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 373/751] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:26:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:01.476762 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10986ca7-a6b3-4e18-b0e3-a88fe3188117 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:01.538857 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:01.543215 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde72cb-16fb-4c75-abd9-bbb3809aaab6 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:01.582968 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10986ca7-a6b3-4e18-b0e3-a88fe3188117 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:01.608501 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:01.622499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e306e7-cde6-475f-aa26-b60ff1b8930f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:01.623662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e306e7-cde6-475f-aa26-b60ff1b8930f None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:01.624119 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e306e7-cde6-475f-aa26-b60ff1b8930f None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:01.624567 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e306e7-cde6-475f-aa26-b60ff1b8930f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:01.633089 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e306e7-cde6-475f-aa26-b60ff1b8930f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:01.634869 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e306e7-cde6-475f-aa26-b60ff1b8930f None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:01.650927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-03e306e7-cde6-475f-aa26-b60ff1b8930f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:26:01.650927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:01.650927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:01.650927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:01.650927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:01.650927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:01.650927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:01.650927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:01.650927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:01.650927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:01.650927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:01.650927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:01.650927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:26:01.650927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:26:01.650927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:26:01.650927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:26:01.652072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:01.652072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:01.652072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:26:01.652072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:01.652072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:26:01.652072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:01.652072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:01.652072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:01.652072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:01.652072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:01.652072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:01.652072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:01.652072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:01.652072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:01.652072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:01.652072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:01.652072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:01.652072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:01.653020 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:01.653020 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:01.653020 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:26:01.653020 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:26:01.653020 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:26:01.653020 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:26:01.653020 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:26:01.653020 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:26:01.653020 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:26:01.653020 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:01.653535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 374/752] 10.222.0.41 () {56 vars in 1093 bytes} [Fri May 27 09:26:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:01.654158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e306e7-cde6-475f-aa26-b60ff1b8930f None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:01.707346 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f48f1a-8aa2-4031-a054-2ac5e12da8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:01.708178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f48f1a-8aa2-4031-a054-2ac5e12da8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:01.708460 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f48f1a-8aa2-4031-a054-2ac5e12da8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:01.708735 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f48f1a-8aa2-4031-a054-2ac5e12da8e0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:01.709384 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f48f1a-8aa2-4031-a054-2ac5e12da8e0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:01.710778 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f48f1a-8aa2-4031-a054-2ac5e12da8e0 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:01.723940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-90f48f1a-8aa2-4031-a054-2ac5e12da8e0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:26:01.723940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:01.723940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:26:01.723940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:26:01.723940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:26:01.723940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:26:01.723940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:26:01.723940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:01.723940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:26:01.723940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:01.723940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:01.723940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:01.723940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:01.723940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:01.723940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:01.723940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:01.724947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:01.724947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:01.724947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:01.724947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:01.724947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:01.724947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:01.724947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:01.724947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:26:01.724947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:26:01.724947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:26:01.724947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:26:01.724947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:01.724947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:01.724947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:01.724947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:01.724947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:01.725791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:01.725791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:01.725791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:01.725791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:01.725791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:01.725791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:01.725791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:01.725791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:01.725791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:01.725791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:01.725791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:01.725791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:26:01.725791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:01.725791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:26:01.725791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:01.725791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 379/753] 10.222.0.41 () {56 vars in 1129 bytes} [Fri May 27 09:26:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:01.727149 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f48f1a-8aa2-4031-a054-2ac5e12da8e0 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:01.768335 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e306e7-cde6-475f-aa26-b60ff1b8930f None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:01.805479 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db93cf7-fdda-4ae3-b3e9-81c9558e20d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:01.806446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db93cf7-fdda-4ae3-b3e9-81c9558e20d9 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:01.806727 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db93cf7-fdda-4ae3-b3e9-81c9558e20d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:01.806997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db93cf7-fdda-4ae3-b3e9-81c9558e20d9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:01.814255 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db93cf7-fdda-4ae3-b3e9-81c9558e20d9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:01.815765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db93cf7-fdda-4ae3-b3e9-81c9558e20d9 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:01.831098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-8db93cf7-fdda-4ae3-b3e9-81c9558e20d9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:26:01.831098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:01.831098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:01.831098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:01.831098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:01.831098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:01.831098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:01.831098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:01.831098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:01.831098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:01.831098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:01.831098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:01.831098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:26:01.831098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:26:01.831098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:26:01.831098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:26:01.832300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:01.832300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:01.832300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:26:01.832300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:01.832300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:26:01.832300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:01.832300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:01.832300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:01.832300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:01.832300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:01.832300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:01.832300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:01.832300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:01.832300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:01.832300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:01.832300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:01.832300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:01.832300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:01.833437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:01.833437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:01.833437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:26:01.833437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:26:01.833437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:26:01.833437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:26:01.833437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:26:01.833437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:26:01.833437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:26:01.833437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:01.837037 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 375/754] 10.222.0.41 () {56 vars in 1117 bytes} [Fri May 27 09:26:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:01.837886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db93cf7-fdda-4ae3-b3e9-81c9558e20d9 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:01.842969 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f48f1a-8aa2-4031-a054-2ac5e12da8e0 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:01.881116 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630bd35-a029-40d2-a220-1782135c455e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:01.881781 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630bd35-a029-40d2-a220-1782135c455e None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:01.882060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630bd35-a029-40d2-a220-1782135c455e None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:01.882330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630bd35-a029-40d2-a220-1782135c455e None admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:01.882425 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:01.883122 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630bd35-a029-40d2-a220-1782135c455e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:01.883473 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630bd35-a029-40d2-a220-1782135c455e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:01.884922 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630bd35-a029-40d2-a220-1782135c455e None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:01.896604 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 380/755] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:26:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:01.897638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630bd35-a029-40d2-a220-1782135c455e None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:01.925595 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:01.949296 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db93cf7-fdda-4ae3-b3e9-81c9558e20d9 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:01.987116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4c786-ca2f-4748-bca2-1df7890ca0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:01.987735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4c786-ca2f-4748-bca2-1df7890ca0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:01.988019 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4c786-ca2f-4748-bca2-1df7890ca0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:01.988293 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4c786-ca2f-4748-bca2-1df7890ca0c2 None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:01.989246 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4c786-ca2f-4748-bca2-1df7890ca0c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:01.989559 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4c786-ca2f-4748-bca2-1df7890ca0c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:01.990975 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4c786-ca2f-4748-bca2-1df7890ca0c2 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:02.000539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630bd35-a029-40d2-a220-1782135c455e None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:02.014468 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 376/756] 10.222.0.41 () {56 vars in 1133 bytes} [Fri May 27 09:26:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:02.014468 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4c786-ca2f-4748-bca2-1df7890ca0c2 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:02.040456 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1ae48-f795-47cb-9fd5-5e192ebe40d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:02.041136 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1ae48-f795-47cb-9fd5-5e192ebe40d9 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:02.041418 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1ae48-f795-47cb-9fd5-5e192ebe40d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:02.041696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1ae48-f795-47cb-9fd5-5e192ebe40d9 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:02.042399 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1ae48-f795-47cb-9fd5-5e192ebe40d9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:02.042706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1ae48-f795-47cb-9fd5-5e192ebe40d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:02.044153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1ae48-f795-47cb-9fd5-5e192ebe40d9 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:02.048744 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 381/757] 10.222.0.41 () {56 vars in 1124 bytes} [Fri May 27 09:26:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:02.049566 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1ae48-f795-47cb-9fd5-5e192ebe40d9 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:02.124612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:02.128128 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4c786-ca2f-4748-bca2-1df7890ca0c2 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:02.146592 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:02.162793 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89811b2a-7c39-4b08-8cb8-61b595e67c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:02.163492 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89811b2a-7c39-4b08-8cb8-61b595e67c21 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:02.163715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1ae48-f795-47cb-9fd5-5e192ebe40d9 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:02.163835 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89811b2a-7c39-4b08-8cb8-61b595e67c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:02.164033 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89811b2a-7c39-4b08-8cb8-61b595e67c21 None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:02.164846 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89811b2a-7c39-4b08-8cb8-61b595e67c21 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:02.165154 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89811b2a-7c39-4b08-8cb8-61b595e67c21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:02.166563 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89811b2a-7c39-4b08-8cb8-61b595e67c21 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:02.183292 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 377/758] 10.222.0.41 () {56 vars in 1149 bytes} [Fri May 27 09:26:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:02.184072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89811b2a-7c39-4b08-8cb8-61b595e67c21 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:02.202470 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9d085-b5b4-44bf-b037-e9fd72c6ec9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:02.203491 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9d085-b5b4-44bf-b037-e9fd72c6ec9b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:02.203953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9d085-b5b4-44bf-b037-e9fd72c6ec9b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:02.204534 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9d085-b5b4-44bf-b037-e9fd72c6ec9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:02.206106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9d085-b5b4-44bf-b037-e9fd72c6ec9b None admin] RBAC: Adding query filter params (role.id=bb6c5483d9be4a16ac64750536c5e2e2, scope.project.id=b1d802dc0211467fa4e709cd01d411dc, user.id=351f74222d394f39bda0663e0e4ebde6) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:02.206601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9d085-b5b4-44bf-b037-e9fd72c6ec9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:02.208345 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9d085-b5b4-44bf-b037-e9fd72c6ec9b None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:02.214533 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 382/759] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:26:02 2022] GET /identity/v3/role_assignments?user.id=351f74222d394f39bda0663e0e4ebde6&scope.project.id=b1d802dc0211467fa4e709cd01d411dc&role.id=bb6c5483d9be4a16ac64750536c5e2e2 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:02.215530 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9d085-b5b4-44bf-b037-e9fd72c6ec9b None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:02.309036 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89811b2a-7c39-4b08-8cb8-61b595e67c21 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:02.348003 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665bde3-b505-482c-82b0-d60542f4d1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:02.348901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665bde3-b505-482c-82b0-d60542f4d1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:02.349250 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665bde3-b505-482c-82b0-d60542f4d1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:02.349589 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665bde3-b505-482c-82b0-d60542f4d1b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:02.360170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9d085-b5b4-44bf-b037-e9fd72c6ec9b None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:02.362209 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665bde3-b505-482c-82b0-d60542f4d1b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:02.363934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665bde3-b505-482c-82b0-d60542f4d1b9 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:02.391172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-d665bde3-b505-482c-82b0-d60542f4d1b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:02.391172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:02.391172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:02.391172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:02.391172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:02.391172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:02.391172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:02.391172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:02.391172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:02.391172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:02.391172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:02.391172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:02.391172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:02.391172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:02.391172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:02.392245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:02.392245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:02.392245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:02.392245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:02.392245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:02.392245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:02.392245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:02.392245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:02.392245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:02.392245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:02.392245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:02.392245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:02.392245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:02.392245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:02.392245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:02.392245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:02.392245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:02.393728 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:02.393728 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:02.393728 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:02.393728 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:02.399677 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 378/760] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:02.400676 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665bde3-b505-482c-82b0-d60542f4d1b9 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:02.409212 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dc745-e81e-40b6-9539-1e0c13971ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:02.410052 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dc745-e81e-40b6-9539-1e0c13971ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:02.410448 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dc745-e81e-40b6-9539-1e0c13971ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:02.410837 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dc745-e81e-40b6-9539-1e0c13971ca6 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:02.411843 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0dc745-e81e-40b6-9539-1e0c13971ca6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:02.412249 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0dc745-e81e-40b6-9539-1e0c13971ca6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:02.415019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0dc745-e81e-40b6-9539-1e0c13971ca6 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:02.415975 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:02.420309 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 383/761] 10.222.0.41 () {56 vars in 1124 bytes} [Fri May 27 09:26:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:02.421126 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dc745-e81e-40b6-9539-1e0c13971ca6 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:02.447660 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:02.531815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dc745-e81e-40b6-9539-1e0c13971ca6 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:02.536336 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665bde3-b505-482c-82b0-d60542f4d1b9 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:02.573328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7c626-daf2-4987-9852-3389106988e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:02.574368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7c626-daf2-4987-9852-3389106988e7 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:02.574852 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7c626-daf2-4987-9852-3389106988e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:02.575362 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7c626-daf2-4987-9852-3389106988e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:02.576296 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7c626-daf2-4987-9852-3389106988e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:02.576843 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7c626-daf2-4987-9852-3389106988e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:02.578411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7c626-daf2-4987-9852-3389106988e7 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:02.582849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c080d94-5803-40af-8a31-6801fd7fbd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:02.583530 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c080d94-5803-40af-8a31-6801fd7fbd19 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:02.583813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c080d94-5803-40af-8a31-6801fd7fbd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:02.584088 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c080d94-5803-40af-8a31-6801fd7fbd19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:02.596678 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 384/762] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:02.597907 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7c626-daf2-4987-9852-3389106988e7 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:02.673804 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c080d94-5803-40af-8a31-6801fd7fbd19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:02.675849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c080d94-5803-40af-8a31-6801fd7fbd19 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:02.678053 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:02.691083 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:02.715459 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7c626-daf2-4987-9852-3389106988e7 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:02.761126 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f95f0-4a52-4bd3-8149-7ff1336832de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:02.761797 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f95f0-4a52-4bd3-8149-7ff1336832de None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:02.762082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f95f0-4a52-4bd3-8149-7ff1336832de None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:02.762364 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f95f0-4a52-4bd3-8149-7ff1336832de None admin] PATH_INFO: `/v3/endpoints` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:02.763438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f95f0-4a52-4bd3-8149-7ff1336832de None admin] RBAC: Adding query filter params (interface=public, service_id=d08aacd097c043afa793ae6c7016e830, region_id=RegionOne) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:02.763755 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f95f0-4a52-4bd3-8149-7ff1336832de None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:02.765869 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f95f0-4a52-4bd3-8149-7ff1336832de None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:02.776341 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 385/763] 10.222.0.41 () {56 vars in 1251 bytes} [Fri May 27 09:26:02 2022] GET /identity/v3/endpoints?service_id=d08aacd097c043afa793ae6c7016e830&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:02.777498 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f95f0-4a52-4bd3-8149-7ff1336832de None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:02.785083 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 379/764] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:26:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:26:02.786264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c080d94-5803-40af-8a31-6801fd7fbd19 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:02.909340 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f95f0-4a52-4bd3-8149-7ff1336832de None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:02.916156 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c080d94-5803-40af-8a31-6801fd7fbd19 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:02.928766 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:02.954965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53843a0b-b56b-4df4-b336-a2dc9ead1287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:02.955520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2b1cb-086f-49ea-a3f1-20f8585829d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:02.956332 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2b1cb-086f-49ea-a3f1-20f8585829d7 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:02.956616 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2b1cb-086f-49ea-a3f1-20f8585829d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:02.956896 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2b1cb-086f-49ea-a3f1-20f8585829d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:02.957305 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53843a0b-b56b-4df4-b336-a2dc9ead1287 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:02.957782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53843a0b-b56b-4df4-b336-a2dc9ead1287 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:02.958265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53843a0b-b56b-4df4-b336-a2dc9ead1287 None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:02.959180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53843a0b-b56b-4df4-b336-a2dc9ead1287 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:02.960792 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53843a0b-b56b-4df4-b336-a2dc9ead1287 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:02.964985 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2b1cb-086f-49ea-a3f1-20f8585829d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:02.966448 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2b1cb-086f-49ea-a3f1-20f8585829d7 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:02.967372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 380/765] 10.222.0.41 () {56 vars in 1087 bytes} [Fri May 27 09:26:02 2022] GET /identity/v3/services => generated 772 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:02.968409 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:02.968621 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53843a0b-b56b-4df4-b336-a2dc9ead1287 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:02.987478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-27e2b1cb-086f-49ea-a3f1-20f8585829d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:02.987478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:02.987478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:02.987478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:02.987478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:02.987478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:02.987478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:02.987478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:02.987478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:02.987478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:02.987478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:02.987478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:02.987478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:26:02.987478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:26:02.987478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:26:02.988438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:26:02.988438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:02.988438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:02.988438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:02.988438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:02.988438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:02.988438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:02.988438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:02.988438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:02.988438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:02.988438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:02.988438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:02.988438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:02.988438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:02.988438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:02.988438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:02.988438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:02.989304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:26:02.989304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:26:02.989304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:26:02.989304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:26:02.989304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:26:02.989304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:26:02.989304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:02.989304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:02.992254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 386/766] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:26:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:02.998466 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2b1cb-086f-49ea-a3f1-20f8585829d7 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:03.134365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53843a0b-b56b-4df4-b336-a2dc9ead1287 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:03.175613 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc88f55-816b-41cc-8347-9f8226957d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:03.176774 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc88f55-816b-41cc-8347-9f8226957d04 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:03.177331 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc88f55-816b-41cc-8347-9f8226957d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:03.177809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc88f55-816b-41cc-8347-9f8226957d04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:03.191807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc88f55-816b-41cc-8347-9f8226957d04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:03.194265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc88f55-816b-41cc-8347-9f8226957d04 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:03.197521 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2b1cb-086f-49ea-a3f1-20f8585829d7 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:03.216911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-9dc88f55-816b-41cc-8347-9f8226957d04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:03.216911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:03.216911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:03.216911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:03.216911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:03.216911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:03.216911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:03.216911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:03.216911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:03.216911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:03.216911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:03.216911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:03.216911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:03.216911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:03.216911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:03.217987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:03.217987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:03.217987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:03.217987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:03.217987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:03.217987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:03.217987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:03.217987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:03.217987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:03.217987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:03.217987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:03.217987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:03.217987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:03.217987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:03.217987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:03.217987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:03.217987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:03.218852 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:03.218852 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:03.218852 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:03.218852 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:03.221474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 381/767] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:03.227957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc88f55-816b-41cc-8347-9f8226957d04 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:03.258862 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307e9eb-de20-4fc3-a5ae-a4525a0462ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:03.259571 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307e9eb-de20-4fc3-a5ae-a4525a0462ce None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:03.259853 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307e9eb-de20-4fc3-a5ae-a4525a0462ce None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:03.260385 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307e9eb-de20-4fc3-a5ae-a4525a0462ce None admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:03.260904 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307e9eb-de20-4fc3-a5ae-a4525a0462ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:03.261212 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307e9eb-de20-4fc3-a5ae-a4525a0462ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:03.262652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307e9eb-de20-4fc3-a5ae-a4525a0462ce None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:03.263390 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:03.276635 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 387/768] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:26:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:03.286517 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307e9eb-de20-4fc3-a5ae-a4525a0462ce None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:03.359957 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:03.372208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc88f55-816b-41cc-8347-9f8226957d04 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:03.416736 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db57438-aac5-41de-9dae-904b209e7fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:03.417406 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db57438-aac5-41de-9dae-904b209e7fde None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:03.417674 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db57438-aac5-41de-9dae-904b209e7fde None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:03.417957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db57438-aac5-41de-9dae-904b209e7fde None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:03.418657 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db57438-aac5-41de-9dae-904b209e7fde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:03.418959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db57438-aac5-41de-9dae-904b209e7fde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:03.420466 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db57438-aac5-41de-9dae-904b209e7fde None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:03.422161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307e9eb-de20-4fc3-a5ae-a4525a0462ce None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:03.433365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 382/769] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:03.441325 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db57438-aac5-41de-9dae-904b209e7fde None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:03.473029 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5203f9-2d27-4832-a034-9dbcb7c4f7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:03.475400 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5203f9-2d27-4832-a034-9dbcb7c4f7be None admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:03.475400 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5203f9-2d27-4832-a034-9dbcb7c4f7be None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:03.475400 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5203f9-2d27-4832-a034-9dbcb7c4f7be None admin] PATH_INFO: `/v3/projects/b1d802dc0211467fa4e709cd01d411dc/users/d2b1c12e88c549208894fc0dd0c60b88/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:03.478484 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5203f9-2d27-4832-a034-9dbcb7c4f7be None admin] RBAC: Authorizing `identity:create_grant(project_id=b1d802dc0211467fa4e709cd01d411dc, user_id=d2b1c12e88c549208894fc0dd0c60b88, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:03.480691 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5203f9-2d27-4832-a034-9dbcb7c4f7be None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:03.507681 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 388/770] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:26:03 2022] PUT /identity/v3/projects/b1d802dc0211467fa4e709cd01d411dc/users/d2b1c12e88c549208894fc0dd0c60b88/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:26:03.555433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:03.589911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db57438-aac5-41de-9dae-904b209e7fde None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:03.644860 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d57541-def0-4baa-b696-a6c7785f3999 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:03.645353 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d57541-def0-4baa-b696-a6c7785f3999 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:03.645731 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d57541-def0-4baa-b696-a6c7785f3999 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:03.645842 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066a41b-3a03-4121-891b-0fea93d84df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:03.646549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066a41b-3a03-4121-891b-0fea93d84df1 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:03.646830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066a41b-3a03-4121-891b-0fea93d84df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:03.647102 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066a41b-3a03-4121-891b-0fea93d84df1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:03.648014 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 389/771] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:26:03.653809 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ba71c-0c93-4cb5-9e8e-d003b36d9c00 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:03.654228 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ba71c-0c93-4cb5-9e8e-d003b36d9c00 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:03.654605 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ba71c-0c93-4cb5-9e8e-d003b36d9c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:03.657462 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066a41b-3a03-4121-891b-0fea93d84df1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:03.659077 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066a41b-3a03-4121-891b-0fea93d84df1 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:03.689144 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-331ba71c-0c93-4cb5-9e8e-d003b36d9c00 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:03.691394 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-331ba71c-0c93-4cb5-9e8e-d003b36d9c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:03.692783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-2066a41b-3a03-4121-891b-0fea93d84df1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:03.692783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:03.692783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:03.692783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:03.692783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:03.692783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:03.692783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:03.692783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:03.692783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:03.692783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:03.692783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:03.692783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:03.692783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:26:03.692783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:26:03.692783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:26:03.693839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:26:03.693839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:03.693839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:03.693839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:03.693839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:03.693839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:03.693839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:03.693839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:03.693839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:03.693839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:03.693839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:03.693839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:03.693839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:03.693839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:03.693839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:03.693839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:03.693839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:03.694916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:26:03.694916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:26:03.694916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:26:03.694916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:26:03.694916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:26:03.694916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:26:03.694916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:03.694916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:03.697673 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 383/772] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:26:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:03.704497 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066a41b-3a03-4121-891b-0fea93d84df1 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:03.793827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 390/773] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:26:03.816504 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ba71c-0c93-4cb5-9e8e-d003b36d9c00 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:03.854739 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066a41b-3a03-4121-891b-0fea93d84df1 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:03.911669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:03.930279 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073006a3-c831-4717-b92b-b82d82721402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:03.930957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073006a3-c831-4717-b92b-b82d82721402 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:03.931241 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073006a3-c831-4717-b92b-b82d82721402 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:03.931540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073006a3-c831-4717-b92b-b82d82721402 None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:03.932402 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073006a3-c831-4717-b92b-b82d82721402 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:03.932713 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073006a3-c831-4717-b92b-b82d82721402 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:03.934152 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073006a3-c831-4717-b92b-b82d82721402 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:03.964799 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 384/774] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:26:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:03.975518 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073006a3-c831-4717-b92b-b82d82721402 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:03.990261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:03.997545 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ba71c-0c93-4cb5-9e8e-d003b36d9c00 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:04.067101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca41c6-d23e-445f-abbb-53792348a07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:04.068177 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca41c6-d23e-445f-abbb-53792348a07f None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:04.068635 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca41c6-d23e-445f-abbb-53792348a07f None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:04.069081 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca41c6-d23e-445f-abbb-53792348a07f None admin] PATH_INFO: `/v3/services/network` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:04.069906 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca41c6-d23e-445f-abbb-53792348a07f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:04.071491 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca41c6-d23e-445f-abbb-53792348a07f None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:04.091675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-59ca41c6-d23e-445f-abbb-53792348a07f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:26:04.091675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:04.091675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:26:04.091675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:26:04.091675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:26:04.091675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:26:04.091675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:26:04.091675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:04.091675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:26:04.091675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:04.091675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:04.091675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:04.091675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:04.091675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:04.091675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:04.091675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:04.091675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:04.092722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:04.092722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:04.092722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:04.092722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:04.092722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:04.092722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:04.092722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:26:04.092722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:26:04.092722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:26:04.092722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:26:04.092722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:04.092722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:04.092722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:04.092722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:04.092722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:04.092722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:04.093564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:04.093564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:04.093564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:04.093564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:04.093564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:04.093564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:04.093564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:04.093564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:04.093564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:04.093564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:04.093564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:26:04.093564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:04.093564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:26:04.093564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:04.093564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 391/775] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:26:03 2022] GET /identity/v3/services/network => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:04.099451 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca41c6-d23e-445f-abbb-53792348a07f None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:04.171098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073006a3-c831-4717-b92b-b82d82721402 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:04.245574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca41c6-d23e-445f-abbb-53792348a07f None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:04.251468 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7518f7b-a369-4b58-a5cf-9f2a39fbfb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:04.252354 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7518f7b-a369-4b58-a5cf-9f2a39fbfb5e None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:04.252644 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7518f7b-a369-4b58-a5cf-9f2a39fbfb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:04.252924 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7518f7b-a369-4b58-a5cf-9f2a39fbfb5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:04.254113 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7518f7b-a369-4b58-a5cf-9f2a39fbfb5e None admin] RBAC: Adding query filter params (role.id=5cde0d2bc9ca433b8904823fc602ab67, scope.project.id=b1d802dc0211467fa4e709cd01d411dc, user.id=f52f0a03cc0f494d82a091bd885478e1) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:04.254345 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7518f7b-a369-4b58-a5cf-9f2a39fbfb5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:04.255823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7518f7b-a369-4b58-a5cf-9f2a39fbfb5e None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:04.269989 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 385/776] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:26:03 2022] GET /identity/v3/role_assignments?user.id=f52f0a03cc0f494d82a091bd885478e1&scope.project.id=b1d802dc0211467fa4e709cd01d411dc&role.id=5cde0d2bc9ca433b8904823fc602ab67 => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:04.273119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:04.310991 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f0c9e-e330-4a48-93ce-98a755578923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:04.311742 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f0c9e-e330-4a48-93ce-98a755578923 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:04.312033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f0c9e-e330-4a48-93ce-98a755578923 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:04.312317 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f0c9e-e330-4a48-93ce-98a755578923 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:04.313050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f0c9e-e330-4a48-93ce-98a755578923 None admin] RBAC: Adding query filter params (name=network) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:04.313365 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f0c9e-e330-4a48-93ce-98a755578923 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:04.314837 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f0c9e-e330-4a48-93ce-98a755578923 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:04.320834 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 392/777] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 09:26:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:04.326317 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7518f7b-a369-4b58-a5cf-9f2a39fbfb5e None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:04.424912 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:04.478118 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7518f7b-a369-4b58-a5cf-9f2a39fbfb5e None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:04.520954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc0d24-868c-460a-99fb-3782f5cb72a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:04.521656 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc0d24-868c-460a-99fb-3782f5cb72a7 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:04.521943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc0d24-868c-460a-99fb-3782f5cb72a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:04.522224 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc0d24-868c-460a-99fb-3782f5cb72a7 None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:04.522970 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc0d24-868c-460a-99fb-3782f5cb72a7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:04.523304 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc0d24-868c-460a-99fb-3782f5cb72a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:04.524742 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc0d24-868c-460a-99fb-3782f5cb72a7 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:04.530997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 386/778] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 09:26:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:04.537553 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f0c9e-e330-4a48-93ce-98a755578923 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:04.655812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f0c9e-e330-4a48-93ce-98a755578923 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:04.698726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395046c-0006-4d26-9350-bc33391b02a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:04.699442 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395046c-0006-4d26-9350-bc33391b02a9 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:04.699734 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395046c-0006-4d26-9350-bc33391b02a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:04.700023 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395046c-0006-4d26-9350-bc33391b02a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:04.700823 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395046c-0006-4d26-9350-bc33391b02a9 None admin] RBAC: Adding query filter params (interface=public, service_id=a84527b133d3430d93ffafe86fae8805, region_id=RegionOne) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:04.701152 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395046c-0006-4d26-9350-bc33391b02a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:04.702526 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395046c-0006-4d26-9350-bc33391b02a9 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:04.713154 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 393/779] 10.222.0.41 () {56 vars in 1251 bytes} [Fri May 27 09:26:04 2022] GET /identity/v3/endpoints?service_id=a84527b133d3430d93ffafe86fae8805&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:04.718324 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc0d24-868c-460a-99fb-3782f5cb72a7 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:04.722143 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61261a38-8d7b-4fae-83ff-fea3134e98ae None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:04.722435 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61261a38-8d7b-4fae-83ff-fea3134e98ae None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:04.722718 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61261a38-8d7b-4fae-83ff-fea3134e98ae None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:04.724346 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 394/780] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:04.729474 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147adfc-2718-419b-bf5d-41129aa3beb2 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:04.729768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147adfc-2718-419b-bf5d-41129aa3beb2 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:04.730054 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147adfc-2718-419b-bf5d-41129aa3beb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:04.750869 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-f147adfc-2718-419b-bf5d-41129aa3beb2 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:04.753932 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f147adfc-2718-419b-bf5d-41129aa3beb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:04.822925 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:04.874009 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 395/781] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:26:04.911206 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147adfc-2718-419b-bf5d-41129aa3beb2 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:04.917901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc0d24-868c-460a-99fb-3782f5cb72a7 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:04.981316 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e64ca-1106-443f-8a8a-f017066a0a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:04.981968 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e64ca-1106-443f-8a8a-f017066a0a1d None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:04.982207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e64ca-1106-443f-8a8a-f017066a0a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:04.982477 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e64ca-1106-443f-8a8a-f017066a0a1d None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:04.983174 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e64ca-1106-443f-8a8a-f017066a0a1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:04.984888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e64ca-1106-443f-8a8a-f017066a0a1d None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:04.991590 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 387/782] 10.222.0.41 () {56 vars in 1087 bytes} [Fri May 27 09:26:04 2022] GET /identity/v3/services => generated 772 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:04.991872 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:05.065854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147adfc-2718-419b-bf5d-41129aa3beb2 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:05.116555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297947c-22c3-499e-9b42-6fef2807785f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:05.117320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297947c-22c3-499e-9b42-6fef2807785f None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:05.117605 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297947c-22c3-499e-9b42-6fef2807785f None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:05.117879 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297947c-22c3-499e-9b42-6fef2807785f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:05.138653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297947c-22c3-499e-9b42-6fef2807785f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:26:05.146774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-4297947c-22c3-499e-9b42-6fef2807785f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:26:05.146774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:05.146774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:05.146774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:05.146774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:05.146774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:05.146774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:05.146774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:05.146774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:05.146774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:05.146774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:05.146774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:05.146774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:26:05.146774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:26:05.146774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:26:05.146774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:26:05.147824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:26:05.147824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:26:05.147824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:26:05.147824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:26:05.147824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:05.147824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:05.147824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:05.147824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:05.147824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:05.147824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:05.147824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:05.147824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:05.147824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:05.147824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:05.147824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:05.147824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:05.148640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:05.148640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:05.148640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:05.148640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:05.148640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:26:05.148640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:26:05.148640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:26:05.148640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:26:05.148640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:26:05.148640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:26:05.148640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:26:05.148640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:05.148640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 396/783] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:26:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:05.155945 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e64ca-1106-443f-8a8a-f017066a0a1d None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:05.300967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e64ca-1106-443f-8a8a-f017066a0a1d None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:05.341829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b410f8-5f1e-4e37-a0bd-8da374bbe082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:05.342510 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b410f8-5f1e-4e37-a0bd-8da374bbe082 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:05.342792 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b410f8-5f1e-4e37-a0bd-8da374bbe082 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:05.343063 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b410f8-5f1e-4e37-a0bd-8da374bbe082 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:05.343829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b410f8-5f1e-4e37-a0bd-8da374bbe082 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:05.344137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b410f8-5f1e-4e37-a0bd-8da374bbe082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:05.345499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b410f8-5f1e-4e37-a0bd-8da374bbe082 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:05.355036 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 388/784] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:26:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:05.360962 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297947c-22c3-499e-9b42-6fef2807785f None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:05.398742 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:05.494288 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297947c-22c3-499e-9b42-6fef2807785f None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:05.543992 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3899d0-dbc1-4590-917c-a394be95fa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:05.544808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3899d0-dbc1-4590-917c-a394be95fa96 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:05.545094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3899d0-dbc1-4590-917c-a394be95fa96 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:05.545368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3899d0-dbc1-4590-917c-a394be95fa96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:05.563555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3899d0-dbc1-4590-917c-a394be95fa96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:05.565227 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3899d0-dbc1-4590-917c-a394be95fa96 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:05.585831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-af3899d0-dbc1-4590-917c-a394be95fa96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:05.585831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:05.585831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:05.585831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:05.585831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:05.585831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:05.585831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:05.585831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:05.585831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:05.585831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:05.585831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:05.585831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:05.585831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:05.585831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:05.585831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:05.586776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:05.586776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:05.586776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:05.586776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:05.586776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:05.586776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:05.586776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:05.586776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:05.586776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:05.586776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:05.586776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:05.586776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:05.586776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:05.586776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:05.586776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:05.586776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:05.586776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:05.587693 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:05.587693 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:05.587693 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:05.587693 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:05.590663 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 397/785] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:05.592736 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b410f8-5f1e-4e37-a0bd-8da374bbe082 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:05.670360 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:05.730362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b410f8-5f1e-4e37-a0bd-8da374bbe082 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:05.779302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212c914-2ab7-401a-be1e-7fb53a698c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:05.779302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212c914-2ab7-401a-be1e-7fb53a698c7c None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:05.779302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212c914-2ab7-401a-be1e-7fb53a698c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:05.779302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212c914-2ab7-401a-be1e-7fb53a698c7c None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:05.779753 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212c914-2ab7-401a-be1e-7fb53a698c7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:05.779753 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212c914-2ab7-401a-be1e-7fb53a698c7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:05.779753 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212c914-2ab7-401a-be1e-7fb53a698c7c None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:05.792738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 389/786] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:05.800426 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3899d0-dbc1-4590-917c-a394be95fa96 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:05.935718 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:05.941333 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3899d0-dbc1-4590-917c-a394be95fa96 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:05.945106 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f10cf-cbd0-4d0b-9e7a-af03d1f20055 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:05.945394 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f10cf-cbd0-4d0b-9e7a-af03d1f20055 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:05.945669 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f10cf-cbd0-4d0b-9e7a-af03d1f20055 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:05.947238 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 390/787] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:26:05.953257 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289b6c7-de15-4503-b6b2-dff3254146e0 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:05.953785 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289b6c7-de15-4503-b6b2-dff3254146e0 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:05.954254 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289b6c7-de15-4503-b6b2-dff3254146e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:05.973449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-5289b6c7-de15-4503-b6b2-dff3254146e0 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:05.975142 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-5289b6c7-de15-4503-b6b2-dff3254146e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:06.010689 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897adfdf-a794-4727-9bb6-daaaf3a0f631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:06.011685 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897adfdf-a794-4727-9bb6-daaaf3a0f631 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:06.011978 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897adfdf-a794-4727-9bb6-daaaf3a0f631 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:06.012257 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897adfdf-a794-4727-9bb6-daaaf3a0f631 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:06.026394 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897adfdf-a794-4727-9bb6-daaaf3a0f631 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:06.027932 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897adfdf-a794-4727-9bb6-daaaf3a0f631 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:06.060169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-897adfdf-a794-4727-9bb6-daaaf3a0f631 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 09:26:06.060169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:06.060169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:06.060169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:06.060169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:06.060169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:06.060169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:06.060169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:06.060169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:06.060169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:06.060169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:06.060169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:06.060169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:26:06.060169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:26:06.060169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:26:06.060169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:26:06.061189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:06.061189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:06.061189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:26:06.061189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:06.061189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:26:06.061189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:06.061189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:06.061189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:06.061189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:06.061189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:06.061189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:06.061189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:06.061189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:06.061189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:06.061189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:06.061189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:06.061189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:06.061189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:06.062137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:06.062137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:06.062137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:26:06.062137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:26:06.062137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:26:06.062137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:26:06.062137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:26:06.062137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:26:06.062137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 09:26:06.062137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:06.065993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 398/788] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:26:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:06.076523 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897adfdf-a794-4727-9bb6-daaaf3a0f631 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:06.076889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 391/789] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:26:06.156829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289b6c7-de15-4503-b6b2-dff3254146e0 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:06.215688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:06.240541 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897adfdf-a794-4727-9bb6-daaaf3a0f631 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:06.292340 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a278c-d771-4a36-a9e3-bae43c0b55c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:06.293012 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a278c-d771-4a36-a9e3-bae43c0b55c3 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:06.293297 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a278c-d771-4a36-a9e3-bae43c0b55c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:06.293575 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a278c-d771-4a36-a9e3-bae43c0b55c3 None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:06.294466 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a278c-d771-4a36-a9e3-bae43c0b55c3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:06.294780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a278c-d771-4a36-a9e3-bae43c0b55c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:06.296310 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a278c-d771-4a36-a9e3-bae43c0b55c3 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:06.296910 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289b6c7-de15-4503-b6b2-dff3254146e0 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:06.311452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:06.316991 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 399/790] 10.222.0.41 () {56 vars in 1135 bytes} [Fri May 27 09:26:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:06.318362 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524de25d-a4ad-43bf-ba36-74778517c9d2 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:06.319007 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524de25d-a4ad-43bf-ba36-74778517c9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:06.319395 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524de25d-a4ad-43bf-ba36-74778517c9d2 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:06.324809 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 400/791] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:06.324809 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524de25d-a4ad-43bf-ba36-74778517c9d2 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:06.351094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f3985-08d1-40d6-8fc0-b90fd7177cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:06.352808 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f3985-08d1-40d6-8fc0-b90fd7177cde None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:06.353237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f3985-08d1-40d6-8fc0-b90fd7177cde None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:06.353650 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f3985-08d1-40d6-8fc0-b90fd7177cde None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:06.354686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f3985-08d1-40d6-8fc0-b90fd7177cde None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:06.357011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f3985-08d1-40d6-8fc0-b90fd7177cde None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:06.373251 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-d96f3985-08d1-40d6-8fc0-b90fd7177cde None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:26:06.373251 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:06.373251 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:26:06.373251 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:26:06.373251 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:26:06.373251 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:26:06.373251 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:26:06.373251 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:06.373251 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:26:06.373251 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:06.373251 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:06.373251 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:06.373251 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:06.373251 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:06.373251 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:06.373251 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:06.374364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:06.374364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:06.374364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:06.374364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:06.374364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:06.374364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:06.374364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:06.374364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:26:06.374364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:26:06.374364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:26:06.374364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:26:06.374364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:06.374364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:06.374364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:06.374364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:06.374364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:06.375176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:06.375176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:06.375176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:06.375176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:06.375176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:06.375176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:06.375176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:06.375176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:06.375176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:06.375176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:06.375176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:06.375176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:26:06.375176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:06.375176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 09:26:06.375176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:06.376720 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 392/792] 10.222.0.41 () {56 vars in 1129 bytes} [Fri May 27 09:26:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:06.379833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a976c-5c3a-4bcd-ac00-b55dc14fa170 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:06.380113 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a976c-5c3a-4bcd-ac00-b55dc14fa170 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:06.380383 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a976c-5c3a-4bcd-ac00-b55dc14fa170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:06.400781 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-902a976c-5c3a-4bcd-ac00-b55dc14fa170 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:06.402197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-902a976c-5c3a-4bcd-ac00-b55dc14fa170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:06.445633 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524de25d-a4ad-43bf-ba36-74778517c9d2 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:06.483464 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 393/793] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:06.483464 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a976c-5c3a-4bcd-ac00-b55dc14fa170 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:06.488839 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe707232-4594-4033-97f8-332fad9a79b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:06.495307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe707232-4594-4033-97f8-332fad9a79b0 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:06.496539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe707232-4594-4033-97f8-332fad9a79b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:06.497026 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe707232-4594-4033-97f8-332fad9a79b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:06.516845 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe707232-4594-4033-97f8-332fad9a79b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:06.523479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe707232-4594-4033-97f8-332fad9a79b0 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:06.535036 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:06.552952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-fe707232-4594-4033-97f8-332fad9a79b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:06.552952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:06.552952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:06.552952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:06.552952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:06.552952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:06.552952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:06.552952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:06.552952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:06.552952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:06.552952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:06.552952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:06.552952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:06.552952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:06.552952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:06.553863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:06.553863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:06.553863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:06.553863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:06.553863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:06.553863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:06.553863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:06.553863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:06.553863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:06.553863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:06.553863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:06.553863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:06.553863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:06.553863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:06.553863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:06.553863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:06.553863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:06.554725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:06.554725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:06.554725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:06.554725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:06.558208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 401/794] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:06.559727 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe707232-4594-4033-97f8-332fad9a79b0 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:06.595449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a976c-5c3a-4bcd-ac00-b55dc14fa170 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:06.621363 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:06.635676 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd55b9-328a-41e3-aec6-549ff47a3dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:06.636605 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd55b9-328a-41e3-aec6-549ff47a3dfe None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:06.637035 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd55b9-328a-41e3-aec6-549ff47a3dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:06.637511 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd55b9-328a-41e3-aec6-549ff47a3dfe None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:06.638363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd55b9-328a-41e3-aec6-549ff47a3dfe None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:06.638931 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd55b9-328a-41e3-aec6-549ff47a3dfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:06.640608 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd55b9-328a-41e3-aec6-549ff47a3dfe None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:06.646545 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 394/795] 10.222.0.41 () {56 vars in 1124 bytes} [Fri May 27 09:26:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:06.647619 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd55b9-328a-41e3-aec6-549ff47a3dfe None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:06.678985 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe707232-4594-4033-97f8-332fad9a79b0 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:06.715940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b9c4b-a6a9-42d1-8a03-8f88c33b1b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:06.716882 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b9c4b-a6a9-42d1-8a03-8f88c33b1b28 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:06.717286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b9c4b-a6a9-42d1-8a03-8f88c33b1b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:06.717668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b9c4b-a6a9-42d1-8a03-8f88c33b1b28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:06.729761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b9c4b-a6a9-42d1-8a03-8f88c33b1b28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:26:06.740153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-4c6b9c4b-a6a9-42d1-8a03-8f88c33b1b28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:26:06.740153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:06.740153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:06.740153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:06.740153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:06.740153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:06.740153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:06.740153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:06.740153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:06.740153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:06.740153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:06.740153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:06.740153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:26:06.740153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:26:06.740153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:26:06.740153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:26:06.741255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:26:06.741255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:26:06.741255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:26:06.741255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:26:06.741255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:06.741255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:06.741255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:06.741255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:06.741255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:06.741255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:06.741255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:06.741255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:06.741255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:06.741255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:06.741255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:06.741255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:06.742100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:06.742100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:06.742100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:06.742100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:06.742100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:26:06.742100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:26:06.742100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:26:06.742100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:26:06.742100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:26:06.742100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:26:06.742100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:26:06.742100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:06.747248 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 402/796] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:26:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:06.748332 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b9c4b-a6a9-42d1-8a03-8f88c33b1b28 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:06.758295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd55b9-328a-41e3-aec6-549ff47a3dfe None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:06.769531 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:06.798398 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08750b65-0633-4588-b45e-9004379de857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:06.799112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08750b65-0633-4588-b45e-9004379de857 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:06.799442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08750b65-0633-4588-b45e-9004379de857 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:06.799717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08750b65-0633-4588-b45e-9004379de857 None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:06.800456 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08750b65-0633-4588-b45e-9004379de857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:06.800758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08750b65-0633-4588-b45e-9004379de857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:06.802177 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08750b65-0633-4588-b45e-9004379de857 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:06.820681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 395/797] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:06.821705 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08750b65-0633-4588-b45e-9004379de857 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:06.877823 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b9c4b-a6a9-42d1-8a03-8f88c33b1b28 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:06.892671 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:06.920296 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbd023-37fa-4668-801c-e78fd74c36aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:06.921504 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbd023-37fa-4668-801c-e78fd74c36aa None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:06.922050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbd023-37fa-4668-801c-e78fd74c36aa None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:06.922520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbd023-37fa-4668-801c-e78fd74c36aa None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:06.923631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbd023-37fa-4668-801c-e78fd74c36aa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:06.924199 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbd023-37fa-4668-801c-e78fd74c36aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:06.927150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbd023-37fa-4668-801c-e78fd74c36aa None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:06.929343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08750b65-0633-4588-b45e-9004379de857 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:06.933418 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 403/798] 10.222.0.41 () {56 vars in 1124 bytes} [Fri May 27 09:26:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:06.935154 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbd023-37fa-4668-801c-e78fd74c36aa None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:06.965481 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c061a-16ee-4b8c-8623-b28600dc2868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:06.966155 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c061a-16ee-4b8c-8623-b28600dc2868 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:06.966438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c061a-16ee-4b8c-8623-b28600dc2868 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:06.966710 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c061a-16ee-4b8c-8623-b28600dc2868 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:06.967485 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c061a-16ee-4b8c-8623-b28600dc2868 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:06.967796 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c061a-16ee-4b8c-8623-b28600dc2868 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:06.969285 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c061a-16ee-4b8c-8623-b28600dc2868 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:06.982248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 396/799] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:26:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:06.982248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c061a-16ee-4b8c-8623-b28600dc2868 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:07.014289 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:07.055550 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbd023-37fa-4668-801c-e78fd74c36aa None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:07.094905 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de9f6b-b059-49ba-a408-983ab51b3bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:07.095759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de9f6b-b059-49ba-a408-983ab51b3bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:07.096072 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de9f6b-b059-49ba-a408-983ab51b3bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:07.096314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c061a-16ee-4b8c-8623-b28600dc2868 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:07.096416 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de9f6b-b059-49ba-a408-983ab51b3bc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:07.103872 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de9f6b-b059-49ba-a408-983ab51b3bc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:07.105337 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de9f6b-b059-49ba-a408-983ab51b3bc8 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:07.119980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-00de9f6b-b059-49ba-a408-983ab51b3bc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:07.119980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:07.119980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:07.119980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:07.119980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:07.119980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:07.119980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:07.119980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:07.119980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:07.119980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:07.119980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:07.119980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:07.119980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:26:07.119980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:26:07.119980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:26:07.121008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:26:07.121008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:07.121008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:07.121008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:07.121008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:07.121008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:07.121008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:07.121008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:07.121008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:07.121008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:07.121008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:07.121008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:07.121008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:07.121008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:07.121008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:07.121008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:07.121008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:07.121877 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:26:07.121877 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:26:07.121877 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:26:07.121877 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:26:07.121877 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:26:07.121877 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:26:07.121877 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:07.121877 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:07.121877 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 404/800] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:26:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:07.122349 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de9f6b-b059-49ba-a408-983ab51b3bc8 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:07.135602 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9f9c3-a311-4c0a-8578-45e81c8d607e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:07.136360 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9f9c3-a311-4c0a-8578-45e81c8d607e None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:07.136649 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9f9c3-a311-4c0a-8578-45e81c8d607e None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:07.136924 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9f9c3-a311-4c0a-8578-45e81c8d607e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:07.137661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9f9c3-a311-4c0a-8578-45e81c8d607e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:07.139062 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9f9c3-a311-4c0a-8578-45e81c8d607e None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:07.161461 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 397/801] 10.222.0.41 () {60 vars in 1144 bytes} [Fri May 27 09:26:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:26:07.163556 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:07.164658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f009c9-1b87-4095-b99a-4a622916392a None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:07.164947 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f009c9-1b87-4095-b99a-4a622916392a None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:07.165222 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f009c9-1b87-4095-b99a-4a622916392a None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:07.166859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 398/802] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:07.168478 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f009c9-1b87-4095-b99a-4a622916392a None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:07.246247 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de9f6b-b059-49ba-a408-983ab51b3bc8 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:07.292213 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3932e4-9dff-418b-b875-ffdd88ee30fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:07.293022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3932e4-9dff-418b-b875-ffdd88ee30fe None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:07.293304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3932e4-9dff-418b-b875-ffdd88ee30fe None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:07.293630 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3932e4-9dff-418b-b875-ffdd88ee30fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:07.300447 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:07.305693 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3932e4-9dff-418b-b875-ffdd88ee30fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:07.307193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3932e4-9dff-418b-b875-ffdd88ee30fe None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:07.323517 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f009c9-1b87-4095-b99a-4a622916392a None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:07.329510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-2c3932e4-9dff-418b-b875-ffdd88ee30fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:07.329510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:07.329510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:07.329510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:07.329510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:07.329510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:07.329510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:07.329510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:07.329510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:07.329510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:07.329510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:07.329510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:07.329510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:07.329510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:07.329510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:07.331161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:07.331161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:07.331161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:07.331161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:07.331161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:07.331161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:07.331161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:07.331161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:07.331161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:07.331161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:07.331161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:07.331161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:07.331161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:07.331161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:07.331161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:07.331161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:07.331161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:07.332282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:07.332282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:07.332282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:07.332282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:07.336072 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 405/803] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:07.337595 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f17fbd-c30f-412d-b1ab-332cbe61c2b6 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:07.337879 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f17fbd-c30f-412d-b1ab-332cbe61c2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:07.338155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f17fbd-c30f-412d-b1ab-332cbe61c2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:07.357981 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-48f17fbd-c30f-412d-b1ab-332cbe61c2b6 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:07.359195 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-48f17fbd-c30f-412d-b1ab-332cbe61c2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:07.376687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88840afb-7f24-4c8f-be91-788ef9536000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:07.377992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88840afb-7f24-4c8f-be91-788ef9536000 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:07.378434 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88840afb-7f24-4c8f-be91-788ef9536000 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:07.378709 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88840afb-7f24-4c8f-be91-788ef9536000 None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:07.380212 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88840afb-7f24-4c8f-be91-788ef9536000 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:07.380212 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88840afb-7f24-4c8f-be91-788ef9536000 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:07.382081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88840afb-7f24-4c8f-be91-788ef9536000 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:07.396317 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 399/804] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:26:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:07.397496 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88840afb-7f24-4c8f-be91-788ef9536000 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:07.457897 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 406/805] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:07.459693 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f17fbd-c30f-412d-b1ab-332cbe61c2b6 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:07.489509 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:07.542340 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88840afb-7f24-4c8f-be91-788ef9536000 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:07.586618 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a56e00-2274-4d52-9091-7bca8a04a062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:07.587307 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a56e00-2274-4d52-9091-7bca8a04a062 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:07.587588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a56e00-2274-4d52-9091-7bca8a04a062 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:07.587862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a56e00-2274-4d52-9091-7bca8a04a062 None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:07.588583 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a56e00-2274-4d52-9091-7bca8a04a062 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:07.588888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a56e00-2274-4d52-9091-7bca8a04a062 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:07.590277 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a56e00-2274-4d52-9091-7bca8a04a062 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:07.602856 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 400/806] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:07.603498 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a56e00-2274-4d52-9091-7bca8a04a062 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:07.612743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:07.614566 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f17fbd-c30f-412d-b1ab-332cbe61c2b6 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:07.650755 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e6318-7da8-4ad1-a4d6-c4e4b32cf255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:07.651677 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e6318-7da8-4ad1-a4d6-c4e4b32cf255 None admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:07.651960 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e6318-7da8-4ad1-a4d6-c4e4b32cf255 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:07.652235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e6318-7da8-4ad1-a4d6-c4e4b32cf255 None admin] PATH_INFO: `/v3/projects/b1d802dc0211467fa4e709cd01d411dc/users/351f74222d394f39bda0663e0e4ebde6/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:07.654935 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e6318-7da8-4ad1-a4d6-c4e4b32cf255 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1d802dc0211467fa4e709cd01d411dc, user_id=351f74222d394f39bda0663e0e4ebde6, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:07.656504 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e6318-7da8-4ad1-a4d6-c4e4b32cf255 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:07.675337 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 407/807] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:26:07 2022] PUT /identity/v3/projects/b1d802dc0211467fa4e709cd01d411dc/users/351f74222d394f39bda0663e0e4ebde6/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:26:07.675337 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1bfa1-f7f4-43d4-b041-648b44dc142c None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:07.675337 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1bfa1-f7f4-43d4-b041-648b44dc142c None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:07.675337 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1bfa1-f7f4-43d4-b041-648b44dc142c None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:07.675337 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 408/808] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:07.675337 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1bfa1-f7f4-43d4-b041-648b44dc142c None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:07.733602 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a56e00-2274-4d52-9091-7bca8a04a062 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:07.775888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce824a3-d073-4704-bade-e2b4e6c8d8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:07.776830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce824a3-d073-4704-bade-e2b4e6c8d8dd None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:07.777212 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce824a3-d073-4704-bade-e2b4e6c8d8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:07.777553 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce824a3-d073-4704-bade-e2b4e6c8d8dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:07.786414 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:07.791518 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce824a3-d073-4704-bade-e2b4e6c8d8dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:26:07.804094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-5ce824a3-d073-4704-bade-e2b4e6c8d8dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:26:07.804094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:07.804094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:07.804094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:07.804094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:07.804094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:07.804094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:07.804094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:07.804094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:07.804094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:07.804094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:07.804094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:07.804094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:26:07.804094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:26:07.804094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:26:07.804094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:26:07.805248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:26:07.805248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:26:07.805248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:26:07.805248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:26:07.805248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:07.805248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:07.805248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:07.805248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:07.805248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:07.805248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:07.805248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:07.805248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:07.805248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:07.805248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:07.805248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:07.805248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:07.806228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:07.806228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:07.806228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:07.806228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:07.806228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:26:07.806228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:26:07.806228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:26:07.806228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:26:07.806228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:26:07.806228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:26:07.806228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:26:07.806228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:07.806868 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 401/809] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 09:26:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:07.810992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ca77c-6512-42bb-b6a8-df3f7df757af None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:07.810992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ca77c-6512-42bb-b6a8-df3f7df757af None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:07.810992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ca77c-6512-42bb-b6a8-df3f7df757af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:07.817723 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1bfa1-f7f4-43d4-b041-648b44dc142c None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:07.827663 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-9f2ca77c-6512-42bb-b6a8-df3f7df757af None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:07.829063 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-9f2ca77c-6512-42bb-b6a8-df3f7df757af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:07.861274 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5e5bc-405d-4a2b-ba16-4e31bb6c94a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:07.862767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5e5bc-405d-4a2b-ba16-4e31bb6c94a2 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:07.863059 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5e5bc-405d-4a2b-ba16-4e31bb6c94a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:07.863359 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5e5bc-405d-4a2b-ba16-4e31bb6c94a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:07.873362 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5e5bc-405d-4a2b-ba16-4e31bb6c94a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:07.879117 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5e5bc-405d-4a2b-ba16-4e31bb6c94a2 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:07.893128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-45b5e5bc-405d-4a2b-ba16-4e31bb6c94a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:26:07.893128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:07.893128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:07.893128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:07.893128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:07.893128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:07.893128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:07.893128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:07.893128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:07.893128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:07.893128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:07.893128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:07.893128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:26:07.893128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:26:07.893128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:26:07.893128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:26:07.894291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:07.894291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:07.894291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:26:07.894291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:07.894291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:26:07.894291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:07.894291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:07.894291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:07.894291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:07.894291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:07.894291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:07.894291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:07.894291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:07.894291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:07.894291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:07.894291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:07.894291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:07.894291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:07.895477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:07.895477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:07.895477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:26:07.895477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:26:07.895477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:26:07.895477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:26:07.895477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:26:07.895477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:26:07.895477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:26:07.895477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:07.896186 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 409/810] 10.222.0.41 () {56 vars in 1093 bytes} [Fri May 27 09:26:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:07.896326 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5e5bc-405d-4a2b-ba16-4e31bb6c94a2 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:07.906854 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:07.921273 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 402/811] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:07.921273 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ca77c-6512-42bb-b6a8-df3f7df757af None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:08.042267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5e5bc-405d-4a2b-ba16-4e31bb6c94a2 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:08.068391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ca77c-6512-42bb-b6a8-df3f7df757af None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:08.086289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44fe502-2b8d-41fa-a9f7-84c5fbd7c9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:08.086970 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fe502-2b8d-41fa-a9f7-84c5fbd7c9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:08.087259 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fe502-2b8d-41fa-a9f7-84c5fbd7c9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:08.087588 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fe502-2b8d-41fa-a9f7-84c5fbd7c9f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:08.088339 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44fe502-2b8d-41fa-a9f7-84c5fbd7c9f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:08.088652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44fe502-2b8d-41fa-a9f7-84c5fbd7c9f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:08.090037 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44fe502-2b8d-41fa-a9f7-84c5fbd7c9f0 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:08.091627 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:08.100596 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 410/812] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 09:26:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:08.101381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44fe502-2b8d-41fa-a9f7-84c5fbd7c9f0 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:08.119693 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4c0fa-96be-4bd5-8312-6f2034e06f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:08.120974 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4c0fa-96be-4bd5-8312-6f2034e06f8d None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:08.121437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4c0fa-96be-4bd5-8312-6f2034e06f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:08.122103 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4c0fa-96be-4bd5-8312-6f2034e06f8d None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:08.123644 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4c0fa-96be-4bd5-8312-6f2034e06f8d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:08.124376 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4c0fa-96be-4bd5-8312-6f2034e06f8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:08.126273 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4c0fa-96be-4bd5-8312-6f2034e06f8d None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:08.152222 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 403/813] 10.222.0.41 () {56 vars in 1133 bytes} [Fri May 27 09:26:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:08.153779 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4c0fa-96be-4bd5-8312-6f2034e06f8d None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:08.217763 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44fe502-2b8d-41fa-a9f7-84c5fbd7c9f0 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:08.227250 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:08.258498 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c27a62-2ca7-44c6-8923-781e20660b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:08.259701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c27a62-2ca7-44c6-8923-781e20660b02 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:08.260137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c27a62-2ca7-44c6-8923-781e20660b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:08.260562 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c27a62-2ca7-44c6-8923-781e20660b02 None admin] PATH_INFO: `/v3/services/network` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:08.261380 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c27a62-2ca7-44c6-8923-781e20660b02 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:08.262989 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c27a62-2ca7-44c6-8923-781e20660b02 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:08.277479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-d5c27a62-2ca7-44c6-8923-781e20660b02 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:26:08.277479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:08.277479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:26:08.277479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:26:08.277479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:26:08.277479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:26:08.277479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:26:08.277479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:08.277479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:26:08.277479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:08.277479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:08.277479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:08.277479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:08.277479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:08.277479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:08.277479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:08.277479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:08.278532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:08.278532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:08.278532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:08.278532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:08.278532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:08.278532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:08.278532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:26:08.278532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:26:08.278532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:26:08.278532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:26:08.278532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:08.278532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:08.278532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:08.278532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:08.278532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:08.278532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:08.279389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:08.279389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:08.279389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:08.279389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:08.279389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:08.279389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:08.279389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:08.279389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:08.279389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:08.279389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:08.279389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:26:08.279389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:08.279389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 09:26:08.279389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:08.282536 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 411/814] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:26:08 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:08.284192 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c27a62-2ca7-44c6-8923-781e20660b02 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:08.295927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4c0fa-96be-4bd5-8312-6f2034e06f8d None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:08.342079 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732ed1c-0767-46f9-9af5-c8b827ef997a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:08.343113 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732ed1c-0767-46f9-9af5-c8b827ef997a None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:08.343483 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732ed1c-0767-46f9-9af5-c8b827ef997a None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:08.343841 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732ed1c-0767-46f9-9af5-c8b827ef997a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:08.354625 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:08.358880 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732ed1c-0767-46f9-9af5-c8b827ef997a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:08.361540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732ed1c-0767-46f9-9af5-c8b827ef997a None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:08.385993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-a732ed1c-0767-46f9-9af5-c8b827ef997a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:08.385993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:08.385993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:08.385993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:08.385993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:08.385993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:08.385993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:08.385993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:08.385993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:08.385993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:08.385993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:08.385993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:08.385993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:08.385993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:08.385993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:08.386948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:08.386948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:08.386948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:08.386948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:08.386948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:08.386948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:08.386948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:08.386948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:08.386948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:08.386948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:08.386948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:08.386948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:08.386948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:08.386948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:08.386948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:08.386948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:08.386948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:08.388018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:08.388018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:08.388018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:08.388018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:08.388018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 404/815] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:08.388288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732ed1c-0767-46f9-9af5-c8b827ef997a None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:08.407362 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c27a62-2ca7-44c6-8923-781e20660b02 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:08.450196 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fe1db-f33c-411e-b30f-d7a4f050630b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:08.451164 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fe1db-f33c-411e-b30f-d7a4f050630b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:08.451487 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fe1db-f33c-411e-b30f-d7a4f050630b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:08.451772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fe1db-f33c-411e-b30f-d7a4f050630b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:08.509610 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732ed1c-0767-46f9-9af5-c8b827ef997a None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:08.517408 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:08.532280 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fe1db-f33c-411e-b30f-d7a4f050630b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:08.534444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fe1db-f33c-411e-b30f-d7a4f050630b None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:08.548280 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786aa34-4e30-425e-9d4f-d4d28d121511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:08.549864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786aa34-4e30-425e-9d4f-d4d28d121511 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:08.550342 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786aa34-4e30-425e-9d4f-d4d28d121511 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:08.550808 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786aa34-4e30-425e-9d4f-d4d28d121511 None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:08.551738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786aa34-4e30-425e-9d4f-d4d28d121511 None admin] RBAC: Adding query filter params (name=network) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:08.552255 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786aa34-4e30-425e-9d4f-d4d28d121511 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:08.553816 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786aa34-4e30-425e-9d4f-d4d28d121511 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:08.559129 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 405/816] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 09:26:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:08.560198 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786aa34-4e30-425e-9d4f-d4d28d121511 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:08.611264 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:08.647339 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 412/817] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:26:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:26:08.647339 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fe1db-f33c-411e-b30f-d7a4f050630b None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:08.675005 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786aa34-4e30-425e-9d4f-d4d28d121511 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:08.710403 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c5c02-1780-4390-a9ad-ac9eb36dc675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:08.711401 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c5c02-1780-4390-a9ad-ac9eb36dc675 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:08.711884 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c5c02-1780-4390-a9ad-ac9eb36dc675 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:08.712354 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c5c02-1780-4390-a9ad-ac9eb36dc675 None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:08.713295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c5c02-1780-4390-a9ad-ac9eb36dc675 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:08.713795 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c5c02-1780-4390-a9ad-ac9eb36dc675 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:08.715360 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c5c02-1780-4390-a9ad-ac9eb36dc675 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:08.727913 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 406/818] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:08.728932 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c5c02-1780-4390-a9ad-ac9eb36dc675 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:08.746365 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fe1db-f33c-411e-b30f-d7a4f050630b None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:08.761509 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:08.782398 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043c69e-1763-41d3-a073-3251fe555980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:08.783110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043c69e-1763-41d3-a073-3251fe555980 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:08.784027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043c69e-1763-41d3-a073-3251fe555980 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:08.784314 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043c69e-1763-41d3-a073-3251fe555980 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:08.785021 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043c69e-1763-41d3-a073-3251fe555980 None admin] RBAC: Adding query filter params (type=network) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:08.785331 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043c69e-1763-41d3-a073-3251fe555980 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:08.786836 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043c69e-1763-41d3-a073-3251fe555980 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:08.792232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 413/819] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 09:26:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:08.793157 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043c69e-1763-41d3-a073-3251fe555980 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:08.819891 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:08.844142 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c5c02-1780-4390-a9ad-ac9eb36dc675 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:08.889989 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450f42b-56c6-4f13-83f4-72fecf367f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:08.891167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450f42b-56c6-4f13-83f4-72fecf367f6b None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:08.891698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450f42b-56c6-4f13-83f4-72fecf367f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:08.892221 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450f42b-56c6-4f13-83f4-72fecf367f6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:08.902646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043c69e-1763-41d3-a073-3251fe555980 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:08.905922 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450f42b-56c6-4f13-83f4-72fecf367f6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:08.907592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450f42b-56c6-4f13-83f4-72fecf367f6b None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:08.926886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-0450f42b-56c6-4f13-83f4-72fecf367f6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:08.926886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:08.926886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:08.926886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:08.926886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:08.926886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:08.926886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:08.926886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:08.926886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:08.926886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:08.926886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:08.926886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:08.926886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:08.926886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:08.926886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:08.927853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:08.927853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:08.927853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:08.927853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:08.927853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:08.927853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:08.927853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:08.927853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:08.927853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:08.927853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:08.927853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:08.927853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:08.927853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:08.927853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:08.927853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:08.927853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:08.927853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:08.928718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:08.928718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:08.928718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:08.928718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:08.936607 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 407/820] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:08.937794 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450f42b-56c6-4f13-83f4-72fecf367f6b None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:08.939236 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d39793-c067-45d0-9f81-e981aa245126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:08.940203 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d39793-c067-45d0-9f81-e981aa245126 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:08.940497 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d39793-c067-45d0-9f81-e981aa245126 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:08.940772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d39793-c067-45d0-9f81-e981aa245126 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:08.948943 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d39793-c067-45d0-9f81-e981aa245126 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:08.950446 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d39793-c067-45d0-9f81-e981aa245126 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:08.966711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-c6d39793-c067-45d0-9f81-e981aa245126 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:26:08.966711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:08.966711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:08.966711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:08.966711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:08.966711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:08.966711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:08.966711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:08.966711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:08.966711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:08.966711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:08.966711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:08.966711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:26:08.966711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:26:08.966711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:26:08.966711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:26:08.967738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:08.967738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:08.967738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:26:08.967738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:08.967738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:26:08.967738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:08.967738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:08.967738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:08.967738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:08.967738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:08.967738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:08.967738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:08.967738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:08.967738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:08.967738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:08.967738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:08.967738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:08.967738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:08.968652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:08.968652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:08.968652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:26:08.968652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:26:08.968652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:26:08.968652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:26:08.968652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:26:08.968652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:26:08.968652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:26:08.968652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:08.968652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 414/821] 10.222.0.41 () {56 vars in 1117 bytes} [Fri May 27 09:26:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:08.969734 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d39793-c067-45d0-9f81-e981aa245126 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:09.033214 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:09.054956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450f42b-56c6-4f13-83f4-72fecf367f6b None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:09.057790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:09.075150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d39793-c067-45d0-9f81-e981aa245126 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:09.095193 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc43f3d-ec79-4510-8ee4-8ee205b72d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:09.096170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc43f3d-ec79-4510-8ee4-8ee205b72d75 None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:09.096549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc43f3d-ec79-4510-8ee4-8ee205b72d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:09.096917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc43f3d-ec79-4510-8ee4-8ee205b72d75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:09.097750 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc43f3d-ec79-4510-8ee4-8ee205b72d75 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:09.099322 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc43f3d-ec79-4510-8ee4-8ee205b72d75 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:09.114216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa309e-6ceb-40ef-9e73-ae3d9a7c57a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:09.114921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa309e-6ceb-40ef-9e73-ae3d9a7c57a8 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:09.115168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa309e-6ceb-40ef-9e73-ae3d9a7c57a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:09.115480 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa309e-6ceb-40ef-9e73-ae3d9a7c57a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:09.116204 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa309e-6ceb-40ef-9e73-ae3d9a7c57a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:09.116524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa309e-6ceb-40ef-9e73-ae3d9a7c57a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:09.117896 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa309e-6ceb-40ef-9e73-ae3d9a7c57a8 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:09.121382 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 408/822] 10.222.0.41 () {60 vars in 1144 bytes} [Fri May 27 09:26:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:26:09.122284 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc43f3d-ec79-4510-8ee4-8ee205b72d75 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:09.139386 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 415/823] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:09.141751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa309e-6ceb-40ef-9e73-ae3d9a7c57a8 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:09.246029 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc43f3d-ec79-4510-8ee4-8ee205b72d75 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:09.262399 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa309e-6ceb-40ef-9e73-ae3d9a7c57a8 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:09.283777 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7d991-9ad6-45f5-84cb-a3e433013d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:09.284458 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7d991-9ad6-45f5-84cb-a3e433013d9d None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:09.284743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7d991-9ad6-45f5-84cb-a3e433013d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:09.285018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7d991-9ad6-45f5-84cb-a3e433013d9d None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:09.285857 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7d991-9ad6-45f5-84cb-a3e433013d9d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:09.286163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7d991-9ad6-45f5-84cb-a3e433013d9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:09.287635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7d991-9ad6-45f5-84cb-a3e433013d9d None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:09.289445 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:09.303570 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f0c54-c445-43ba-9022-4443145de7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:09.304016 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f0c54-c445-43ba-9022-4443145de7bd None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:09.304395 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f0c54-c445-43ba-9022-4443145de7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:09.304812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f0c54-c445-43ba-9022-4443145de7bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:09.308343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 409/824] 10.222.0.41 () {56 vars in 1149 bytes} [Fri May 27 09:26:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:09.319301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f0c54-c445-43ba-9022-4443145de7bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:09.319301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f0c54-c445-43ba-9022-4443145de7bd None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:09.320667 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7d991-9ad6-45f5-84cb-a3e433013d9d None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:09.332543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-313f0c54-c445-43ba-9022-4443145de7bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:09.332543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:09.332543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:09.332543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:09.332543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:09.332543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:09.332543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:09.332543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:09.332543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:09.332543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:09.332543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:09.332543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:09.332543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:26:09.332543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:26:09.332543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:26:09.333520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:26:09.333520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:09.333520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:09.333520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:09.333520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:09.333520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:09.333520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:09.333520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:09.333520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:09.333520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:09.333520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:09.333520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:09.333520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:09.333520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:09.333520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:09.333520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:09.333520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:09.334419 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:26:09.334419 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:26:09.334419 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:26:09.334419 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:26:09.334419 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:26:09.334419 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:26:09.334419 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:09.334419 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:09.334419 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 416/825] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:26:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:09.340478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f0c54-c445-43ba-9022-4443145de7bd None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:09.344847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:09.439635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7d991-9ad6-45f5-84cb-a3e433013d9d None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:09.480218 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab102803-f08a-4cec-bb1a-f08f5e41f437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:09.481322 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab102803-f08a-4cec-bb1a-f08f5e41f437 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:09.481782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab102803-f08a-4cec-bb1a-f08f5e41f437 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:09.482255 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab102803-f08a-4cec-bb1a-f08f5e41f437 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:09.482738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f0c54-c445-43ba-9022-4443145de7bd None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:09.494974 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab102803-f08a-4cec-bb1a-f08f5e41f437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:09.496724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab102803-f08a-4cec-bb1a-f08f5e41f437 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:09.516640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-ab102803-f08a-4cec-bb1a-f08f5e41f437 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:09.516640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:09.516640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:09.516640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:09.516640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:09.516640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:09.516640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:09.516640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:09.516640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:09.516640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:09.516640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:09.516640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:09.516640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:09.516640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:09.516640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:09.517588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:09.517588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:09.517588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:09.517588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:09.517588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:09.517588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:09.517588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:09.517588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:09.517588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:09.517588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:09.517588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:09.517588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:09.517588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:09.517588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:09.517588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:09.517588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:09.517588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:09.518496 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:09.518496 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:09.518496 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:09.518496 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:09.520782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 410/826] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:09.527244 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939efe8-6e3b-41af-bae4-312bad35b822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:09.527954 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939efe8-6e3b-41af-bae4-312bad35b822 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:09.528238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939efe8-6e3b-41af-bae4-312bad35b822 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:09.528513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939efe8-6e3b-41af-bae4-312bad35b822 None admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:09.529306 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939efe8-6e3b-41af-bae4-312bad35b822 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:09.529620 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939efe8-6e3b-41af-bae4-312bad35b822 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:09.531059 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939efe8-6e3b-41af-bae4-312bad35b822 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:09.531534 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab102803-f08a-4cec-bb1a-f08f5e41f437 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:09.546967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 417/827] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:26:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:09.551129 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3617026-b8f9-4de2-9e37-d7f61aeea0f8 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:09.551553 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3617026-b8f9-4de2-9e37-d7f61aeea0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:09.551932 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3617026-b8f9-4de2-9e37-d7f61aeea0f8 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:09.553358 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 418/828] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:26:09.554144 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3617026-b8f9-4de2-9e37-d7f61aeea0f8 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:09.591384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:09.631187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:09.664844 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab102803-f08a-4cec-bb1a-f08f5e41f437 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:09.681519 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3617026-b8f9-4de2-9e37-d7f61aeea0f8 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:09.701669 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98023b5d-7a85-4187-a3df-5550939e967e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:09.702318 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98023b5d-7a85-4187-a3df-5550939e967e None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:09.702597 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98023b5d-7a85-4187-a3df-5550939e967e None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:09.703150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98023b5d-7a85-4187-a3df-5550939e967e None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:09.703615 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98023b5d-7a85-4187-a3df-5550939e967e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:09.703926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98023b5d-7a85-4187-a3df-5550939e967e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:09.705366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98023b5d-7a85-4187-a3df-5550939e967e None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:09.717396 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e2137-cc61-4677-b875-5c959b0b7985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:09.722121 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 411/829] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:09.722244 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e2137-cc61-4677-b875-5c959b0b7985 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:09.722244 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e2137-cc61-4677-b875-5c959b0b7985 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:09.722244 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e2137-cc61-4677-b875-5c959b0b7985 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:09.722460 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3785e-685e-4a04-9691-8cab2b6adedd None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:09.722529 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e2137-cc61-4677-b875-5c959b0b7985 None admin] RBAC: Adding query filter params (role.id=bb6c5483d9be4a16ac64750536c5e2e2, scope.project.id=b1d802dc0211467fa4e709cd01d411dc, user.id=d2b1c12e88c549208894fc0dd0c60b88) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:09.722598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3785e-685e-4a04-9691-8cab2b6adedd None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:09.722673 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e2137-cc61-4677-b875-5c959b0b7985 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:09.722743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3785e-685e-4a04-9691-8cab2b6adedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:09.722809 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e2137-cc61-4677-b875-5c959b0b7985 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:09.732285 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 419/830] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:26:09 2022] GET /identity/v3/role_assignments?user.id=d2b1c12e88c549208894fc0dd0c60b88&scope.project.id=b1d802dc0211467fa4e709cd01d411dc&role.id=bb6c5483d9be4a16ac64750536c5e2e2 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:09.732285 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e2137-cc61-4677-b875-5c959b0b7985 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:09.739904 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-8ca3785e-685e-4a04-9691-8cab2b6adedd None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:09.741348 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-8ca3785e-685e-4a04-9691-8cab2b6adedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:09.834231 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 412/831] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:09.848995 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e2137-cc61-4677-b875-5c959b0b7985 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:09.854131 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3785e-685e-4a04-9691-8cab2b6adedd None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:09.879012 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:09.893501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db242a8c-fb2b-4fe5-af07-9a7c3971b847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:09.894499 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db242a8c-fb2b-4fe5-af07-9a7c3971b847 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:09.894888 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db242a8c-fb2b-4fe5-af07-9a7c3971b847 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:09.895292 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db242a8c-fb2b-4fe5-af07-9a7c3971b847 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:09.903348 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db242a8c-fb2b-4fe5-af07-9a7c3971b847 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:09.904990 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db242a8c-fb2b-4fe5-af07-9a7c3971b847 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:09.905343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:09.923174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-db242a8c-fb2b-4fe5-af07-9a7c3971b847 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:09.923174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:09.923174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:09.923174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:09.923174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:09.923174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:09.923174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:09.923174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:09.923174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:09.923174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:09.923174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:09.923174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:09.923174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:26:09.923174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:26:09.923174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:26:09.924771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:26:09.924771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:09.924771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:09.924771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:09.924771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:09.924771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:09.924771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:09.924771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:09.924771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:09.924771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:09.924771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:09.924771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:09.924771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:09.924771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:09.924771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:09.924771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:09.924771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:09.925647 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:26:09.925647 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:26:09.925647 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:26:09.925647 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:26:09.925647 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:26:09.925647 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:26:09.925647 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:09.925647 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:09.925647 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 420/832] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:26:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:09.933936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db242a8c-fb2b-4fe5-af07-9a7c3971b847 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:09.991972 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3785e-685e-4a04-9691-8cab2b6adedd None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:10.042387 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05782f22-5f76-4e15-91c8-a9ced3024912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:10.043357 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05782f22-5f76-4e15-91c8-a9ced3024912 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:10.043580 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05782f22-5f76-4e15-91c8-a9ced3024912 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:10.043814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05782f22-5f76-4e15-91c8-a9ced3024912 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:10.044483 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05782f22-5f76-4e15-91c8-a9ced3024912 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:10.045887 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05782f22-5f76-4e15-91c8-a9ced3024912 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:10.060864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-05782f22-5f76-4e15-91c8-a9ced3024912 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:26:10.060864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:10.060864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:26:10.060864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:26:10.060864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:26:10.060864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:26:10.060864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:26:10.060864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:10.060864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:26:10.060864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:10.060864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:10.060864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:10.060864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:10.060864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:10.060864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:10.060864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:10.060864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:10.061926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:10.061926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:10.061926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:10.061926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:10.061926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:10.061926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:10.061926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:26:10.061926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:26:10.061926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:26:10.061926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:26:10.061926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:10.061926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:10.061926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:10.061926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:10.061926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:10.061926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:10.062946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:10.062946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:10.062946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:10.062946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:10.062946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:10.062946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:10.062946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:10.062946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:10.062946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:10.062946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:10.062946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:26:10.062946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:10.062946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:26:10.062946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:10.062946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 413/833] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 09:26:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:10.070926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05782f22-5f76-4e15-91c8-a9ced3024912 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:10.078651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db242a8c-fb2b-4fe5-af07-9a7c3971b847 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:10.114741 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4a493-1f33-4308-90a4-5ddc74970b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:10.115547 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4a493-1f33-4308-90a4-5ddc74970b3e None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:10.115721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4a493-1f33-4308-90a4-5ddc74970b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:10.115997 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4a493-1f33-4308-90a4-5ddc74970b3e None admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:10.116795 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4a493-1f33-4308-90a4-5ddc74970b3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:10.117109 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4a493-1f33-4308-90a4-5ddc74970b3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:10.118563 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4a493-1f33-4308-90a4-5ddc74970b3e None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:10.136006 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 421/834] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:26:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:10.137236 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4a493-1f33-4308-90a4-5ddc74970b3e None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:10.187647 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:10.188557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:10.195933 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05782f22-5f76-4e15-91c8-a9ced3024912 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:10.239972 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4ce30-73ba-43f4-871c-211fbf439842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:10.241056 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4ce30-73ba-43f4-871c-211fbf439842 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:10.241332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4ce30-73ba-43f4-871c-211fbf439842 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:10.241531 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4ce30-73ba-43f4-871c-211fbf439842 None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:10.242285 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4ce30-73ba-43f4-871c-211fbf439842 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:10.242585 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4ce30-73ba-43f4-871c-211fbf439842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:10.244015 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4ce30-73ba-43f4-871c-211fbf439842 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:10.246266 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4a493-1f33-4308-90a4-5ddc74970b3e None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:10.262407 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 414/835] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 09:26:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:10.262407 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d585dd-bf71-4d22-a38e-9d7f6eeea4d9 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:10.262407 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d585dd-bf71-4d22-a38e-9d7f6eeea4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:10.262407 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d585dd-bf71-4d22-a38e-9d7f6eeea4d9 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:10.263499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 415/836] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:10.264205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d585dd-bf71-4d22-a38e-9d7f6eeea4d9 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:10.294466 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11301799-8a7f-4f97-b1a4-46f6e522b12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:10.296304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11301799-8a7f-4f97-b1a4-46f6e522b12d None admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:10.296773 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11301799-8a7f-4f97-b1a4-46f6e522b12d None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:10.297360 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11301799-8a7f-4f97-b1a4-46f6e522b12d None admin] PATH_INFO: `/v3/projects/b1d802dc0211467fa4e709cd01d411dc/users/f52f0a03cc0f494d82a091bd885478e1/roles/5cde0d2bc9ca433b8904823fc602ab67` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:10.315426 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11301799-8a7f-4f97-b1a4-46f6e522b12d None admin] RBAC: Authorizing `identity:create_grant(project_id=b1d802dc0211467fa4e709cd01d411dc, user_id=f52f0a03cc0f494d82a091bd885478e1, role_id=5cde0d2bc9ca433b8904823fc602ab67)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:10.316929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11301799-8a7f-4f97-b1a4-46f6e522b12d None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:10.343633 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 422/837] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:26:10 2022] PUT /identity/v3/projects/b1d802dc0211467fa4e709cd01d411dc/users/f52f0a03cc0f494d82a091bd885478e1/roles/5cde0d2bc9ca433b8904823fc602ab67 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:26:10.345194 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3a91d-fbd7-4975-af15-3ac156106fed None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:10.345543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3a91d-fbd7-4975-af15-3ac156106fed None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:10.345864 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3a91d-fbd7-4975-af15-3ac156106fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:10.368952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-b0c3a91d-fbd7-4975-af15-3ac156106fed None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:10.370232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-b0c3a91d-fbd7-4975-af15-3ac156106fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:10.384809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d585dd-bf71-4d22-a38e-9d7f6eeea4d9 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:10.437237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710dddc-4b5d-4481-ae32-c6dfe10efdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:10.438228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710dddc-4b5d-4481-ae32-c6dfe10efdbc None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:10.438512 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710dddc-4b5d-4481-ae32-c6dfe10efdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:10.438791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710dddc-4b5d-4481-ae32-c6dfe10efdbc None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:10.440384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710dddc-4b5d-4481-ae32-c6dfe10efdbc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:10.440696 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710dddc-4b5d-4481-ae32-c6dfe10efdbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:10.442922 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710dddc-4b5d-4481-ae32-c6dfe10efdbc None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:10.450076 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 416/838] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 09:26:10 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:10.459925 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 423/839] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:10.478048 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710dddc-4b5d-4481-ae32-c6dfe10efdbc None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:10.518629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:10.612960 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710dddc-4b5d-4481-ae32-c6dfe10efdbc None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:10.654584 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e456f64-01c6-4847-b88d-c4f91aa39eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:10.655421 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e456f64-01c6-4847-b88d-c4f91aa39eed None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:10.655708 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e456f64-01c6-4847-b88d-c4f91aa39eed None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:10.655985 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e456f64-01c6-4847-b88d-c4f91aa39eed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:10.668451 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e456f64-01c6-4847-b88d-c4f91aa39eed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:26:10.677688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-8e456f64-01c6-4847-b88d-c4f91aa39eed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:26:10.677688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:10.677688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:10.677688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:10.677688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:10.677688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:10.677688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:10.677688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:10.677688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:10.677688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:10.677688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:10.677688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:10.677688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:26:10.677688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:26:10.677688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:26:10.677688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:26:10.678682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:26:10.678682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:26:10.678682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:26:10.678682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:26:10.678682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:10.678682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:10.678682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:10.678682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:10.678682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:10.678682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:10.678682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:10.678682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:10.678682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:10.678682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:10.678682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:10.678682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:10.679552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:10.679552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:10.679552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:10.679552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:10.679552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:26:10.679552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:26:10.679552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:26:10.679552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:26:10.679552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:26:10.679552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:26:10.679552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:26:10.679552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:10.679552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 417/840] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:26:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:10.684883 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3a91d-fbd7-4975-af15-3ac156106fed None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:10.714922 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:10.795944 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3a91d-fbd7-4975-af15-3ac156106fed None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:10.832180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171cba6b-2186-407b-abf1-8141b483f189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:10.833219 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cba6b-2186-407b-abf1-8141b483f189 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:10.833705 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cba6b-2186-407b-abf1-8141b483f189 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:10.834182 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cba6b-2186-407b-abf1-8141b483f189 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:10.835120 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171cba6b-2186-407b-abf1-8141b483f189 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:10.835650 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171cba6b-2186-407b-abf1-8141b483f189 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:10.837244 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171cba6b-2186-407b-abf1-8141b483f189 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:10.846829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 424/841] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:26:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:10.852167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e456f64-01c6-4847-b88d-c4f91aa39eed None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:10.944387 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:10.960289 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e456f64-01c6-4847-b88d-c4f91aa39eed None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:10.996698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239143f-18b4-4015-b764-a87368de6796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:10.997548 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239143f-18b4-4015-b764-a87368de6796 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:10.997836 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239143f-18b4-4015-b764-a87368de6796 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:10.998113 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239143f-18b4-4015-b764-a87368de6796 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:11.009225 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239143f-18b4-4015-b764-a87368de6796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:11.010680 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239143f-18b4-4015-b764-a87368de6796 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:11.030234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-3239143f-18b4-4015-b764-a87368de6796 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:11.030234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:11.030234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:11.030234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:11.030234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:11.030234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:11.030234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:11.030234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:11.030234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:11.030234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:11.030234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:11.030234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:11.030234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:11.030234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:11.030234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:11.031167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:11.031167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:11.031167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:11.031167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:11.031167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:11.031167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:11.031167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:11.031167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:11.031167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:11.031167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:11.031167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:11.031167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:11.031167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:11.031167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:11.031167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:11.031167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:11.031167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:11.032096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:11.032096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:11.032096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:11.032096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:11.032096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 418/842] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:11.038165 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171cba6b-2186-407b-abf1-8141b483f189 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:11.136648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:11.147576 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171cba6b-2186-407b-abf1-8141b483f189 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:11.184346 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be64313-eb92-477a-a789-1a7df659a7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:11.185022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be64313-eb92-477a-a789-1a7df659a7ca None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:11.185307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be64313-eb92-477a-a789-1a7df659a7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:11.185582 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be64313-eb92-477a-a789-1a7df659a7ca None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:11.186308 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be64313-eb92-477a-a789-1a7df659a7ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:11.186617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be64313-eb92-477a-a789-1a7df659a7ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:11.188019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be64313-eb92-477a-a789-1a7df659a7ca None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:11.200807 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 425/843] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:11.206563 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239143f-18b4-4015-b764-a87368de6796 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:11.312086 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239143f-18b4-4015-b764-a87368de6796 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:11.347296 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9969cd-d648-49af-a6af-cc1257dd94a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:11.348029 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9969cd-d648-49af-a6af-cc1257dd94a6 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:11.348315 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9969cd-d648-49af-a6af-cc1257dd94a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:11.348595 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9969cd-d648-49af-a6af-cc1257dd94a6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:11.356930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9969cd-d648-49af-a6af-cc1257dd94a6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:11.358378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9969cd-d648-49af-a6af-cc1257dd94a6 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:11.360403 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:11.373226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-8c9969cd-d648-49af-a6af-cc1257dd94a6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 09:26:11.373226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:11.373226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:11.373226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:11.373226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:11.373226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:11.373226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:11.373226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:11.373226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:11.373226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:11.373226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:11.373226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:11.373226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:26:11.373226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:26:11.373226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:26:11.373226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:26:11.374148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:11.374148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:11.374148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:26:11.374148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:11.374148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:26:11.374148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:11.374148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:11.374148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:11.374148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:11.374148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:11.374148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:11.374148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:11.374148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:11.374148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:11.374148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:11.374148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:11.374148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:11.374148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:11.375084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:11.375084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:11.375084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:26:11.375084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:26:11.375084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:26:11.375084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:26:11.375084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:26:11.375084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:26:11.375084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 09:26:11.375084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:11.375084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 419/844] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:26:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:11.381046 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be64313-eb92-477a-a789-1a7df659a7ca None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:11.486115 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be64313-eb92-477a-a789-1a7df659a7ca None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:11.523012 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a82efb-9b29-4409-b117-ad5779f75f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:11.523719 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a82efb-9b29-4409-b117-ad5779f75f92 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:11.524005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a82efb-9b29-4409-b117-ad5779f75f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:11.524283 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a82efb-9b29-4409-b117-ad5779f75f92 None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:11.525124 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a82efb-9b29-4409-b117-ad5779f75f92 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:11.525435 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a82efb-9b29-4409-b117-ad5779f75f92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:11.526874 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a82efb-9b29-4409-b117-ad5779f75f92 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:11.545209 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 426/845] 10.222.0.41 () {56 vars in 1135 bytes} [Fri May 27 09:26:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:11.550548 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9969cd-d648-49af-a6af-cc1257dd94a6 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:11.669692 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9969cd-d648-49af-a6af-cc1257dd94a6 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:11.708165 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52920f9-98ed-43d4-8bc5-6d5b385c827e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:11.708825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52920f9-98ed-43d4-8bc5-6d5b385c827e None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:11.709109 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52920f9-98ed-43d4-8bc5-6d5b385c827e None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:11.709389 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52920f9-98ed-43d4-8bc5-6d5b385c827e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:11.784367 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:11.788128 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52920f9-98ed-43d4-8bc5-6d5b385c827e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:11.789652 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52920f9-98ed-43d4-8bc5-6d5b385c827e None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:11.895098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 420/846] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:26:11 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:26:11.900942 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a82efb-9b29-4409-b117-ad5779f75f92 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:11.912448 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:12.019449 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a82efb-9b29-4409-b117-ad5779f75f92 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:12.055457 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be3a13-d379-46be-9306-f3bc52713b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:12.056262 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be3a13-d379-46be-9306-f3bc52713b61 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:12.056550 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be3a13-d379-46be-9306-f3bc52713b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:12.056830 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be3a13-d379-46be-9306-f3bc52713b61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:12.068252 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be3a13-d379-46be-9306-f3bc52713b61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:12.069725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be3a13-d379-46be-9306-f3bc52713b61 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:12.087955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-c0be3a13-d379-46be-9306-f3bc52713b61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:12.087955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:12.087955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:12.087955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:12.087955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:12.087955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:12.087955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:12.087955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:12.087955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:12.087955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:12.087955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:12.087955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:12.087955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:12.087955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:12.087955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:12.088873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:12.088873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:12.088873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:12.088873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:12.088873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:12.088873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:12.088873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:12.088873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:12.088873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:12.088873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:12.088873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:12.088873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:12.088873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:12.088873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:12.088873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:12.088873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:12.088873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:12.089741 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:12.089741 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:12.089741 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:12.089741 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:12.089741 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 427/847] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:12.094746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52920f9-98ed-43d4-8bc5-6d5b385c827e None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:12.126175 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6ac7e-4a82-40f6-b54e-3f2234b96d3e None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:12.126480 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6ac7e-4a82-40f6-b54e-3f2234b96d3e None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:12.126745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6ac7e-4a82-40f6-b54e-3f2234b96d3e None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:12.128455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 428/848] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:26:12.133471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b81ba-b126-470c-a4e0-cb6e0eb15177 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:12.133851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b81ba-b126-470c-a4e0-cb6e0eb15177 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:12.134140 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b81ba-b126-470c-a4e0-cb6e0eb15177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:12.151477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-8f6b81ba-b126-470c-a4e0-cb6e0eb15177 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:12.152769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-8f6b81ba-b126-470c-a4e0-cb6e0eb15177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:12.194714 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:12.198234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52920f9-98ed-43d4-8bc5-6d5b385c827e None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:12.217563 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:12.243296 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 429/849] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:26:12.246053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1904e3-d73a-4538-8f1d-5ae14c468beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:12.246733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1904e3-d73a-4538-8f1d-5ae14c468beb None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:12.247012 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1904e3-d73a-4538-8f1d-5ae14c468beb None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:12.247297 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1904e3-d73a-4538-8f1d-5ae14c468beb None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:12.248044 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1904e3-d73a-4538-8f1d-5ae14c468beb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:12.248351 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1904e3-d73a-4538-8f1d-5ae14c468beb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:12.249715 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1904e3-d73a-4538-8f1d-5ae14c468beb None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:12.260638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b81ba-b126-470c-a4e0-cb6e0eb15177 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:12.264262 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 421/850] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:12.270181 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1904e3-d73a-4538-8f1d-5ae14c468beb None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:12.381470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1904e3-d73a-4538-8f1d-5ae14c468beb None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:12.394638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b81ba-b126-470c-a4e0-cb6e0eb15177 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:12.421826 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad55a0-8f5a-4135-b5d6-cf038f09dd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:12.422639 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad55a0-8f5a-4135-b5d6-cf038f09dd29 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:12.423064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad55a0-8f5a-4135-b5d6-cf038f09dd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:12.423518 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad55a0-8f5a-4135-b5d6-cf038f09dd29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:12.433099 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad55a0-8f5a-4135-b5d6-cf038f09dd29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:12.435230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad55a0-8f5a-4135-b5d6-cf038f09dd29 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:12.440005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943e38f-f049-46db-8d67-91f8c1ddb21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:12.441152 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943e38f-f049-46db-8d67-91f8c1ddb21c None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:12.441630 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943e38f-f049-46db-8d67-91f8c1ddb21c None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:12.442120 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943e38f-f049-46db-8d67-91f8c1ddb21c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:12.442976 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d943e38f-f049-46db-8d67-91f8c1ddb21c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:12.444612 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d943e38f-f049-46db-8d67-91f8c1ddb21c None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:12.451108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-0bad55a0-8f5a-4135-b5d6-cf038f09dd29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:12.451108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:12.451108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:12.451108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:12.451108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:12.451108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:12.451108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:12.451108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:12.451108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:12.451108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:12.451108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:12.451108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:12.451108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:26:12.451108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:26:12.451108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:26:12.452021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:26:12.452021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:12.452021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:12.452021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:12.452021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:12.452021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:12.452021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:12.452021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:12.452021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:12.452021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:12.452021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:12.452021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:12.452021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:12.452021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:12.452021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:12.452021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:12.452021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:12.452979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:26:12.452979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:26:12.452979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:26:12.452979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:26:12.452979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:26:12.452979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:26:12.452979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:12.452979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:12.457664 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 422/851] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:26:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:12.458829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad55a0-8f5a-4135-b5d6-cf038f09dd29 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:12.461771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-d943e38f-f049-46db-8d67-91f8c1ddb21c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:26:12.461771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:12.461771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:26:12.461771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:26:12.461771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:26:12.461771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:26:12.461771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:26:12.461771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:12.461771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:26:12.461771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:12.461771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:12.461771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:12.461771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:12.461771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:12.461771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:12.461771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:12.462649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:12.462649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:12.462649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:12.462649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:12.462649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:12.462649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:12.462649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:12.462649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:26:12.462649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:26:12.462649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:26:12.462649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:26:12.462649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:12.462649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:12.462649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:12.462649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:12.462649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:12.463505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:12.463505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:12.463505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:12.463505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:12.463505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:12.463505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:12.463505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:12.463505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:12.463505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:12.463505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:12.463505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:12.463505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:26:12.463505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:12.463505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:26:12.463505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:12.466246 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 430/852] 10.222.0.41 () {56 vars in 1132 bytes} [Fri May 27 09:26:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:12.472978 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943e38f-f049-46db-8d67-91f8c1ddb21c None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:12.490062 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:12.539061 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:12.604642 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943e38f-f049-46db-8d67-91f8c1ddb21c None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:12.610044 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad55a0-8f5a-4135-b5d6-cf038f09dd29 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:12.643230 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49493968-cd84-4473-9f97-0a7f7d040ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:12.643924 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49493968-cd84-4473-9f97-0a7f7d040ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:12.644206 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49493968-cd84-4473-9f97-0a7f7d040ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:12.644475 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49493968-cd84-4473-9f97-0a7f7d040ba4 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:12.645217 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49493968-cd84-4473-9f97-0a7f7d040ba4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:12.645478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49493968-cd84-4473-9f97-0a7f7d040ba4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:12.646850 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49493968-cd84-4473-9f97-0a7f7d040ba4 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:12.652027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 431/853] 10.222.0.41 () {56 vars in 1126 bytes} [Fri May 27 09:26:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:12.657509 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12614ce4-ed9e-433a-8301-bceceffb9970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:12.658221 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12614ce4-ed9e-433a-8301-bceceffb9970 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:12.659074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49493968-cd84-4473-9f97-0a7f7d040ba4 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:12.659203 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12614ce4-ed9e-433a-8301-bceceffb9970 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:12.659467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12614ce4-ed9e-433a-8301-bceceffb9970 None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:12.660250 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12614ce4-ed9e-433a-8301-bceceffb9970 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:12.660573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12614ce4-ed9e-433a-8301-bceceffb9970 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:12.662242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12614ce4-ed9e-433a-8301-bceceffb9970 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:12.682119 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 423/854] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:26:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:12.683885 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12614ce4-ed9e-433a-8301-bceceffb9970 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:12.769632 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49493968-cd84-4473-9f97-0a7f7d040ba4 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:12.775887 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:12.788967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:12.801879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12614ce4-ed9e-433a-8301-bceceffb9970 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:12.808579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2b0b0-fae1-46af-86f4-037d903a0ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:12.809255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2b0b0-fae1-46af-86f4-037d903a0ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:12.809534 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2b0b0-fae1-46af-86f4-037d903a0ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:12.809810 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2b0b0-fae1-46af-86f4-037d903a0ae6 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:12.810514 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2b0b0-fae1-46af-86f4-037d903a0ae6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:12.810826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2b0b0-fae1-46af-86f4-037d903a0ae6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:12.812222 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2b0b0-fae1-46af-86f4-037d903a0ae6 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:12.817489 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 432/855] 10.222.0.41 () {56 vars in 1126 bytes} [Fri May 27 09:26:12 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:12.818522 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c2166-043a-40a5-a9c4-900b5057c3c1 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:12.819825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c2166-043a-40a5-a9c4-900b5057c3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:12.819825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c2166-043a-40a5-a9c4-900b5057c3c1 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:12.823604 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 433/856] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:12.825634 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f904b-721c-4bed-ba39-400cb1090dd5 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:12.825932 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f904b-721c-4bed-ba39-400cb1090dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:12.826211 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f904b-721c-4bed-ba39-400cb1090dd5 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:12.827889 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 434/857] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:12.828955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d418599-d4a6-4591-9e11-21e13c2cab90 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:12.829237 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d418599-d4a6-4591-9e11-21e13c2cab90 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:12.829509 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d418599-d4a6-4591-9e11-21e13c2cab90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:12.845983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997394a6-c2ab-44b6-b07b-d931cd083c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:12.846664 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997394a6-c2ab-44b6-b07b-d931cd083c6d None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:12.846947 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997394a6-c2ab-44b6-b07b-d931cd083c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:12.847220 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997394a6-c2ab-44b6-b07b-d931cd083c6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:12.847553 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-5d418599-d4a6-4591-9e11-21e13c2cab90 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:12.848096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997394a6-c2ab-44b6-b07b-d931cd083c6d None admin] RBAC: Adding query filter params (role.id=bb6c5483d9be4a16ac64750536c5e2e2, scope.project.id=b1d802dc0211467fa4e709cd01d411dc, user.id=351f74222d394f39bda0663e0e4ebde6) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:12.848411 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997394a6-c2ab-44b6-b07b-d931cd083c6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:12.848784 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-5d418599-d4a6-4591-9e11-21e13c2cab90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:12.849872 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997394a6-c2ab-44b6-b07b-d931cd083c6d None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:12.857686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 424/858] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:26:12 2022] GET /identity/v3/role_assignments?user.id=351f74222d394f39bda0663e0e4ebde6&scope.project.id=b1d802dc0211467fa4e709cd01d411dc&role.id=bb6c5483d9be4a16ac64750536c5e2e2 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:12.858786 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb396f-253d-4a93-8f80-1b90e7485656 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:12.859071 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb396f-253d-4a93-8f80-1b90e7485656 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:12.859640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb396f-253d-4a93-8f80-1b90e7485656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:12.891870 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-04eb396f-253d-4a93-8f80-1b90e7485656 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:12.891870 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-04eb396f-253d-4a93-8f80-1b90e7485656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:12.975307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 435/859] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:12.989573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 425/860] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:12.999267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d418599-d4a6-4591-9e11-21e13c2cab90 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:13.014278 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb396f-253d-4a93-8f80-1b90e7485656 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:13.111046 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:13.140591 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d418599-d4a6-4591-9e11-21e13c2cab90 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:13.149120 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb396f-253d-4a93-8f80-1b90e7485656 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:13.157659 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:13.181893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3f570-34a1-4bd2-9672-8078ff049f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:13.182573 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3f570-34a1-4bd2-9672-8078ff049f41 None admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:13.182859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3f570-34a1-4bd2-9672-8078ff049f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:13.183138 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3f570-34a1-4bd2-9672-8078ff049f41 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:13.183975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3f570-34a1-4bd2-9672-8078ff049f41 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:13.185361 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3f570-34a1-4bd2-9672-8078ff049f41 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:13.194464 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb2317-5448-4a52-b6e0-68c860cc67fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:13.195503 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb2317-5448-4a52-b6e0-68c860cc67fe None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:13.195852 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb2317-5448-4a52-b6e0-68c860cc67fe None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:13.196232 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb2317-5448-4a52-b6e0-68c860cc67fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:13.204276 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 436/861] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 09:26:12 2022] POST /identity/v3/services => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:26:13.213074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb2317-5448-4a52-b6e0-68c860cc67fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:26:13.221346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-1dfb2317-5448-4a52-b6e0-68c860cc67fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:26:13.221346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:13.221346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:13.221346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:13.221346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:13.221346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:13.221346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:13.221346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:13.221346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:13.221346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:13.221346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:13.221346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:13.221346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:26:13.221346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:26:13.221346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:26:13.221346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:26:13.222363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:26:13.222363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:26:13.222363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:26:13.222363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:26:13.222363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:13.222363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:13.222363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:13.222363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:13.222363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:13.222363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:13.222363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:13.222363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:13.222363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:13.222363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:13.222363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:13.222363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:13.223189 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:13.223189 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:13.223189 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:13.223189 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:13.223189 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:26:13.223189 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:26:13.223189 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:26:13.223189 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:26:13.223189 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:26:13.223189 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:26:13.223189 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:26:13.223189 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:13.223189 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 426/862] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 09:26:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:13.229149 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3f570-34a1-4bd2-9672-8078ff049f41 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:13.358166 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3f570-34a1-4bd2-9672-8078ff049f41 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:13.395616 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f34fc-9940-4f74-b669-6b0f21f3f692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:13.396296 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f34fc-9940-4f74-b669-6b0f21f3f692 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:13.396579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f34fc-9940-4f74-b669-6b0f21f3f692 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:13.396854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f34fc-9940-4f74-b669-6b0f21f3f692 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:13.397603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f34fc-9940-4f74-b669-6b0f21f3f692 None admin] RBAC: Adding query filter params (name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:13.397912 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f34fc-9940-4f74-b669-6b0f21f3f692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:13.399312 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f34fc-9940-4f74-b669-6b0f21f3f692 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:13.408471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 437/863] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 09:26:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:13.413505 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb2317-5448-4a52-b6e0-68c860cc67fe None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:13.529603 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb2317-5448-4a52-b6e0-68c860cc67fe None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:13.560471 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:13.566676 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b666fda-a474-44a0-ad4d-7bf0192f0d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:13.567506 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b666fda-a474-44a0-ad4d-7bf0192f0d35 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:13.567796 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b666fda-a474-44a0-ad4d-7bf0192f0d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:13.568181 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b666fda-a474-44a0-ad4d-7bf0192f0d35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:13.580174 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b666fda-a474-44a0-ad4d-7bf0192f0d35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:13.581695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b666fda-a474-44a0-ad4d-7bf0192f0d35 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:13.599851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-8b666fda-a474-44a0-ad4d-7bf0192f0d35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:13.599851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:13.599851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:13.599851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:13.599851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:13.599851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:13.599851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:13.599851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:13.599851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:13.599851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:13.599851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:13.599851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:13.599851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:13.599851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:13.599851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:13.600907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:13.600907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:13.600907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:13.600907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:13.600907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:13.600907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:13.600907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:13.600907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:13.600907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:13.600907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:13.600907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:13.600907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:13.600907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:13.600907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:13.600907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:13.600907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:13.600907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:13.601859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:13.601859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:13.601859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:13.601859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:13.601859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 427/864] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:13.606622 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f34fc-9940-4f74-b669-6b0f21f3f692 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:13.639731 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:13.710809 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f34fc-9940-4f74-b669-6b0f21f3f692 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:13.746362 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd887d-3499-4214-8a07-b825d9d9edbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:13.747026 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd887d-3499-4214-8a07-b825d9d9edbb None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:13.747325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd887d-3499-4214-8a07-b825d9d9edbb None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:13.747609 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd887d-3499-4214-8a07-b825d9d9edbb None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:13.748324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd887d-3499-4214-8a07-b825d9d9edbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:13.748630 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd887d-3499-4214-8a07-b825d9d9edbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:13.750001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd887d-3499-4214-8a07-b825d9d9edbb None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:13.762842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 438/865] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:13.768406 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b666fda-a474-44a0-ad4d-7bf0192f0d35 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:13.881027 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b666fda-a474-44a0-ad4d-7bf0192f0d35 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:13.915917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5cfe3-a881-45f1-89ad-d30153976bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:13.916668 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5cfe3-a881-45f1-89ad-d30153976bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:13.916953 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5cfe3-a881-45f1-89ad-d30153976bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:13.917233 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5cfe3-a881-45f1-89ad-d30153976bb6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:13.926324 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5cfe3-a881-45f1-89ad-d30153976bb6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:13.927805 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5cfe3-a881-45f1-89ad-d30153976bb6 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:13.942622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-5ab5cfe3-a881-45f1-89ad-d30153976bb6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:26:13.942622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:13.942622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:13.942622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:13.942622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:13.942622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:13.942622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:13.942622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:13.942622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:13.942622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:13.942622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:13.942622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:13.942622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:26:13.942622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:26:13.942622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:26:13.942622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:26:13.943601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:13.943601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:13.943601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:26:13.943601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:13.943601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:26:13.943601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:13.943601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:13.943601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:13.943601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:13.943601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:13.943601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:13.943601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:13.943601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:13.943601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:13.943601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:13.943601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:13.943601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:13.943601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:13.944581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:13.944581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:13.944581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:26:13.944581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:26:13.944581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:26:13.944581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:26:13.944581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:26:13.944581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:26:13.944581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:26:13.944581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:13.944581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 428/866] 10.222.0.41 () {56 vars in 1117 bytes} [Fri May 27 09:26:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:13.951358 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd887d-3499-4214-8a07-b825d9d9edbb None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:14.052965 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:14.071302 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd887d-3499-4214-8a07-b825d9d9edbb None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:14.109027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779982e-e49b-4862-9e82-32572907e60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:14.109971 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779982e-e49b-4862-9e82-32572907e60d None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:14.110255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779982e-e49b-4862-9e82-32572907e60d None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:14.110520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779982e-e49b-4862-9e82-32572907e60d None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:14.111417 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779982e-e49b-4862-9e82-32572907e60d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:14.111729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779982e-e49b-4862-9e82-32572907e60d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:14.113170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779982e-e49b-4862-9e82-32572907e60d None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:14.131458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 439/867] 10.222.0.41 () {56 vars in 1149 bytes} [Fri May 27 09:26:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:14.140581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5cfe3-a881-45f1-89ad-d30153976bb6 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:14.189222 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:14.251551 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5cfe3-a881-45f1-89ad-d30153976bb6 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:14.290280 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb633b5-e692-4ef3-bc70-edd9b5ece7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:14.291347 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb633b5-e692-4ef3-bc70-edd9b5ece7aa None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:14.291847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb633b5-e692-4ef3-bc70-edd9b5ece7aa None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:14.292329 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb633b5-e692-4ef3-bc70-edd9b5ece7aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:14.362771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb633b5-e692-4ef3-bc70-edd9b5ece7aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:14.364611 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb633b5-e692-4ef3-bc70-edd9b5ece7aa None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:14.412235 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:14.475467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 429/868] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:26:14 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:26:14.476621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779982e-e49b-4862-9e82-32572907e60d None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:14.585041 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779982e-e49b-4862-9e82-32572907e60d None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:14.619802 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695afd06-3a61-4edc-8867-f2adaa9a5f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:14.620604 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695afd06-3a61-4edc-8867-f2adaa9a5f96 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:14.620892 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695afd06-3a61-4edc-8867-f2adaa9a5f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:14.621171 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695afd06-3a61-4edc-8867-f2adaa9a5f96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:14.631980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695afd06-3a61-4edc-8867-f2adaa9a5f96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:14.633448 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695afd06-3a61-4edc-8867-f2adaa9a5f96 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:14.642185 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:14.652854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-695afd06-3a61-4edc-8867-f2adaa9a5f96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:14.652854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:14.652854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:14.652854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:14.652854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:14.652854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:14.652854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:14.652854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:14.652854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:14.652854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:14.652854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:14.652854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:14.652854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:14.652854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:14.652854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:14.653780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:14.653780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:14.653780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:14.653780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:14.653780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:14.653780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:14.653780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:14.653780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:14.653780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:14.653780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:14.653780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:14.653780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:14.653780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:14.653780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:14.653780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:14.653780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:14.653780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:14.654669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:14.654669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:14.654669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:14.654669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:14.654669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 440/869] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:14.661022 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb633b5-e692-4ef3-bc70-edd9b5ece7aa None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:14.765962 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb633b5-e692-4ef3-bc70-edd9b5ece7aa None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:14.802236 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033742e-178b-44c4-a6bc-5da747e92a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:14.803318 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033742e-178b-44c4-a6bc-5da747e92a94 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:14.803824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033742e-178b-44c4-a6bc-5da747e92a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:14.804317 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033742e-178b-44c4-a6bc-5da747e92a94 None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:14.805250 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033742e-178b-44c4-a6bc-5da747e92a94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:14.805781 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033742e-178b-44c4-a6bc-5da747e92a94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:14.807390 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033742e-178b-44c4-a6bc-5da747e92a94 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:14.820409 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 430/870] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:14.826086 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695afd06-3a61-4edc-8867-f2adaa9a5f96 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:14.931881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695afd06-3a61-4edc-8867-f2adaa9a5f96 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:14.968054 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623377a-8f94-4954-b0d1-fc20dff45b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:14.969214 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623377a-8f94-4954-b0d1-fc20dff45b47 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:14.969726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623377a-8f94-4954-b0d1-fc20dff45b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:14.970233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623377a-8f94-4954-b0d1-fc20dff45b47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:14.977628 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623377a-8f94-4954-b0d1-fc20dff45b47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:14.979426 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623377a-8f94-4954-b0d1-fc20dff45b47 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:14.994710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-6623377a-8f94-4954-b0d1-fc20dff45b47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:14.994710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:14.994710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:14.994710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:14.994710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:14.994710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:14.994710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:14.994710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:14.994710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:14.994710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:14.994710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:14.994710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:14.994710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:26:14.994710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:26:14.994710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:26:14.995638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:26:14.995638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:14.995638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:14.995638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:14.995638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:14.995638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:14.995638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:14.995638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:14.995638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:14.995638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:14.995638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:14.995638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:14.995638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:14.995638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:14.995638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:14.995638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:14.995638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:14.996515 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:26:14.996515 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:26:14.996515 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:26:14.996515 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:26:14.996515 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:26:14.996515 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:26:14.996515 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:14.996515 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:14.998969 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 441/871] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:26:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:15.005393 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033742e-178b-44c4-a6bc-5da747e92a94 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:15.023636 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:15.121339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033742e-178b-44c4-a6bc-5da747e92a94 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:15.155802 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ae45e-f2ed-4158-b3ca-43b28bdb51e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:15.156453 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ae45e-f2ed-4158-b3ca-43b28bdb51e0 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:15.156748 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ae45e-f2ed-4158-b3ca-43b28bdb51e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:15.157033 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ae45e-f2ed-4158-b3ca-43b28bdb51e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:15.157822 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ae45e-f2ed-4158-b3ca-43b28bdb51e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:15.158698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ae45e-f2ed-4158-b3ca-43b28bdb51e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:15.160173 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ae45e-f2ed-4158-b3ca-43b28bdb51e0 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:15.173190 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 431/872] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:26:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:15.179623 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623377a-8f94-4954-b0d1-fc20dff45b47 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:15.242662 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:15.260421 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16604b-d991-4b91-934c-f59686d2e4f3 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:15.261527 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16604b-d991-4b91-934c-f59686d2e4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:15.262025 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16604b-d991-4b91-934c-f59686d2e4f3 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:15.264273 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 432/873] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:15.270682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fdc63-9620-4158-a451-b66d60fd10e6 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:15.270973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fdc63-9620-4158-a451-b66d60fd10e6 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:15.271252 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fdc63-9620-4158-a451-b66d60fd10e6 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:15.273094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 433/874] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:15.274064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b76a49-53f3-4a14-8703-260085142a09 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:15.274295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b76a49-53f3-4a14-8703-260085142a09 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:15.274575 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b76a49-53f3-4a14-8703-260085142a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:15.289846 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623377a-8f94-4954-b0d1-fc20dff45b47 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:15.291472 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-67b76a49-53f3-4a14-8703-260085142a09 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:15.292662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-67b76a49-53f3-4a14-8703-260085142a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:15.325749 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18490f-83f2-47f4-9eb1-87468ea85b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:15.326403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18490f-83f2-47f4-9eb1-87468ea85b7c None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:15.326684 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18490f-83f2-47f4-9eb1-87468ea85b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:15.326957 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18490f-83f2-47f4-9eb1-87468ea85b7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:15.327846 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18490f-83f2-47f4-9eb1-87468ea85b7c None admin] RBAC: Adding query filter params (role.id=5cde0d2bc9ca433b8904823fc602ab67, scope.project.id=b1d802dc0211467fa4e709cd01d411dc, user.id=f52f0a03cc0f494d82a091bd885478e1) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:15.328126 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18490f-83f2-47f4-9eb1-87468ea85b7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:15.329559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18490f-83f2-47f4-9eb1-87468ea85b7c None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:15.336295 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 442/875] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:26:15 2022] GET /identity/v3/role_assignments?user.id=f52f0a03cc0f494d82a091bd885478e1&scope.project.id=b1d802dc0211467fa4e709cd01d411dc&role.id=5cde0d2bc9ca433b8904823fc602ab67 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:15.337291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60db61a-62a5-4f7f-922d-8ce954cf29b3 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:15.337579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60db61a-62a5-4f7f-922d-8ce954cf29b3 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:15.337849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60db61a-62a5-4f7f-922d-8ce954cf29b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:15.355764 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-b60db61a-62a5-4f7f-922d-8ce954cf29b3 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:15.357023 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-b60db61a-62a5-4f7f-922d-8ce954cf29b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:15.380304 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:15.397776 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 434/876] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:15 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:15.418447 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b76a49-53f3-4a14-8703-260085142a09 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:15.457816 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 443/877] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:15 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:15.484516 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60db61a-62a5-4f7f-922d-8ce954cf29b3 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:15.550632 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:15.560452 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b76a49-53f3-4a14-8703-260085142a09 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:15.598143 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49104024-099f-4fde-92cf-7d15656d5e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:15.598926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49104024-099f-4fde-92cf-7d15656d5e8b None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:15.599292 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49104024-099f-4fde-92cf-7d15656d5e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:15.599590 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49104024-099f-4fde-92cf-7d15656d5e8b None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:15.601309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49104024-099f-4fde-92cf-7d15656d5e8b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:15.602769 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49104024-099f-4fde-92cf-7d15656d5e8b None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:15.606936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60db61a-62a5-4f7f-922d-8ce954cf29b3 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:15.624008 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 435/878] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 09:26:15 2022] POST /identity/v3/services => generated 269 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:26:15.625725 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06061333-9c7c-460b-a5b6-6f0ff2615d5c None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:15.626196 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06061333-9c7c-460b-a5b6-6f0ff2615d5c None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:15.626675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06061333-9c7c-460b-a5b6-6f0ff2615d5c None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:15.628519 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 436/879] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:15.633757 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be7f8f-5334-4d78-bd2d-20b3fc757cae None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:15.634123 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be7f8f-5334-4d78-bd2d-20b3fc757cae None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:15.634411 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be7f8f-5334-4d78-bd2d-20b3fc757cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:15.656808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f922fb-5852-47ba-908d-5629612a244a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:15.657572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-d5be7f8f-5334-4d78-bd2d-20b3fc757cae None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:15.658927 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f922fb-5852-47ba-908d-5629612a244a None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:15.659460 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-d5be7f8f-5334-4d78-bd2d-20b3fc757cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:15.659573 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f922fb-5852-47ba-908d-5629612a244a None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:15.660105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f922fb-5852-47ba-908d-5629612a244a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:15.661024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f922fb-5852-47ba-908d-5629612a244a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:15.664066 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f922fb-5852-47ba-908d-5629612a244a None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:15.685725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-56f922fb-5852-47ba-908d-5629612a244a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:26:15.685725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:15.685725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:26:15.685725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:26:15.685725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:26:15.685725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:26:15.685725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:26:15.685725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:15.685725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:26:15.685725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:15.685725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:15.685725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:15.685725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:15.685725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:15.685725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:15.685725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:15.685725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:15.686827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:15.686827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:15.686827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:15.686827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:15.686827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:15.686827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:15.686827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:26:15.686827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:26:15.686827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:26:15.686827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:26:15.686827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:15.686827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:15.686827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:15.686827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:15.686827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:15.686827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:15.687690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:15.687690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:15.687690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:15.687690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:15.687690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:15.687690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:15.687690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:15.687690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:15.687690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:15.687690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:15.687690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:26:15.687690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:15.687690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:26:15.687690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:15.689236 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 444/880] 10.222.0.41 () {56 vars in 1126 bytes} [Fri May 27 09:26:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:15.695509 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f922fb-5852-47ba-908d-5629612a244a None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:15.724759 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:15.749092 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 437/881] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:26:15.772377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be7f8f-5334-4d78-bd2d-20b3fc757cae None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:15.830724 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f922fb-5852-47ba-908d-5629612a244a None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:15.847737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:15.877275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927a79c-49e5-4f52-bce7-c7c490421a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:15.877957 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927a79c-49e5-4f52-bce7-c7c490421a85 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:15.878244 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927a79c-49e5-4f52-bce7-c7c490421a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:15.878528 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927a79c-49e5-4f52-bce7-c7c490421a85 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:15.879239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927a79c-49e5-4f52-bce7-c7c490421a85 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:15.879583 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927a79c-49e5-4f52-bce7-c7c490421a85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:15.880967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927a79c-49e5-4f52-bce7-c7c490421a85 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:15.887969 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 445/882] 10.222.0.41 () {56 vars in 1122 bytes} [Fri May 27 09:26:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:15.893423 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927a79c-49e5-4f52-bce7-c7c490421a85 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:15.906293 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be7f8f-5334-4d78-bd2d-20b3fc757cae None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:15.954820 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e9e4b-8291-4662-85d6-7c0026125bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:15.955909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e9e4b-8291-4662-85d6-7c0026125bbb None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:15.956209 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e9e4b-8291-4662-85d6-7c0026125bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:15.956484 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e9e4b-8291-4662-85d6-7c0026125bbb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:15.957536 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e9e4b-8291-4662-85d6-7c0026125bbb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:15.958964 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e9e4b-8291-4662-85d6-7c0026125bbb None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:15.976687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-8b5e9e4b-8291-4662-85d6-7c0026125bbb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:26:15.976687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:15.976687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:26:15.976687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:26:15.976687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:26:15.976687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:26:15.976687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:26:15.976687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:15.976687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:26:15.976687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:15.976687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:15.976687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:15.976687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:15.976687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:15.976687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:15.976687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:15.976687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:15.977719 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:15.977719 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:15.977719 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:15.977719 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:15.977719 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:15.977719 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:15.977719 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:26:15.977719 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:26:15.977719 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:26:15.977719 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:26:15.977719 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:15.977719 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:15.977719 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:15.977719 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:15.977719 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:15.977719 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:15.978537 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:15.978537 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:15.978537 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:15.978537 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:15.978537 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:15.978537 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:15.978537 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:15.978537 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:15.978537 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:15.978537 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:15.978537 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:26:15.978537 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:15.978537 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:26:15.978537 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:15.979268 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 438/883] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 09:26:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:15.989909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e9e4b-8291-4662-85d6-7c0026125bbb None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:16.018870 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927a79c-49e5-4f52-bce7-c7c490421a85 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:16.053434 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:16.066619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c119f-bc29-448a-8c33-f78447ef5dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:16.067312 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c119f-bc29-448a-8c33-f78447ef5dfc None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:16.067603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c119f-bc29-448a-8c33-f78447ef5dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:16.067881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c119f-bc29-448a-8c33-f78447ef5dfc None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:16.068861 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c119f-bc29-448a-8c33-f78447ef5dfc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:16.069171 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c119f-bc29-448a-8c33-f78447ef5dfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:16.071310 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c119f-bc29-448a-8c33-f78447ef5dfc None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:16.083392 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 446/884] 10.222.0.41 () {56 vars in 1122 bytes} [Fri May 27 09:26:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:16.122913 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e9e4b-8291-4662-85d6-7c0026125bbb None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:16.162452 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77b99a-c5cd-4269-bdf1-929a5282e185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:16.163238 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77b99a-c5cd-4269-bdf1-929a5282e185 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:16.163439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77b99a-c5cd-4269-bdf1-929a5282e185 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:16.163708 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77b99a-c5cd-4269-bdf1-929a5282e185 None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:16.164480 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77b99a-c5cd-4269-bdf1-929a5282e185 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:16.164789 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77b99a-c5cd-4269-bdf1-929a5282e185 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:16.166170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77b99a-c5cd-4269-bdf1-929a5282e185 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:16.172243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 439/885] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 09:26:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:16.180516 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c119f-bc29-448a-8c33-f78447ef5dfc None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:16.236990 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:16.304491 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c119f-bc29-448a-8c33-f78447ef5dfc None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:16.340794 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562e080-9c81-426e-9101-9511f88e0a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:16.341390 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562e080-9c81-426e-9101-9511f88e0a16 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:16.341677 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562e080-9c81-426e-9101-9511f88e0a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:16.341958 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562e080-9c81-426e-9101-9511f88e0a16 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:16.342663 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562e080-9c81-426e-9101-9511f88e0a16 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:16.342976 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562e080-9c81-426e-9101-9511f88e0a16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:16.344388 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562e080-9c81-426e-9101-9511f88e0a16 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:16.350236 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 447/886] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 09:26:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:16.355945 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77b99a-c5cd-4269-bdf1-929a5282e185 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:16.461481 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77b99a-c5cd-4269-bdf1-929a5282e185 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:16.475362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:16.498301 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ebcb5-1937-47bb-b541-3d0c42a11a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:16.498977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ebcb5-1937-47bb-b541-3d0c42a11a87 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:16.499261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ebcb5-1937-47bb-b541-3d0c42a11a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:16.499561 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ebcb5-1937-47bb-b541-3d0c42a11a87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:16.500351 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ebcb5-1937-47bb-b541-3d0c42a11a87 None admin] RBAC: Adding query filter params (interface=public, service_id=e38d59ef9eda47f6a97d3644e717821b, region_id=RegionOne) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:16.500669 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ebcb5-1937-47bb-b541-3d0c42a11a87 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:16.502080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ebcb5-1937-47bb-b541-3d0c42a11a87 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:16.510305 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 440/887] 10.222.0.41 () {56 vars in 1251 bytes} [Fri May 27 09:26:16 2022] GET /identity/v3/endpoints?service_id=e38d59ef9eda47f6a97d3644e717821b&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:16.515708 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562e080-9c81-426e-9101-9511f88e0a16 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:16.623900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562e080-9c81-426e-9101-9511f88e0a16 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:16.631706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:16.659772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069fe7d-0944-49f3-ad19-e5aa3de720ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:16.660450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069fe7d-0944-49f3-ad19-e5aa3de720ab None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:16.660738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069fe7d-0944-49f3-ad19-e5aa3de720ab None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:16.661021 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069fe7d-0944-49f3-ad19-e5aa3de720ab None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:16.661703 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069fe7d-0944-49f3-ad19-e5aa3de720ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:16.663088 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069fe7d-0944-49f3-ad19-e5aa3de720ab None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:16.669312 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 448/888] 10.222.0.41 () {56 vars in 1087 bytes} [Fri May 27 09:26:16 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:26:17.697868 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e8c6a-f87a-42e4-9bc4-69909d65f36d None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:17.698423 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e8c6a-f87a-42e4-9bc4-69909d65f36d None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:17.698423 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e8c6a-f87a-42e4-9bc4-69909d65f36d None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:17.700094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 441/889] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:17.705446 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e7396-d8e1-4816-a95d-62700520020b None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:17.705859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e7396-d8e1-4816-a95d-62700520020b None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:17.706053 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e7396-d8e1-4816-a95d-62700520020b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:17.723051 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-2e3e7396-d8e1-4816-a95d-62700520020b None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:17.724285 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-2e3e7396-d8e1-4816-a95d-62700520020b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:17.804873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 449/890] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:26:17.828190 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e8c6a-f87a-42e4-9bc4-69909d65f36d None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:17.936318 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e8c6a-f87a-42e4-9bc4-69909d65f36d None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:17.952092 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08bd23-811e-4b35-b1cb-0eb3f9a65dc8 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:17.952360 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08bd23-811e-4b35-b1cb-0eb3f9a65dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:17.952984 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08bd23-811e-4b35-b1cb-0eb3f9a65dc8 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:17.955562 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 450/891] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:26:17.963337 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcda77-a716-4ab3-bb06-e10bfebef75b None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:17.963629 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcda77-a716-4ab3-bb06-e10bfebef75b None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:17.963912 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcda77-a716-4ab3-bb06-e10bfebef75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:17.980166 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831559a-faf4-415f-978f-868e160d4b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:17.980983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831559a-faf4-415f-978f-868e160d4b87 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:17.981115 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-eefcda77-a716-4ab3-bb06-e10bfebef75b None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:17.981318 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831559a-faf4-415f-978f-868e160d4b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:17.981581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831559a-faf4-415f-978f-868e160d4b87 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:17.982466 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-eefcda77-a716-4ab3-bb06-e10bfebef75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:17.995109 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831559a-faf4-415f-978f-868e160d4b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:26:18.005764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-a831559a-faf4-415f-978f-868e160d4b87 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:26:18.005764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:18.005764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:18.005764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:18.005764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:18.005764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:18.005764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:18.005764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:18.005764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:18.005764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:18.005764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:18.005764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:18.005764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:26:18.005764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:26:18.005764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:26:18.005764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:26:18.006717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:26:18.006717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:26:18.006717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:26:18.006717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:26:18.006717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:18.006717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:18.006717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:18.006717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:18.006717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:18.006717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:18.006717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:18.006717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:18.006717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:18.006717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:18.006717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:18.006717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:18.007671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:18.007671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:18.007671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:18.007671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:18.007671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:26:18.007671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:26:18.007671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:26:18.007671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:26:18.007671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:26:18.007671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:26:18.007671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:26:18.007671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:18.007671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 442/892] 10.222.0.41 () {56 vars in 1120 bytes} [Fri May 27 09:26:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:18.014560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831559a-faf4-415f-978f-868e160d4b87 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:18.067667 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:18.070786 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 451/893] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:26:18.094163 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcda77-a716-4ab3-bb06-e10bfebef75b None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:18.134154 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:18.137040 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831559a-faf4-415f-978f-868e160d4b87 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:18.171828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac83cb5-6686-4ca5-911e-4ff25391cf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:18.172808 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac83cb5-6686-4ca5-911e-4ff25391cf8b None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:18.173244 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac83cb5-6686-4ca5-911e-4ff25391cf8b None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:18.173693 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac83cb5-6686-4ca5-911e-4ff25391cf8b None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:18.174574 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac83cb5-6686-4ca5-911e-4ff25391cf8b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:18.175021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac83cb5-6686-4ca5-911e-4ff25391cf8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:18.176563 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac83cb5-6686-4ca5-911e-4ff25391cf8b None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:18.185465 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 443/894] 10.222.0.41 () {56 vars in 1115 bytes} [Fri May 27 09:26:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:18.191035 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac83cb5-6686-4ca5-911e-4ff25391cf8b None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:18.233911 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcda77-a716-4ab3-bb06-e10bfebef75b None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:18.275364 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5508e26-29af-4c9e-b65b-75b2a2d945a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:18.276064 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5508e26-29af-4c9e-b65b-75b2a2d945a5 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:18.276347 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5508e26-29af-4c9e-b65b-75b2a2d945a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:18.276625 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5508e26-29af-4c9e-b65b-75b2a2d945a5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:18.277407 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5508e26-29af-4c9e-b65b-75b2a2d945a5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:18.278949 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5508e26-29af-4c9e-b65b-75b2a2d945a5 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:18.293194 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-a5508e26-29af-4c9e-b65b-75b2a2d945a5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:26:18.293194 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:18.293194 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:26:18.293194 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:26:18.293194 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:26:18.293194 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:26:18.293194 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:26:18.293194 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:18.293194 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:26:18.293194 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:18.293194 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:18.293194 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:18.293194 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:18.293194 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:18.293194 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:18.293194 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:18.294220 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:18.294220 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:18.294220 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:18.294220 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:18.294220 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:18.294220 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:18.294220 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:18.294220 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:26:18.294220 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:26:18.294220 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:26:18.294220 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:26:18.294220 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:18.294220 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:18.294220 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:18.294220 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:18.294220 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:18.295036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:18.295036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:18.295036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:18.295036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:18.295036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:18.295036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:18.295036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:18.295036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:18.295036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:18.295036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:18.295036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:18.295036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:26:18.295036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:18.295036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:26:18.295036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:18.295036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 452/895] 10.222.0.41 () {56 vars in 1132 bytes} [Fri May 27 09:26:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:18.302749 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5508e26-29af-4c9e-b65b-75b2a2d945a5 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:18.311306 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:18.316544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac83cb5-6686-4ca5-911e-4ff25391cf8b None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:18.354861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e553562-04f7-4e31-bad2-efef0ffc4d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:18.356093 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e553562-04f7-4e31-bad2-efef0ffc4d0a None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:18.356635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e553562-04f7-4e31-bad2-efef0ffc4d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:18.357116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e553562-04f7-4e31-bad2-efef0ffc4d0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:18.368957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e553562-04f7-4e31-bad2-efef0ffc4d0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:18.370681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e553562-04f7-4e31-bad2-efef0ffc4d0a None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:18.389343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-5e553562-04f7-4e31-bad2-efef0ffc4d0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:18.389343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:18.389343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:18.389343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:18.389343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:18.389343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:18.389343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:18.389343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:18.389343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:18.389343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:18.389343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:18.389343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:18.389343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:18.389343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:18.389343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:18.390264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:18.390264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:18.390264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:18.390264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:18.390264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:18.390264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:18.390264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:18.390264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:18.390264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:18.390264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:18.390264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:18.390264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:18.390264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:18.390264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:18.390264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:18.390264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:18.390264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:18.391129 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:18.391129 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:18.391129 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:18.391129 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:18.394064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 444/896] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:18.399511 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e553562-04f7-4e31-bad2-efef0ffc4d0a None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:18.410583 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:18.417998 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5508e26-29af-4c9e-b65b-75b2a2d945a5 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:18.455404 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65761f8-9162-4cfb-8428-197c4fb1e915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:18.456079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65761f8-9162-4cfb-8428-197c4fb1e915 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:18.456360 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65761f8-9162-4cfb-8428-197c4fb1e915 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:18.456632 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65761f8-9162-4cfb-8428-197c4fb1e915 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:18.457340 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65761f8-9162-4cfb-8428-197c4fb1e915 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:18.457646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65761f8-9162-4cfb-8428-197c4fb1e915 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:18.459033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65761f8-9162-4cfb-8428-197c4fb1e915 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:18.468739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 453/897] 10.222.0.41 () {56 vars in 1126 bytes} [Fri May 27 09:26:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:18.469612 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65761f8-9162-4cfb-8428-197c4fb1e915 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:18.513313 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e553562-04f7-4e31-bad2-efef0ffc4d0a None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:18.552277 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ae95e-b35f-4786-a954-12430943e6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:18.553046 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ae95e-b35f-4786-a954-12430943e6ac None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:18.553327 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ae95e-b35f-4786-a954-12430943e6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:18.553602 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ae95e-b35f-4786-a954-12430943e6ac None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:18.554316 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ae95e-b35f-4786-a954-12430943e6ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:18.554621 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ae95e-b35f-4786-a954-12430943e6ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:18.556224 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ae95e-b35f-4786-a954-12430943e6ac None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:18.571678 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 445/898] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:18.573044 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9911832-dd09-4e0a-af76-09312f4e9482 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:18.573319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9911832-dd09-4e0a-af76-09312f4e9482 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:18.573596 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9911832-dd09-4e0a-af76-09312f4e9482 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:18.574876 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 446/899] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:18.575593 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9911832-dd09-4e0a-af76-09312f4e9482 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:18.578462 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65761f8-9162-4cfb-8428-197c4fb1e915 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:18.588012 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:18.616579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f8193-0b1f-482b-872c-0f88b7cce371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:18.617255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f8193-0b1f-482b-872c-0f88b7cce371 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:18.617542 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f8193-0b1f-482b-872c-0f88b7cce371 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:18.617820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f8193-0b1f-482b-872c-0f88b7cce371 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:18.618960 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f8193-0b1f-482b-872c-0f88b7cce371 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:18.619317 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f8193-0b1f-482b-872c-0f88b7cce371 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:18.621061 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f8193-0b1f-482b-872c-0f88b7cce371 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:18.631109 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 454/900] 10.222.0.41 () {56 vars in 1126 bytes} [Fri May 27 09:26:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:18.631109 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc23d1-eea8-4329-af6b-494dd83a328f None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:18.631109 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc23d1-eea8-4329-af6b-494dd83a328f None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:18.631109 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc23d1-eea8-4329-af6b-494dd83a328f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:18.648155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-92cc23d1-eea8-4329-af6b-494dd83a328f None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:18.649333 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-92cc23d1-eea8-4329-af6b-494dd83a328f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:18.668239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:18.693320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9911832-dd09-4e0a-af76-09312f4e9482 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:18.731317 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 455/901] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:18.731317 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc23d1-eea8-4329-af6b-494dd83a328f None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:18.743542 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87613074-5a47-4f9e-af27-37f186f2f0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:18.744439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87613074-5a47-4f9e-af27-37f186f2f0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:18.744736 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87613074-5a47-4f9e-af27-37f186f2f0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:18.745012 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87613074-5a47-4f9e-af27-37f186f2f0d0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:18.754185 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87613074-5a47-4f9e-af27-37f186f2f0d0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:18.755711 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87613074-5a47-4f9e-af27-37f186f2f0d0 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:18.772245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-87613074-5a47-4f9e-af27-37f186f2f0d0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:26:18.772245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:18.772245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:18.772245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:18.772245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:18.772245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:18.772245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:18.772245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:18.772245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:18.772245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:18.772245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:18.772245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:18.772245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:26:18.772245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:26:18.772245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:26:18.772245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:26:18.773186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:18.773186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:18.773186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:26:18.773186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:18.773186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:26:18.773186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:18.773186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:18.773186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:18.773186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:18.773186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:18.773186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:18.773186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:18.773186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:18.773186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:18.773186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:18.773186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:18.773186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:18.773186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:18.774100 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:18.774100 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:18.774100 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:26:18.774100 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:26:18.774100 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:26:18.774100 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:26:18.774100 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:26:18.774100 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:26:18.774100 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:26:18.774100 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:18.774100 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 447/902] 10.222.0.41 () {56 vars in 1117 bytes} [Fri May 27 09:26:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:18.774680 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87613074-5a47-4f9e-af27-37f186f2f0d0 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:18.835130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc23d1-eea8-4329-af6b-494dd83a328f None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:18.847178 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:18.870138 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cda75-00ec-4699-9372-63989a1aecc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:18.870805 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cda75-00ec-4699-9372-63989a1aecc9 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:18.871086 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cda75-00ec-4699-9372-63989a1aecc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:18.871393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cda75-00ec-4699-9372-63989a1aecc9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:18.872173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9cda75-00ec-4699-9372-63989a1aecc9 None admin] RBAC: Adding query filter params (interface=public, service_id=c028713f1d7b4668917781fcd2dd8b4f, region_id=RegionOne) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:18.872487 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9cda75-00ec-4699-9372-63989a1aecc9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:18.873863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9cda75-00ec-4699-9372-63989a1aecc9 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:18.883634 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 456/903] 10.222.0.41 () {56 vars in 1251 bytes} [Fri May 27 09:26:18 2022] GET /identity/v3/endpoints?service_id=c028713f1d7b4668917781fcd2dd8b4f&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:18.883802 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87613074-5a47-4f9e-af27-37f186f2f0d0 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:18.883899 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cda75-00ec-4699-9372-63989a1aecc9 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:18.901418 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:18.918728 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7ba81-31b0-4b67-b413-d0ddaebb667f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:18.919426 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7ba81-31b0-4b67-b413-d0ddaebb667f None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:18.919716 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7ba81-31b0-4b67-b413-d0ddaebb667f None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:18.919995 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7ba81-31b0-4b67-b413-d0ddaebb667f None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:18.920720 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7ba81-31b0-4b67-b413-d0ddaebb667f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:18.922085 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7ba81-31b0-4b67-b413-d0ddaebb667f None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:18.935666 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 448/904] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 09:26:18 2022] POST /identity/v3/services => generated 241 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:26:18.936440 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7ba81-31b0-4b67-b413-d0ddaebb667f None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:18.990677 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cda75-00ec-4699-9372-63989a1aecc9 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:19.038854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a8e7c-0299-434f-b8e2-10e63761880d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:19.039488 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a8e7c-0299-434f-b8e2-10e63761880d None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:19.039771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a8e7c-0299-434f-b8e2-10e63761880d None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:19.040046 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a8e7c-0299-434f-b8e2-10e63761880d None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:19.041399 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a8e7c-0299-434f-b8e2-10e63761880d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:19.041712 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a8e7c-0299-434f-b8e2-10e63761880d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:19.043181 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a8e7c-0299-434f-b8e2-10e63761880d None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:19.062697 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 457/905] 10.222.0.41 () {56 vars in 1149 bytes} [Fri May 27 09:26:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:19.063836 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c44d74-b753-49ec-8100-bf6d6c2aa906 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:19.064124 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c44d74-b753-49ec-8100-bf6d6c2aa906 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:19.064941 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c44d74-b753-49ec-8100-bf6d6c2aa906 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:19.066545 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 458/906] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:19.067099 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7ba81-31b0-4b67-b413-d0ddaebb667f None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:19.068613 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c44d74-b753-49ec-8100-bf6d6c2aa906 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:19.104489 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:19.113124 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4660d26-ce9d-4b96-b22c-35d7045f74f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:19.114528 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4660d26-ce9d-4b96-b22c-35d7045f74f2 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:19.115485 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4660d26-ce9d-4b96-b22c-35d7045f74f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:19.115485 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4660d26-ce9d-4b96-b22c-35d7045f74f2 None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:19.116201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4660d26-ce9d-4b96-b22c-35d7045f74f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:19.117664 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4660d26-ce9d-4b96-b22c-35d7045f74f2 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:19.124581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 449/907] 10.222.0.41 () {56 vars in 1087 bytes} [Fri May 27 09:26:18 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:26:19.126242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590eace-3d88-41b7-88d4-e09df8bbe231 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:19.127313 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590eace-3d88-41b7-88d4-e09df8bbe231 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:19.127914 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590eace-3d88-41b7-88d4-e09df8bbe231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:19.147162 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-2590eace-3d88-41b7-88d4-e09df8bbe231 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:19.148659 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-2590eace-3d88-41b7-88d4-e09df8bbe231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:19.162233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:19.213280 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c44d74-b753-49ec-8100-bf6d6c2aa906 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:19.247657 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 450/908] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:19.257390 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b5a9e-8484-4f0c-bddd-a38bdaf8af7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:19.258161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b5a9e-8484-4f0c-bddd-a38bdaf8af7f None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:19.258524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b5a9e-8484-4f0c-bddd-a38bdaf8af7f None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:19.258871 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b5a9e-8484-4f0c-bddd-a38bdaf8af7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:19.276748 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590eace-3d88-41b7-88d4-e09df8bbe231 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:19.344293 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b5a9e-8484-4f0c-bddd-a38bdaf8af7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:19.345761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b5a9e-8484-4f0c-bddd-a38bdaf8af7f None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:19.417337 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590eace-3d88-41b7-88d4-e09df8bbe231 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:19.431099 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:19.445809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:19.458089 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce864af2-a626-4630-b344-292a71506eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:19.458981 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce864af2-a626-4630-b344-292a71506eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:19.459367 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce864af2-a626-4630-b344-292a71506eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:19.459716 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce864af2-a626-4630-b344-292a71506eb1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:19.460444 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce864af2-a626-4630-b344-292a71506eb1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:19.461906 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce864af2-a626-4630-b344-292a71506eb1 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:19.474229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-ce864af2-a626-4630-b344-292a71506eb1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:26:19.474229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:19.474229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:26:19.474229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:26:19.474229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:26:19.474229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:26:19.474229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:26:19.474229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:19.474229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:26:19.474229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:19.474229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:19.474229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:19.474229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:19.474229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:19.474229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:19.474229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:19.474229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:19.475217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:19.475217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:19.475217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:19.475217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:19.475217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:19.475217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:19.475217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:26:19.475217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:26:19.475217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:26:19.475217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:26:19.475217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:19.475217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:19.475217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:19.475217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:19.475217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:19.475217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:19.476369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:19.476369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:19.476369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:19.476369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:19.476369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:19.476369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:19.476369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:19.476369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:19.476369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:19.476369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:19.476369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:26:19.476369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:19.476369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 09:26:19.476369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:19.476369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 451/910] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 09:26:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:19.477724 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 459/910] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:26:19 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 09:26:19.480168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce864af2-a626-4630-b344-292a71506eb1 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:19.481467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b5a9e-8484-4f0c-bddd-a38bdaf8af7f None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:19.587842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b5a9e-8484-4f0c-bddd-a38bdaf8af7f None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:19.594371 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce864af2-a626-4630-b344-292a71506eb1 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:19.626296 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001da62-0293-4297-95e1-2cd199053934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:19.626998 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001da62-0293-4297-95e1-2cd199053934 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:19.627302 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001da62-0293-4297-95e1-2cd199053934 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:19.627594 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001da62-0293-4297-95e1-2cd199053934 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:19.628296 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001da62-0293-4297-95e1-2cd199053934 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:19.628605 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001da62-0293-4297-95e1-2cd199053934 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:19.629986 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001da62-0293-4297-95e1-2cd199053934 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:19.639450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 460/911] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 09:26:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:19.641213 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3628d7-d1f1-493e-a00f-81f74e091fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:19.642016 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3628d7-d1f1-493e-a00f-81f74e091fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:19.642324 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3628d7-d1f1-493e-a00f-81f74e091fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:19.642602 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3628d7-d1f1-493e-a00f-81f74e091fd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:19.643983 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001da62-0293-4297-95e1-2cd199053934 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:19.656553 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3628d7-d1f1-493e-a00f-81f74e091fd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:19.658711 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3628d7-d1f1-493e-a00f-81f74e091fd8 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:19.678662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-ec3628d7-d1f1-493e-a00f-81f74e091fd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:19.678662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:19.678662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:19.678662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:19.678662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:19.678662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:19.678662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:19.678662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:19.678662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:19.678662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:19.678662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:19.678662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:19.678662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:19.678662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:19.678662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:19.680571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:19.680571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:19.680571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:19.680571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:19.680571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:19.680571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:19.680571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:19.680571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:19.680571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:19.680571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:19.680571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:19.680571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:19.680571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:19.680571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:19.680571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:19.680571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:19.680571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:19.681964 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:19.681964 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:19.681964 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:19.681964 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:19.681964 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 452/912] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:19.685651 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3628d7-d1f1-493e-a00f-81f74e091fd8 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:19.699836 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:19.735108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:19.796106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001da62-0293-4297-95e1-2cd199053934 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:19.806910 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3628d7-d1f1-493e-a00f-81f74e091fd8 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:19.842966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461f7e5-36fe-422f-917f-92f036ddca3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:19.843821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461f7e5-36fe-422f-917f-92f036ddca3a None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:19.844204 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461f7e5-36fe-422f-917f-92f036ddca3a None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:19.844634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461f7e5-36fe-422f-917f-92f036ddca3a None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:19.845920 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461f7e5-36fe-422f-917f-92f036ddca3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:19.846335 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461f7e5-36fe-422f-917f-92f036ddca3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:19.847265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f49931-0026-43e1-9f72-2ff2552a6492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:19.848081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461f7e5-36fe-422f-917f-92f036ddca3a None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:19.848277 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f49931-0026-43e1-9f72-2ff2552a6492 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:19.848700 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f49931-0026-43e1-9f72-2ff2552a6492 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:19.849121 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f49931-0026-43e1-9f72-2ff2552a6492 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:19.850288 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f49931-0026-43e1-9f72-2ff2552a6492 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:19.850770 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f49931-0026-43e1-9f72-2ff2552a6492 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:19.852751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f49931-0026-43e1-9f72-2ff2552a6492 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:19.863397 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 461/913] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 09:26:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:19.864894 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f49931-0026-43e1-9f72-2ff2552a6492 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:19.866238 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 453/914] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:19.871164 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461f7e5-36fe-422f-917f-92f036ddca3a None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:19.970497 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:19.973824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461f7e5-36fe-422f-917f-92f036ddca3a None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:19.993800 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:19.998708 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f49931-0026-43e1-9f72-2ff2552a6492 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:20.009559 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799787a-a413-449e-ab69-9371434e602c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:20.010331 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799787a-a413-449e-ab69-9371434e602c None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:20.010612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799787a-a413-449e-ab69-9371434e602c None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:20.010878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799787a-a413-449e-ab69-9371434e602c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:20.018698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799787a-a413-449e-ab69-9371434e602c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:20.020104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799787a-a413-449e-ab69-9371434e602c None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:20.041859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-7799787a-a413-449e-ab69-9371434e602c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:20.041859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:20.041859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:20.041859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:20.041859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:20.041859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:20.041859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:20.041859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:20.041859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:20.041859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:20.041859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:20.041859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:20.041859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:26:20.041859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:26:20.041859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:26:20.042807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:26:20.042807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:20.042807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:20.042807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:20.042807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:20.042807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:20.042807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:20.042807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:20.042807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:20.042807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:20.042807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:20.042807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:20.042807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:20.042807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:20.042807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:20.042807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:20.042807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:20.043782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:26:20.043782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:26:20.043782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:26:20.043782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:26:20.043782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:26:20.043782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:26:20.043782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:20.043782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:20.047621 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 454/915] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:26:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:20.048341 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf43a34-dba3-43db-aaff-37184d29059b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:20.049070 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799787a-a413-449e-ab69-9371434e602c None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:20.049599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf43a34-dba3-43db-aaff-37184d29059b None admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:20.050082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf43a34-dba3-43db-aaff-37184d29059b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:20.050564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf43a34-dba3-43db-aaff-37184d29059b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:20.051542 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf43a34-dba3-43db-aaff-37184d29059b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:20.053219 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf43a34-dba3-43db-aaff-37184d29059b None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:20.087904 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 462/916] 10.222.0.41 () {60 vars in 1144 bytes} [Fri May 27 09:26:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:26:20.174714 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799787a-a413-449e-ab69-9371434e602c None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:20.217733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264104ce-baf2-401d-8403-3bcb13c5403b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:20.218412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264104ce-baf2-401d-8403-3bcb13c5403b None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:20.218697 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264104ce-baf2-401d-8403-3bcb13c5403b None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:20.218974 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264104ce-baf2-401d-8403-3bcb13c5403b None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:20.219801 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264104ce-baf2-401d-8403-3bcb13c5403b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:20.220114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264104ce-baf2-401d-8403-3bcb13c5403b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:20.222165 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264104ce-baf2-401d-8403-3bcb13c5403b None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:20.236318 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 455/917] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:26:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:20.242374 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf43a34-dba3-43db-aaff-37184d29059b None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:20.355257 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf43a34-dba3-43db-aaff-37184d29059b None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:20.391494 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a3805-d5a5-47d1-9f32-0ea02db64fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:20.392164 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a3805-d5a5-47d1-9f32-0ea02db64fac None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:20.393030 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a3805-d5a5-47d1-9f32-0ea02db64fac None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:20.393311 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a3805-d5a5-47d1-9f32-0ea02db64fac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:20.394207 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a3805-d5a5-47d1-9f32-0ea02db64fac None admin] RBAC: Adding query filter params (role.id=582df05c56014989bfe8f0e5522d0633, scope.project.id=b1d802dc0211467fa4e709cd01d411dc, user.id=f52f0a03cc0f494d82a091bd885478e1) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:20.394526 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a3805-d5a5-47d1-9f32-0ea02db64fac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:20.396014 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a3805-d5a5-47d1-9f32-0ea02db64fac None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:20.402056 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 463/918] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:26:20 2022] GET /identity/v3/role_assignments?user.id=f52f0a03cc0f494d82a091bd885478e1&scope.project.id=b1d802dc0211467fa4e709cd01d411dc&role.id=582df05c56014989bfe8f0e5522d0633 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:21.279882 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d6e10-d044-4b0f-bc29-a2572243bf15 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:21.280437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d6e10-d044-4b0f-bc29-a2572243bf15 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:21.280437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d6e10-d044-4b0f-bc29-a2572243bf15 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:21.282116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 456/919] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:21.289120 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d35696-9efc-4257-9fd4-b88b27190505 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:21.290123 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d35696-9efc-4257-9fd4-b88b27190505 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:21.290616 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d35696-9efc-4257-9fd4-b88b27190505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:21.308969 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-f0d35696-9efc-4257-9fd4-b88b27190505 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:21.310484 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f0d35696-9efc-4257-9fd4-b88b27190505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:21.324621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:21.388038 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 464/920] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:26:21.410764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d6e10-d044-4b0f-bc29-a2572243bf15 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:21.429789 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:21.473472 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd854555-8c57-43c0-97f8-97881b2563c7 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:21.473809 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd854555-8c57-43c0-97f8-97881b2563c7 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:21.474043 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd854555-8c57-43c0-97f8-97881b2563c7 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:21.475771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 465/921] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:26:21.481967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167e596-8c7e-4cb4-90e3-0995c32863e3 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:21.482506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167e596-8c7e-4cb4-90e3-0995c32863e3 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:21.482983 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167e596-8c7e-4cb4-90e3-0995c32863e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:21.502315 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-d167e596-8c7e-4cb4-90e3-0995c32863e3 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:21.504658 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d167e596-8c7e-4cb4-90e3-0995c32863e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:21.529211 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d6e10-d044-4b0f-bc29-a2572243bf15 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:21.564945 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e5c47-f4ea-4fa3-8f90-58fb76f9f9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:21.565873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e5c47-f4ea-4fa3-8f90-58fb76f9f9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:21.566158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e5c47-f4ea-4fa3-8f90-58fb76f9f9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:21.566434 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e5c47-f4ea-4fa3-8f90-58fb76f9f9d2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:21.567101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e5c47-f4ea-4fa3-8f90-58fb76f9f9d2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:21.568602 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e5c47-f4ea-4fa3-8f90-58fb76f9f9d2 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:21.582172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-309e5c47-f4ea-4fa3-8f90-58fb76f9f9d2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:26:21.582172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:21.582172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:26:21.582172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:26:21.582172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:26:21.582172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:26:21.582172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:26:21.582172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:21.582172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:26:21.582172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:21.582172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:21.582172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:21.582172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:21.582172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:21.582172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:21.582172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:21.582172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:21.583144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:21.583144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:21.583144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:21.583144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:21.583144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:21.583144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:21.583144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:26:21.583144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:26:21.583144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:26:21.583144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:26:21.583144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:21.583144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:21.583144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:21.583144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:21.583144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:21.583144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:21.584315 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:21.584315 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:21.584315 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:21.584315 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:21.584315 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:21.584315 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:21.584315 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:21.584315 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:21.584315 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:21.584315 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:21.584315 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:26:21.584315 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:21.584315 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:26:21.584315 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:21.584315 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 457/922] 10.222.0.41 () {56 vars in 1126 bytes} [Fri May 27 09:26:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:21.589411 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e5c47-f4ea-4fa3-8f90-58fb76f9f9d2 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:21.599380 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 466/923] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:26:21.617857 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167e596-8c7e-4cb4-90e3-0995c32863e3 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:21.680287 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:21.702335 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e5c47-f4ea-4fa3-8f90-58fb76f9f9d2 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:21.714116 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:21.741448 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167e596-8c7e-4cb4-90e3-0995c32863e3 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:21.742038 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb4a16-01df-4039-a4b4-b0e05d5d853f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:21.743164 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb4a16-01df-4039-a4b4-b0e05d5d853f None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:21.743808 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb4a16-01df-4039-a4b4-b0e05d5d853f None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:21.744301 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb4a16-01df-4039-a4b4-b0e05d5d853f None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:21.745192 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb4a16-01df-4039-a4b4-b0e05d5d853f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:21.745705 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb4a16-01df-4039-a4b4-b0e05d5d853f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:21.747296 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb4a16-01df-4039-a4b4-b0e05d5d853f None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:21.753495 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 458/924] 10.222.0.41 () {56 vars in 1122 bytes} [Fri May 27 09:26:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:21.759428 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb4a16-01df-4039-a4b4-b0e05d5d853f None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:21.785523 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9d2ff-f688-4c39-85bb-f67a630d7cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:21.786810 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9d2ff-f688-4c39-85bb-f67a630d7cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:21.787335 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9d2ff-f688-4c39-85bb-f67a630d7cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:21.787806 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9d2ff-f688-4c39-85bb-f67a630d7cd6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:21.788698 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9d2ff-f688-4c39-85bb-f67a630d7cd6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:21.790480 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9d2ff-f688-4c39-85bb-f67a630d7cd6 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:21.804325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-47a9d2ff-f688-4c39-85bb-f67a630d7cd6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:26:21.804325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:21.804325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:26:21.804325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:26:21.804325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:26:21.804325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:26:21.804325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:26:21.804325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:21.804325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:26:21.804325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:21.804325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:21.804325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:21.804325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:21.804325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:21.804325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:21.804325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:21.805268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:21.805268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:21.805268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:21.805268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:21.805268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:21.805268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:21.805268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:21.805268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:26:21.805268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:26:21.805268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:26:21.805268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:26:21.805268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:21.805268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:21.805268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:21.805268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:21.805268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:21.806100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:21.806100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:21.806100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:21.806100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:21.806100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:21.806100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:21.806100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:21.806100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:21.806100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:21.806100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:21.806100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:21.806100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:26:21.806100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:21.806100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 09:26:21.806100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:21.814004 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 467/925] 10.222.0.41 () {56 vars in 1132 bytes} [Fri May 27 09:26:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:21.815706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9d2ff-f688-4c39-85bb-f67a630d7cd6 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:21.880317 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb4a16-01df-4039-a4b4-b0e05d5d853f None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:21.915613 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e77ae-37c9-44fa-bccd-3b23f2e8a743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:21.916558 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e77ae-37c9-44fa-bccd-3b23f2e8a743 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:21.916679 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e77ae-37c9-44fa-bccd-3b23f2e8a743 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:21.916873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e77ae-37c9-44fa-bccd-3b23f2e8a743 None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:21.917582 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e77ae-37c9-44fa-bccd-3b23f2e8a743 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:21.917929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e77ae-37c9-44fa-bccd-3b23f2e8a743 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:21.919231 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e77ae-37c9-44fa-bccd-3b23f2e8a743 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:21.926658 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9d2ff-f688-4c39-85bb-f67a630d7cd6 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:21.930133 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 459/926] 10.222.0.41 () {56 vars in 1122 bytes} [Fri May 27 09:26:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:21.930329 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e77ae-37c9-44fa-bccd-3b23f2e8a743 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:21.941902 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:21.969264 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3933e-5e1a-4120-97e6-f94cf6533086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:21.970433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3933e-5e1a-4120-97e6-f94cf6533086 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:21.970938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3933e-5e1a-4120-97e6-f94cf6533086 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:21.971480 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3933e-5e1a-4120-97e6-f94cf6533086 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:21.972542 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3933e-5e1a-4120-97e6-f94cf6533086 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:21.973082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3933e-5e1a-4120-97e6-f94cf6533086 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:21.974798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3933e-5e1a-4120-97e6-f94cf6533086 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:21.985668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 468/927] 10.222.0.41 () {56 vars in 1126 bytes} [Fri May 27 09:26:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:21.986880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3933e-5e1a-4120-97e6-f94cf6533086 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:21.996817 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:22.035089 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e77ae-37c9-44fa-bccd-3b23f2e8a743 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:22.071265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4d95b-2409-4682-90b7-8a9f4530af85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:22.071959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4d95b-2409-4682-90b7-8a9f4530af85 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:22.072243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4d95b-2409-4682-90b7-8a9f4530af85 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:22.072523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4d95b-2409-4682-90b7-8a9f4530af85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:22.073308 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4d95b-2409-4682-90b7-8a9f4530af85 None admin] RBAC: Adding query filter params (interface=public, service_id=f4b5627a5ae148d5ba5ec24ab0472dce, region_id=RegionOne) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:22.073618 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4d95b-2409-4682-90b7-8a9f4530af85 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:22.075346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4d95b-2409-4682-90b7-8a9f4530af85 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:22.085652 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 460/928] 10.222.0.41 () {56 vars in 1251 bytes} [Fri May 27 09:26:21 2022] GET /identity/v3/endpoints?service_id=f4b5627a5ae148d5ba5ec24ab0472dce&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:22.086525 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4d95b-2409-4682-90b7-8a9f4530af85 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:22.103973 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3933e-5e1a-4120-97e6-f94cf6533086 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:22.144682 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf7822-2eb8-4bed-b3bc-db0d92d10057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:22.145912 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf7822-2eb8-4bed-b3bc-db0d92d10057 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:22.146396 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf7822-2eb8-4bed-b3bc-db0d92d10057 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:22.146869 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf7822-2eb8-4bed-b3bc-db0d92d10057 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:22.148019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf7822-2eb8-4bed-b3bc-db0d92d10057 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:22.148614 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf7822-2eb8-4bed-b3bc-db0d92d10057 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:22.150246 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf7822-2eb8-4bed-b3bc-db0d92d10057 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:22.161160 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 469/929] 10.222.0.41 () {56 vars in 1126 bytes} [Fri May 27 09:26:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:22.161829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:22.163825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf7822-2eb8-4bed-b3bc-db0d92d10057 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:22.193675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4d95b-2409-4682-90b7-8a9f4530af85 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:22.229025 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05534aaa-89d7-4b98-b763-f6b139d96933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:22.229579 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05534aaa-89d7-4b98-b763-f6b139d96933 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:22.229864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05534aaa-89d7-4b98-b763-f6b139d96933 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:22.230140 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05534aaa-89d7-4b98-b763-f6b139d96933 None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:22.230817 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05534aaa-89d7-4b98-b763-f6b139d96933 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:22.232231 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05534aaa-89d7-4b98-b763-f6b139d96933 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:22.244284 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 461/930] 10.222.0.41 () {56 vars in 1087 bytes} [Fri May 27 09:26:22 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:26:22.245768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:22.290238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf7822-2eb8-4bed-b3bc-db0d92d10057 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:22.335323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66704b7f-9840-4d5b-bc68-b6e6d2056824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:22.335323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66704b7f-9840-4d5b-bc68-b6e6d2056824 None admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:22.335597 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66704b7f-9840-4d5b-bc68-b6e6d2056824 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:22.335849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66704b7f-9840-4d5b-bc68-b6e6d2056824 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:22.336493 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66704b7f-9840-4d5b-bc68-b6e6d2056824 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:22.337928 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66704b7f-9840-4d5b-bc68-b6e6d2056824 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:22.362998 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 470/931] 10.222.0.41 () {60 vars in 1144 bytes} [Fri May 27 09:26:22 2022] POST /identity/v3/endpoints => generated 347 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:26:22.490819 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce145c6e-507c-4f66-a153-7355ac2f3f1d None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:22.490819 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce145c6e-507c-4f66-a153-7355ac2f3f1d None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:22.490819 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce145c6e-507c-4f66-a153-7355ac2f3f1d None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:22.492712 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 462/932] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:22.497832 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa591490-e4e1-4178-b40d-fb665376826a None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:22.498214 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa591490-e4e1-4178-b40d-fb665376826a None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:22.498565 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa591490-e4e1-4178-b40d-fb665376826a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:22.516764 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-aa591490-e4e1-4178-b40d-fb665376826a None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:22.518515 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-aa591490-e4e1-4178-b40d-fb665376826a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:22.603396 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 471/933] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:22.622724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce145c6e-507c-4f66-a153-7355ac2f3f1d None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:22.645570 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a9ecf-075e-4384-8953-7439bb50693d None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:22.645899 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a9ecf-075e-4384-8953-7439bb50693d None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:22.646125 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a9ecf-075e-4384-8953-7439bb50693d None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:22.647809 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 472/934] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:26:22.655186 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3d28e-730b-422d-8649-04ea0a6f6f88 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:22.655504 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3d28e-730b-422d-8649-04ea0a6f6f88 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:22.655784 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3d28e-730b-422d-8649-04ea0a6f6f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:22.676583 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-dca3d28e-730b-422d-8649-04ea0a6f6f88 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:22.677768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-dca3d28e-730b-422d-8649-04ea0a6f6f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:22.742815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:22.747103 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce145c6e-507c-4f66-a153-7355ac2f3f1d None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:22.771392 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 473/935] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:26:22.792119 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962fc58-0672-4f37-adff-7397f911274c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:22.793619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3d28e-730b-422d-8649-04ea0a6f6f88 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:22.794289 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962fc58-0672-4f37-adff-7397f911274c None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:22.794588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962fc58-0672-4f37-adff-7397f911274c None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:22.794877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962fc58-0672-4f37-adff-7397f911274c None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:22.795763 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962fc58-0672-4f37-adff-7397f911274c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:22.797210 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962fc58-0672-4f37-adff-7397f911274c None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:22.798635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: WARNING keystone.server.flask.common [None req-d962fc58-0672-4f37-adff-7397f911274c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 27 09:26:22.804327 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:22.822963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.sql.core [None req-d962fc58-0672-4f37-adff-7397f911274c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 09:26:22.822963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 27 09:26:22.822963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [parameters: {'id': 'cdf0d0ba11c043c99529187f7f3dd574', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 27 09:26:22.822963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80091) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 09:26:22.833996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-d962fc58-0672-4f37-adff-7397f911274c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cdf0d0ba11c043c99529187f7f3dd574.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cdf0d0ba11c043c99529187f7f3dd574. May 27 09:26:22.833996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:22.833996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 09:26:22.833996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 09:26:22.833996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 09:26:22.833996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 09:26:22.833996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 09:26:22.833996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application result = self._query(query) May 27 09:26:22.833996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 09:26:22.833996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application conn.query(q) May 27 09:26:22.833996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 09:26:22.833996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 09:26:22.833996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 09:26:22.834800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application result.read() May 27 09:26:22.834800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 09:26:22.834800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 09:26:22.834800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 09:26:22.834800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 09:26:22.834800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 09:26:22.834800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 09:26:22.834800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 09:26:22.834800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 09:26:22.834800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 09:26:22.834800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:22.834800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 09:26:22.834800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:22.834800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:22.834800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 09:26:22.834800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 09:26:22.834800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 27 09:26:22.834800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return project_ref.to_dict() May 27 09:26:22.835812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 09:26:22.835812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application next(self.gen) May 27 09:26:22.835812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 09:26:22.835812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application yield resource May 27 09:26:22.835812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 09:26:22.835812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application next(self.gen) May 27 09:26:22.835812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 09:26:22.835812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self.session.rollback() May 27 09:26:22.835812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 09:26:22.835812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self.force_reraise() May 27 09:26:22.835812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 09:26:22.835812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise self.value May 27 09:26:22.835812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 09:26:22.835812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 09:26:22.835812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 09:26:22.835812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application session.commit() May 27 09:26:22.835812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 09:26:22.840454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 09:26:22.840454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 09:26:22.840454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._prepare_impl() May 27 09:26:22.840454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 09:26:22.840454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self.session.flush() May 27 09:26:22.840454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 09:26:22.840454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._flush(objects) May 27 09:26:22.840454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 09:26:22.840454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 09:26:22.840454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 09:26:22.840454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application compat.raise_( May 27 09:26:22.840454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 09:26:22.840454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception May 27 09:26:22.840454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 09:26:22.840454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application flush_context.execute() May 27 09:26:22.840454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 09:26:22.840454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rec.execute(self) May 27 09:26:22.841344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 09:26:22.841344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 09:26:22.841344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 09:26:22.841344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 09:26:22.841344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 27 09:26:22.841344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application c = connection._execute_20( May 27 09:26:22.841344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 09:26:22.841344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 09:26:22.841344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 09:26:22.841344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 09:26:22.841344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 09:26:22.841344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 09:26:22.841344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 09:26:22.841344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 09:26:22.841344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 09:26:22.842116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 09:26:22.842116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 09:26:22.842116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception May 27 09:26:22.842116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 09:26:22.842116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 09:26:22.842116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 09:26:22.842116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 09:26:22.842116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 09:26:22.842116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application result = self._query(query) May 27 09:26:22.842116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 09:26:22.842116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application conn.query(q) May 27 09:26:22.842116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 09:26:22.842116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 09:26:22.842116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 09:26:22.842116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application result.read() May 27 09:26:22.842116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 09:26:22.842116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 09:26:22.842963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 09:26:22.842963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 09:26:22.842963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 09:26:22.842963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 09:26:22.842963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 09:26:22.842963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 09:26:22.842963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 09:26:22.842963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 27 09:26:22.842963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [parameters: {'id': 'cdf0d0ba11c043c99529187f7f3dd574', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 27 09:26:22.842963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 09:26:22.842963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:22.842963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:22.842963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:22.842963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:22.842963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 27 09:26:22.846843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 27 09:26:22.846843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 09:26:22.846843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 09:26:22.846843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 27 09:26:22.846843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:22.846843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:22.846843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:22.846843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:22.846843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:22.846843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:22.846843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:22.846843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:22.846843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:22.846843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:22.846843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:22.846843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:22.846843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:22.848976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:22.848976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 27 09:26:22.848976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 27 09:26:22.848976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:22.848976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:22.848976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 27 09:26:22.848976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.Conflict( May 27 09:26:22.848976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cdf0d0ba11c043c99529187f7f3dd574. May 27 09:26:22.848976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:22.848976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 463/936] 10.222.0.41 () {60 vars in 1140 bytes} [Fri May 27 09:26:22 2022] POST /identity/v3/projects => generated 262 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:22.848976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962fc58-0672-4f37-adff-7397f911274c None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:22.926834 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3d28e-730b-422d-8649-04ea0a6f6f88 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:22.968179 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5c2c0-e762-49ef-ac4e-bd8efdc6b975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:22.969472 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5c2c0-e762-49ef-ac4e-bd8efdc6b975 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:22.970017 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5c2c0-e762-49ef-ac4e-bd8efdc6b975 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:22.970530 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5c2c0-e762-49ef-ac4e-bd8efdc6b975 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:22.975187 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962fc58-0672-4f37-adff-7397f911274c None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:22.982273 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5c2c0-e762-49ef-ac4e-bd8efdc6b975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:26:22.992242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-9bc5c2c0-e762-49ef-ac4e-bd8efdc6b975 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:26:22.992242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:22.992242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:22.992242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:22.992242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:22.992242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:22.992242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:22.992242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:22.992242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:22.992242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:22.992242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:22.992242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:22.992242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:26:22.992242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:26:22.992242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:26:22.992242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:26:22.993235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:26:22.993235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:26:22.993235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:26:22.993235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:26:22.993235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:22.993235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:22.993235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:22.993235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:22.993235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:22.993235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:22.993235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:22.993235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:22.993235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:22.993235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:22.993235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:22.993235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:22.994106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:22.994106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:22.994106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:22.994106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:22.994106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:26:22.994106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:26:22.994106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:26:22.994106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:26:22.994106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:26:22.994106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:26:22.994106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:26:22.994106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:22.996873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 474/937] 10.222.0.41 () {56 vars in 1120 bytes} [Fri May 27 09:26:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:23.002810 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5c2c0-e762-49ef-ac4e-bd8efdc6b975 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:23.017548 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a418241-b5e0-47df-8c31-de39a4dff91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:23.018827 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a418241-b5e0-47df-8c31-de39a4dff91f None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:23.019748 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a418241-b5e0-47df-8c31-de39a4dff91f None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:23.020375 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a418241-b5e0-47df-8c31-de39a4dff91f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:23.029588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a418241-b5e0-47df-8c31-de39a4dff91f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:23.031814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a418241-b5e0-47df-8c31-de39a4dff91f None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:23.052633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-9a418241-b5e0-47df-8c31-de39a4dff91f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:23.052633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:23.052633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:23.052633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:23.052633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:23.052633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:23.052633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:23.052633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:23.052633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:23.052633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:23.052633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:23.052633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:23.052633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:26:23.052633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:26:23.052633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:26:23.053544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:26:23.053544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:23.053544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:23.053544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:23.053544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:23.053544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:23.053544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:23.053544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:23.053544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:23.053544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:23.053544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:23.053544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:23.053544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:23.053544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:23.053544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:23.053544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:23.053544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:23.054431 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:26:23.054431 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:26:23.054431 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:26:23.054431 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:26:23.054431 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:26:23.054431 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:26:23.054431 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:23.054431 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:23.055658 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:23.057280 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 464/938] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:26:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:23.073140 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a418241-b5e0-47df-8c31-de39a4dff91f None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:23.133042 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:23.147949 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5c2c0-e762-49ef-ac4e-bd8efdc6b975 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:23.185062 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a418241-b5e0-47df-8c31-de39a4dff91f None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:23.195519 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c3b2a-37b2-4f98-bab2-054ff24998b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:23.196244 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c3b2a-37b2-4f98-bab2-054ff24998b5 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:23.196527 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c3b2a-37b2-4f98-bab2-054ff24998b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:23.196798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c3b2a-37b2-4f98-bab2-054ff24998b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:23.197540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c3b2a-37b2-4f98-bab2-054ff24998b5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:23.197844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c3b2a-37b2-4f98-bab2-054ff24998b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:23.199218 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c3b2a-37b2-4f98-bab2-054ff24998b5 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:23.211156 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 475/939] 10.222.0.41 () {56 vars in 1115 bytes} [Fri May 27 09:26:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:23.217445 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c3b2a-37b2-4f98-bab2-054ff24998b5 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:23.239688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06055ebb-8098-46f7-b196-d6d60d9b49aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:23.240697 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06055ebb-8098-46f7-b196-d6d60d9b49aa None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:23.240985 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06055ebb-8098-46f7-b196-d6d60d9b49aa None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:23.241260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06055ebb-8098-46f7-b196-d6d60d9b49aa None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:23.242071 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06055ebb-8098-46f7-b196-d6d60d9b49aa None admin] RBAC: Adding query filter params (name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:23.242383 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06055ebb-8098-46f7-b196-d6d60d9b49aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:23.243912 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06055ebb-8098-46f7-b196-d6d60d9b49aa None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:23.275349 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 465/940] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 09:26:23 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:23.340508 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c3b2a-37b2-4f98-bab2-054ff24998b5 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:23.343317 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:23.388739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15dd2ce-9785-4a79-9bc5-8e4bb59793c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:23.389564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dd2ce-9785-4a79-9bc5-8e4bb59793c7 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:23.389854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dd2ce-9785-4a79-9bc5-8e4bb59793c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:23.390138 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dd2ce-9785-4a79-9bc5-8e4bb59793c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:23.402608 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15dd2ce-9785-4a79-9bc5-8e4bb59793c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:23.404144 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15dd2ce-9785-4a79-9bc5-8e4bb59793c7 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:23.424063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-d15dd2ce-9785-4a79-9bc5-8e4bb59793c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:23.424063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:23.424063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:23.424063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:23.424063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:23.424063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:23.424063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:23.424063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:23.424063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:23.424063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:23.424063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:23.424063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:23.424063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:23.424063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:23.424063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:23.425001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:23.425001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:23.425001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:23.425001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:23.425001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:23.425001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:23.425001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:23.425001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:23.425001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:23.425001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:23.425001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:23.425001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:23.425001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:23.425001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:23.425001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:23.425001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:23.425001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:23.425869 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:23.425869 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:23.425869 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:23.425869 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:23.425869 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 476/941] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:23.432511 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06055ebb-8098-46f7-b196-d6d60d9b49aa None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:23.543183 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06055ebb-8098-46f7-b196-d6d60d9b49aa None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:23.559533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:23.582708 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df4532-408a-49d9-a11a-68fdb08d0a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:23.583395 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df4532-408a-49d9-a11a-68fdb08d0a43 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:23.583676 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df4532-408a-49d9-a11a-68fdb08d0a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:23.583944 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df4532-408a-49d9-a11a-68fdb08d0a43 None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:23.584656 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df4532-408a-49d9-a11a-68fdb08d0a43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:23.584956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df4532-408a-49d9-a11a-68fdb08d0a43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:23.586303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df4532-408a-49d9-a11a-68fdb08d0a43 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:23.599321 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 466/942] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:23.604436 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15dd2ce-9785-4a79-9bc5-8e4bb59793c7 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:23.713729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15dd2ce-9785-4a79-9bc5-8e4bb59793c7 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:23.753357 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bd7a6-b30a-4c0a-b9c4-163d9dcc3341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:23.754262 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bd7a6-b30a-4c0a-b9c4-163d9dcc3341 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:23.754871 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bd7a6-b30a-4c0a-b9c4-163d9dcc3341 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:23.754871 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bd7a6-b30a-4c0a-b9c4-163d9dcc3341 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:23.763183 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75bd7a6-b30a-4c0a-b9c4-163d9dcc3341 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:23.764730 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75bd7a6-b30a-4c0a-b9c4-163d9dcc3341 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:23.780579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-f75bd7a6-b30a-4c0a-b9c4-163d9dcc3341 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:26:23.780579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:23.780579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:23.780579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:23.780579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:23.780579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:23.780579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:23.780579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:23.780579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:23.780579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:23.780579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:23.780579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:23.780579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:26:23.780579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:26:23.780579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:26:23.780579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:26:23.781548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:23.781548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:23.781548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:26:23.781548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:23.781548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:26:23.781548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:23.781548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:23.781548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:23.781548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:23.781548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:23.781548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:23.781548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:23.781548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:23.781548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:23.781548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:23.781548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:23.781548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:23.781548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:23.784074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:23.784074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:23.784074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:26:23.784074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:26:23.784074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:26:23.784074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:26:23.784074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:26:23.784074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:26:23.784074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:26:23.784074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:23.784074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 477/943] 10.222.0.41 () {56 vars in 1117 bytes} [Fri May 27 09:26:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:23.788662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df4532-408a-49d9-a11a-68fdb08d0a43 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:23.890326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df4532-408a-49d9-a11a-68fdb08d0a43 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:23.926508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1e477-2aa6-4277-a3d9-fed7b7cb9609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:23.927662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1e477-2aa6-4277-a3d9-fed7b7cb9609 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:23.928150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1e477-2aa6-4277-a3d9-fed7b7cb9609 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:23.928625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1e477-2aa6-4277-a3d9-fed7b7cb9609 None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:23.929716 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1e477-2aa6-4277-a3d9-fed7b7cb9609 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:23.930226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1e477-2aa6-4277-a3d9-fed7b7cb9609 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:23.931959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1e477-2aa6-4277-a3d9-fed7b7cb9609 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:23.950722 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 467/944] 10.222.0.41 () {56 vars in 1149 bytes} [Fri May 27 09:26:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:23.959302 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bd7a6-b30a-4c0a-b9c4-163d9dcc3341 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:23.975974 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:24.068057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bd7a6-b30a-4c0a-b9c4-163d9dcc3341 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:24.103525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247134a-470a-4e85-8a8f-21c930f44286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:24.104325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247134a-470a-4e85-8a8f-21c930f44286 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:24.104608 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247134a-470a-4e85-8a8f-21c930f44286 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:24.104879 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247134a-470a-4e85-8a8f-21c930f44286 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:24.117504 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247134a-470a-4e85-8a8f-21c930f44286 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:24.118971 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247134a-470a-4e85-8a8f-21c930f44286 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:24.137403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-4247134a-470a-4e85-8a8f-21c930f44286 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:24.137403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:24.137403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:24.137403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:24.137403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:24.137403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:24.137403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:24.137403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:24.137403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:24.137403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:24.137403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:24.137403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:24.137403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:24.137403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:24.137403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:24.138320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:24.138320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:24.138320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:24.138320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:24.138320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:24.138320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:24.138320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:24.138320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:24.138320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:24.138320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:24.138320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:24.138320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:24.138320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:24.138320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:24.138320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:24.138320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:24.138320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:24.139662 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:24.139662 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:24.139662 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:24.139662 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:24.139662 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 478/945] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:24.145094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1e477-2aa6-4277-a3d9-fed7b7cb9609 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:24.177406 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:24.253332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1e477-2aa6-4277-a3d9-fed7b7cb9609 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:24.293663 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171c57e-53b0-49e1-babe-75cd40ed29ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:24.295185 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171c57e-53b0-49e1-babe-75cd40ed29ef None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:24.295699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171c57e-53b0-49e1-babe-75cd40ed29ef None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:24.296138 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171c57e-53b0-49e1-babe-75cd40ed29ef None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:24.297011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171c57e-53b0-49e1-babe-75cd40ed29ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:24.297511 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171c57e-53b0-49e1-babe-75cd40ed29ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:24.299180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171c57e-53b0-49e1-babe-75cd40ed29ef None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:24.312263 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 468/946] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:24.319962 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247134a-470a-4e85-8a8f-21c930f44286 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:24.388925 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:24.428243 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247134a-470a-4e85-8a8f-21c930f44286 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:24.466074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba879f6-c9c2-478a-bb0e-bb3b813f2344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:24.466897 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba879f6-c9c2-478a-bb0e-bb3b813f2344 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:24.467176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba879f6-c9c2-478a-bb0e-bb3b813f2344 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:24.467473 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba879f6-c9c2-478a-bb0e-bb3b813f2344 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:24.475747 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba879f6-c9c2-478a-bb0e-bb3b813f2344 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:24.477247 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba879f6-c9c2-478a-bb0e-bb3b813f2344 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:24.494280 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-bba879f6-c9c2-478a-bb0e-bb3b813f2344 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:24.494280 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:24.494280 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:24.494280 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:24.494280 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:24.494280 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:24.494280 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:24.494280 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:24.494280 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:24.494280 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:24.494280 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:24.494280 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:24.494280 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:26:24.494280 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:26:24.494280 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:26:24.495223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:26:24.495223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:24.495223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:24.495223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:24.495223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:24.495223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:24.495223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:24.495223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:24.495223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:24.495223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:24.495223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:24.495223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:24.495223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:24.495223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:24.495223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:24.495223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:24.495223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:24.496523 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:26:24.496523 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:26:24.496523 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:26:24.496523 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:26:24.496523 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:26:24.496523 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:26:24.496523 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:24.496523 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:24.496523 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 479/947] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:26:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:24.502415 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171c57e-53b0-49e1-babe-75cd40ed29ef None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:24.601426 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:24.613408 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171c57e-53b0-49e1-babe-75cd40ed29ef None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:24.620262 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6dcce-709c-4608-9e75-f4e026427bf2 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:24.620555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6dcce-709c-4608-9e75-f4e026427bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:24.620992 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6dcce-709c-4608-9e75-f4e026427bf2 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:24.622740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 480/948] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:24.628395 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc6b26-2e40-42ac-a760-af73afdc16b8 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:24.628771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc6b26-2e40-42ac-a760-af73afdc16b8 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:24.629147 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc6b26-2e40-42ac-a760-af73afdc16b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:24.647959 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-12dc6b26-2e40-42ac-a760-af73afdc16b8 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:24.649252 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-12dc6b26-2e40-42ac-a760-af73afdc16b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:24.653414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f91f1-1bd8-4136-9651-d0ebe123a6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:24.654283 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f91f1-1bd8-4136-9651-d0ebe123a6cf None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:24.654755 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f91f1-1bd8-4136-9651-d0ebe123a6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:24.655215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f91f1-1bd8-4136-9651-d0ebe123a6cf None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:24.656190 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f91f1-1bd8-4136-9651-d0ebe123a6cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:24.656673 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f91f1-1bd8-4136-9651-d0ebe123a6cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:24.659302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f91f1-1bd8-4136-9651-d0ebe123a6cf None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:24.673089 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 469/949] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:26:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:24.677999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e941cc9-f90c-411f-a930-9018d1f24869 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:24.678765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e941cc9-f90c-411f-a930-9018d1f24869 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:24.678992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e941cc9-f90c-411f-a930-9018d1f24869 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:24.680984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 470/950] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:26:24.682325 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e941cc9-f90c-411f-a930-9018d1f24869 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:24.721698 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 481/951] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:26:24.723487 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a594ae-8684-453e-9126-73b3cf0f9a71 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:24.723982 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a594ae-8684-453e-9126-73b3cf0f9a71 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:24.724259 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a594ae-8684-453e-9126-73b3cf0f9a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:24.740865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-d4a594ae-8684-453e-9126-73b3cf0f9a71 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:24.742134 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d4a594ae-8684-453e-9126-73b3cf0f9a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:24.798973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e941cc9-f90c-411f-a930-9018d1f24869 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:24.799635 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:24.827570 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 482/952] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:24.828254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a594ae-8684-453e-9126-73b3cf0f9a71 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:24.839831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61416e1a-1b77-43ff-98da-c6af17ea6078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:24.841308 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61416e1a-1b77-43ff-98da-c6af17ea6078 None admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:24.841999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61416e1a-1b77-43ff-98da-c6af17ea6078 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:24.842288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61416e1a-1b77-43ff-98da-c6af17ea6078 None admin] PATH_INFO: `/v3/projects/b1d802dc0211467fa4e709cd01d411dc/users/f52f0a03cc0f494d82a091bd885478e1/roles/582df05c56014989bfe8f0e5522d0633` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:24.845632 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61416e1a-1b77-43ff-98da-c6af17ea6078 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1d802dc0211467fa4e709cd01d411dc, user_id=f52f0a03cc0f494d82a091bd885478e1, role_id=582df05c56014989bfe8f0e5522d0633)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:24.847339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61416e1a-1b77-43ff-98da-c6af17ea6078 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:24.866748 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 471/953] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:26:24 2022] PUT /identity/v3/projects/b1d802dc0211467fa4e709cd01d411dc/users/f52f0a03cc0f494d82a091bd885478e1/roles/582df05c56014989bfe8f0e5522d0633 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:26:24.866748 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61416e1a-1b77-43ff-98da-c6af17ea6078 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:24.884693 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:24.958131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a594ae-8684-453e-9126-73b3cf0f9a71 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:25.000839 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e52f3e-d6fb-4276-8dcd-e8e05bafece5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:25.002759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e52f3e-d6fb-4276-8dcd-e8e05bafece5 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:25.003323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e52f3e-d6fb-4276-8dcd-e8e05bafece5 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:25.003799 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e52f3e-d6fb-4276-8dcd-e8e05bafece5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:25.004825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e52f3e-d6fb-4276-8dcd-e8e05bafece5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:25.006458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e52f3e-d6fb-4276-8dcd-e8e05bafece5 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:25.007804 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61416e1a-1b77-43ff-98da-c6af17ea6078 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:25.021739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-b8e52f3e-d6fb-4276-8dcd-e8e05bafece5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:26:25.021739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:25.021739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:26:25.021739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:26:25.021739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:26:25.021739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:26:25.021739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:26:25.021739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:25.021739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:26:25.021739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:25.021739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:25.021739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:25.021739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:25.021739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:25.021739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:25.021739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:25.021739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:25.022913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:25.022913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:25.022913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:25.022913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:25.022913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:25.022913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:25.022913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:26:25.022913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:26:25.022913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:26:25.022913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:26:25.022913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:25.022913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:25.022913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:25.022913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:25.022913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:25.022913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:25.023827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:25.023827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:25.023827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:25.023827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:25.023827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:25.023827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:25.023827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:25.023827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:25.023827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:25.023827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:25.023827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:26:25.023827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:25.023827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:26:25.023827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:25.037553 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 483/954] 10.222.0.41 () {56 vars in 1126 bytes} [Fri May 27 09:26:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:25.038896 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e52f3e-d6fb-4276-8dcd-e8e05bafece5 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:25.047488 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7a074-6717-4fb6-9a51-0a9b865b24af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:25.048297 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7a074-6717-4fb6-9a51-0a9b865b24af None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:25.048612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7a074-6717-4fb6-9a51-0a9b865b24af None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:25.048884 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7a074-6717-4fb6-9a51-0a9b865b24af None admin] PATH_INFO: `/v3/services/compute` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:25.049534 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7a074-6717-4fb6-9a51-0a9b865b24af None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:25.051025 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7a074-6717-4fb6-9a51-0a9b865b24af None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:25.070074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-41a7a074-6717-4fb6-9a51-0a9b865b24af None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:26:25.070074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:25.070074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:26:25.070074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:26:25.070074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:26:25.070074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:26:25.070074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:26:25.070074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:25.070074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:26:25.070074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:25.070074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:25.070074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:25.070074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:25.070074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:25.070074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:25.070074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:25.070074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:25.071384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:25.071384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:25.071384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:25.071384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:25.071384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:25.071384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:25.071384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:26:25.071384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:26:25.071384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:26:25.071384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:26:25.071384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:25.071384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:25.071384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:25.071384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:25.071384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:25.071384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:25.072261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:25.072261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:25.072261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:25.072261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:25.072261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:25.072261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:25.072261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:25.072261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:25.072261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:25.072261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:25.072261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:26:25.072261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:25.072261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:26:25.072261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:25.072261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 472/955] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:26:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:25.080445 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7a074-6717-4fb6-9a51-0a9b865b24af None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:25.111260 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:25.169443 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:25.172262 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e52f3e-d6fb-4276-8dcd-e8e05bafece5 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:25.198735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7a074-6717-4fb6-9a51-0a9b865b24af None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:25.210308 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd9e96-bd94-453b-9635-cabe0fe72995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:25.210911 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd9e96-bd94-453b-9635-cabe0fe72995 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:25.211251 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd9e96-bd94-453b-9635-cabe0fe72995 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:25.212542 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd9e96-bd94-453b-9635-cabe0fe72995 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:25.212542 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd9e96-bd94-453b-9635-cabe0fe72995 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:25.212732 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd9e96-bd94-453b-9635-cabe0fe72995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:25.214113 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd9e96-bd94-453b-9635-cabe0fe72995 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:25.219201 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 484/956] 10.222.0.41 () {56 vars in 1122 bytes} [Fri May 27 09:26:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:25.224971 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd9e96-bd94-453b-9635-cabe0fe72995 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:25.236609 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bf942-c870-4cd0-aa72-7751fa1b6b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:25.237281 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bf942-c870-4cd0-aa72-7751fa1b6b2c None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:25.237562 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bf942-c870-4cd0-aa72-7751fa1b6b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:25.237842 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bf942-c870-4cd0-aa72-7751fa1b6b2c None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:25.238534 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bf942-c870-4cd0-aa72-7751fa1b6b2c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:25.238937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bf942-c870-4cd0-aa72-7751fa1b6b2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:25.240463 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bf942-c870-4cd0-aa72-7751fa1b6b2c None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:25.246269 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 473/957] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 09:26:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:25.253653 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bf942-c870-4cd0-aa72-7751fa1b6b2c None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:25.340489 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd9e96-bd94-453b-9635-cabe0fe72995 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:25.358458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:25.378747 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bf942-c870-4cd0-aa72-7751fa1b6b2c None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:25.379899 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ab96a-b6a7-4099-b8f7-ba555506fa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:25.380900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ab96a-b6a7-4099-b8f7-ba555506fa3e None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:25.381605 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ab96a-b6a7-4099-b8f7-ba555506fa3e None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:25.382092 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ab96a-b6a7-4099-b8f7-ba555506fa3e None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:25.382991 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ab96a-b6a7-4099-b8f7-ba555506fa3e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:25.383521 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ab96a-b6a7-4099-b8f7-ba555506fa3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:25.385122 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ab96a-b6a7-4099-b8f7-ba555506fa3e None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:25.395833 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 485/958] 10.222.0.41 () {56 vars in 1122 bytes} [Fri May 27 09:26:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:25.397550 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ab96a-b6a7-4099-b8f7-ba555506fa3e None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:25.416429 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61cf5c-c6cc-4fa0-8b4d-cdf77ad58e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:25.417099 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61cf5c-c6cc-4fa0-8b4d-cdf77ad58e0c None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:25.417382 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61cf5c-c6cc-4fa0-8b4d-cdf77ad58e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:25.417657 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61cf5c-c6cc-4fa0-8b4d-cdf77ad58e0c None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:25.418358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61cf5c-c6cc-4fa0-8b4d-cdf77ad58e0c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:25.418766 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61cf5c-c6cc-4fa0-8b4d-cdf77ad58e0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:25.420273 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61cf5c-c6cc-4fa0-8b4d-cdf77ad58e0c None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:25.431301 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 474/959] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 09:26:25 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:25.517061 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ab96a-b6a7-4099-b8f7-ba555506fa3e None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:25.562693 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecb626-42c0-420c-862a-8d70dae72947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:25.563444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecb626-42c0-420c-862a-8d70dae72947 None admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:25.563733 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecb626-42c0-420c-862a-8d70dae72947 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:25.564074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecb626-42c0-420c-862a-8d70dae72947 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:25.565355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ecb626-42c0-420c-862a-8d70dae72947 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:25.566810 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ecb626-42c0-420c-862a-8d70dae72947 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:25.591351 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 486/960] 10.222.0.41 () {60 vars in 1144 bytes} [Fri May 27 09:26:25 2022] POST /identity/v3/endpoints => generated 349 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:26:25.761237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f7c8a-65ef-4aac-943d-d5f1f7047d6d None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:25.761754 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f7c8a-65ef-4aac-943d-d5f1f7047d6d None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:25.761862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f7c8a-65ef-4aac-943d-d5f1f7047d6d None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:25.763623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 475/961] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:25.769769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955e4c3-59c7-446b-a3a0-73ce80e1ba3d None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:25.770029 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955e4c3-59c7-446b-a3a0-73ce80e1ba3d None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:25.770262 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955e4c3-59c7-446b-a3a0-73ce80e1ba3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:25.789965 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-a955e4c3-59c7-446b-a3a0-73ce80e1ba3d None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:25.791161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-a955e4c3-59c7-446b-a3a0-73ce80e1ba3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:25.822761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:25.873822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 487/962] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:25.898121 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f7c8a-65ef-4aac-943d-d5f1f7047d6d None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:25.901066 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:26.010760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f7c8a-65ef-4aac-943d-d5f1f7047d6d None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:26.057430 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3641269-49c0-4014-9cb2-1b702d51caa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:26.058022 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3641269-49c0-4014-9cb2-1b702d51caa8 None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:26.058307 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3641269-49c0-4014-9cb2-1b702d51caa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:26.058581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3641269-49c0-4014-9cb2-1b702d51caa8 None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:26.059295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3641269-49c0-4014-9cb2-1b702d51caa8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:26.065994 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3641269-49c0-4014-9cb2-1b702d51caa8 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:26.080903 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.sql.core [None req-a3641269-49c0-4014-9cb2-1b702d51caa8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 09:26:26.080903 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 27 09:26:26.080903 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [parameters: {'user_id': 'c18d1ad4b965477c8ce6a95d4ea82be6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 27 09:26:26.080903 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80091) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 09:26:26.089239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-a3641269-49c0-4014-9cb2-1b702d51caa8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 27 09:26:26.089239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:26.089239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 09:26:26.089239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 09:26:26.089239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 09:26:26.089239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 09:26:26.089239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 09:26:26.089239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application result = self._query(query) May 27 09:26:26.089239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 09:26:26.089239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application conn.query(q) May 27 09:26:26.089239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 09:26:26.089239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 09:26:26.089239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 09:26:26.089239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application result.read() May 27 09:26:26.089239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 09:26:26.090215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 09:26:26.090215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 09:26:26.090215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 09:26:26.090215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 09:26:26.090215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 09:26:26.090215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 09:26:26.090215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 09:26:26.090215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 09:26:26.090215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:26.090215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 09:26:26.090215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:26.090215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:26.090215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 09:26:26.090215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 09:26:26.090215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 27 09:26:26.090215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 27 09:26:26.090215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 09:26:26.090215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application next(self.gen) May 27 09:26:26.091260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 09:26:26.091260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application yield resource May 27 09:26:26.091260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 09:26:26.091260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application next(self.gen) May 27 09:26:26.091260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 09:26:26.091260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self.session.rollback() May 27 09:26:26.091260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 09:26:26.091260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self.force_reraise() May 27 09:26:26.091260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 09:26:26.091260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise self.value May 27 09:26:26.091260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 09:26:26.091260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 09:26:26.091260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 09:26:26.091260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application session.commit() May 27 09:26:26.091260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 09:26:26.091260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 09:26:26.091260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 09:26:26.092197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._prepare_impl() May 27 09:26:26.092197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 09:26:26.092197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self.session.flush() May 27 09:26:26.092197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 09:26:26.092197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._flush(objects) May 27 09:26:26.092197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 09:26:26.092197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 09:26:26.092197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 09:26:26.092197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application compat.raise_( May 27 09:26:26.092197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 09:26:26.092197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception May 27 09:26:26.092197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 09:26:26.092197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application flush_context.execute() May 27 09:26:26.092197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 09:26:26.092197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rec.execute(self) May 27 09:26:26.092197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 09:26:26.092197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 09:26:26.093125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 09:26:26.093125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 09:26:26.093125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 27 09:26:26.093125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application result = connection._execute_20( May 27 09:26:26.093125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 09:26:26.093125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 09:26:26.093125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 09:26:26.093125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 09:26:26.093125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 09:26:26.093125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 09:26:26.093125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 09:26:26.093125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 09:26:26.093125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 09:26:26.093125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 09:26:26.093125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 09:26:26.093125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception May 27 09:26:26.093963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 09:26:26.093963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 09:26:26.093963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 09:26:26.093963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 09:26:26.093963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 09:26:26.093963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application result = self._query(query) May 27 09:26:26.093963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 09:26:26.093963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application conn.query(q) May 27 09:26:26.093963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 09:26:26.093963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 09:26:26.093963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 09:26:26.093963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application result.read() May 27 09:26:26.093963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 09:26:26.093963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 09:26:26.093963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 09:26:26.093963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 09:26:26.094864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 09:26:26.094864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 09:26:26.094864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 09:26:26.094864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 09:26:26.094864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 09:26:26.094864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 27 09:26:26.094864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c18d1ad4b965477c8ce6a95d4ea82be6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 27 09:26:26.094864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 09:26:26.094864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:26.094864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:26.094864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:26.094864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:26.094864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:26.094864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:26.094864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:26.097571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:26.097571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:26.097571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:26.097571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:26.097571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:26.097571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:26.097571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:26.097571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 27 09:26:26.097571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 27 09:26:26.097571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:26.097571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:26.097571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:26:26.097571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:26.097571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:26:26.097571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:26.097571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 27 09:26:26.097571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 27 09:26:26.098690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 27 09:26:26.098690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 27 09:26:26.098690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 09:26:26.098690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 09:26:26.098690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 27 09:26:26.098690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:26.098690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 476/963] 10.222.0.41 () {60 vars in 1131 bytes} [Fri May 27 09:26:25 2022] POST /identity/v3/users => generated 160 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:26.102375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955e4c3-59c7-446b-a3a0-73ce80e1ba3d None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:26.209019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955e4c3-59c7-446b-a3a0-73ce80e1ba3d None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:26.245442 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccf35b-770a-47b5-b24a-2ddc734f1ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:26.246681 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccf35b-770a-47b5-b24a-2ddc734f1ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:26.247163 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccf35b-770a-47b5-b24a-2ddc734f1ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:26.247715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccf35b-770a-47b5-b24a-2ddc734f1ae5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:26.255437 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccf35b-770a-47b5-b24a-2ddc734f1ae5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:26.257094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccf35b-770a-47b5-b24a-2ddc734f1ae5 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:26.272463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-e8ccf35b-770a-47b5-b24a-2ddc734f1ae5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 09:26:26.272463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:26.272463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:26.272463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:26.272463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:26.272463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:26.272463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:26.272463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:26.272463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:26.272463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:26.272463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:26.272463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:26.272463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:26:26.272463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:26:26.272463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:26:26.272463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:26:26.273490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:26.273490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:26.273490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:26:26.273490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:26.273490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:26:26.273490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:26.273490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:26.273490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:26.273490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:26.273490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:26.273490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:26.273490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:26.273490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:26.273490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:26.273490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:26.273490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:26.273490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:26.273490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:26.274420 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:26.274420 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:26.274420 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:26:26.274420 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:26:26.274420 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:26:26.274420 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:26:26.274420 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:26:26.274420 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:26:26.274420 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 09:26:26.274420 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:26.277098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 488/964] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:26:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:26.283591 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3641269-49c0-4014-9cb2-1b702d51caa8 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:26.350882 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:26.401161 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3641269-49c0-4014-9cb2-1b702d51caa8 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:26.435386 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e713908-5e3d-456b-826c-33b3c9e0c4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:26.436058 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e713908-5e3d-456b-826c-33b3c9e0c4fc None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:26.436343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e713908-5e3d-456b-826c-33b3c9e0c4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:26.436628 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e713908-5e3d-456b-826c-33b3c9e0c4fc None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:26.437410 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e713908-5e3d-456b-826c-33b3c9e0c4fc None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:26.437715 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e713908-5e3d-456b-826c-33b3c9e0c4fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:26.439977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e713908-5e3d-456b-826c-33b3c9e0c4fc None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:26.483406 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 477/965] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 09:26:26 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:27.201750 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ffc89-5d49-48bc-9fb3-737bab1ce263 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:27.202289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ffc89-5d49-48bc-9fb3-737bab1ce263 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:27.202289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ffc89-5d49-48bc-9fb3-737bab1ce263 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:27.203886 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 489/966] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:27.208933 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77356185-6fc8-44c7-97b5-96949797bb04 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:27.209312 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77356185-6fc8-44c7-97b5-96949797bb04 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:27.209502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77356185-6fc8-44c7-97b5-96949797bb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:27.228666 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-77356185-6fc8-44c7-97b5-96949797bb04 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:27.230188 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-77356185-6fc8-44c7-97b5-96949797bb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:27.300965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 478/967] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:27.323940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ffc89-5d49-48bc-9fb3-737bab1ce263 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:27.349048 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:27.436708 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ffc89-5d49-48bc-9fb3-737bab1ce263 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:27.471673 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d36439-e64d-4f69-b339-309345d94a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:27.472498 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d36439-e64d-4f69-b339-309345d94a64 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:27.472785 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d36439-e64d-4f69-b339-309345d94a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:27.473063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d36439-e64d-4f69-b339-309345d94a64 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:27.483211 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d36439-e64d-4f69-b339-309345d94a64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:26:27.491775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-a1d36439-e64d-4f69-b339-309345d94a64 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:26:27.491775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:27.491775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:27.491775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:27.491775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:27.491775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:27.491775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:27.491775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:27.491775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:27.491775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:27.491775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:27.491775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:27.491775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:26:27.491775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:26:27.491775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:26:27.491775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:26:27.492704 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:26:27.492704 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:26:27.492704 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:26:27.492704 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:26:27.492704 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:27.492704 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:27.492704 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:27.492704 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:27.492704 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:27.492704 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:27.492704 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:27.492704 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:27.492704 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:27.492704 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:27.492704 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:27.492704 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:27.493539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:27.493539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:27.493539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:27.493539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:27.493539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:26:27.493539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:26:27.493539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:26:27.493539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:26:27.493539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:26:27.493539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:26:27.493539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:26:27.493539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:27.495622 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 490/968] 10.222.0.41 () {56 vars in 1120 bytes} [Fri May 27 09:26:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:27.498730 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77356185-6fc8-44c7-97b5-96949797bb04 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:27.556519 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:27.606289 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77356185-6fc8-44c7-97b5-96949797bb04 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:27.640330 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c50add-25d6-451c-879d-53a7d50e55b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:27.641003 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c50add-25d6-451c-879d-53a7d50e55b2 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:27.641289 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c50add-25d6-451c-879d-53a7d50e55b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:27.641566 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c50add-25d6-451c-879d-53a7d50e55b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:27.642886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c50add-25d6-451c-879d-53a7d50e55b2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:27.643198 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c50add-25d6-451c-879d-53a7d50e55b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:27.644668 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c50add-25d6-451c-879d-53a7d50e55b2 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:27.657422 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 479/969] 10.222.0.41 () {56 vars in 1115 bytes} [Fri May 27 09:26:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:27.659657 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d36439-e64d-4f69-b339-309345d94a64 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:27.724377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e41795-80b4-40e1-bfd5-a4ad1f3d7711 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:27.724674 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e41795-80b4-40e1-bfd5-a4ad1f3d7711 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:27.724956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e41795-80b4-40e1-bfd5-a4ad1f3d7711 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:27.726592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 480/970] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:26:27.731391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a941fb-fa4d-4a6d-ae19-c7d204fd143f None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:27.731682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a941fb-fa4d-4a6d-ae19-c7d204fd143f None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:27.731969 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a941fb-fa4d-4a6d-ae19-c7d204fd143f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:27.748954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-e7a941fb-fa4d-4a6d-ae19-c7d204fd143f None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:27.750276 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e7a941fb-fa4d-4a6d-ae19-c7d204fd143f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:27.754505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:27.774826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d36439-e64d-4f69-b339-309345d94a64 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:27.812463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a90d9-3d77-411e-b5b9-0c029112a1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:27.813265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a90d9-3d77-411e-b5b9-0c029112a1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:27.813549 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a90d9-3d77-411e-b5b9-0c029112a1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:27.813826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a90d9-3d77-411e-b5b9-0c029112a1c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:27.825418 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a90d9-3d77-411e-b5b9-0c029112a1c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:27.826874 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a90d9-3d77-411e-b5b9-0c029112a1c5 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:27.831345 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 481/971] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:26:27.847936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-399a90d9-3d77-411e-b5b9-0c029112a1c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:27.847936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:27.847936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:27.847936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:27.847936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:27.847936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:27.847936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:27.847936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:27.847936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:27.847936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:27.847936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:27.847936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:27.847936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:27.847936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:27.847936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:27.848815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:27.848815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:27.848815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:27.848815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:27.848815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:27.848815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:27.848815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:27.848815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:27.848815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:27.848815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:27.848815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:27.848815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:27.848815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:27.848815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:27.848815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:27.848815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:27.848815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:27.854336 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:27.854336 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:27.854336 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:27.854336 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:27.854336 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 491/972] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:27.854629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a941fb-fa4d-4a6d-ae19-c7d204fd143f None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:27.856050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a90d9-3d77-411e-b5b9-0c029112a1c5 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:27.902604 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:27.961075 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a941fb-fa4d-4a6d-ae19-c7d204fd143f None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:27.961690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a90d9-3d77-411e-b5b9-0c029112a1c5 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:27.995376 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba850d-c579-47b9-a559-c2d658b406eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:27.995677 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260206af-3c1e-4db3-8fec-57c8676309c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:27.996044 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba850d-c579-47b9-a559-c2d658b406eb None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:27.996325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260206af-3c1e-4db3-8fec-57c8676309c7 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:27.996425 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba850d-c579-47b9-a559-c2d658b406eb None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:27.996602 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba850d-c579-47b9-a559-c2d658b406eb None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:27.996695 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260206af-3c1e-4db3-8fec-57c8676309c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:27.996870 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260206af-3c1e-4db3-8fec-57c8676309c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:27.997328 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba850d-c579-47b9-a559-c2d658b406eb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:27.997592 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260206af-3c1e-4db3-8fec-57c8676309c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:27.997899 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260206af-3c1e-4db3-8fec-57c8676309c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:27.998700 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba850d-c579-47b9-a559-c2d658b406eb None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:27.999260 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260206af-3c1e-4db3-8fec-57c8676309c7 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:28.000778 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:28.013470 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 492/973] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:28.024838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 482/974] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 09:26:27 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:26:28.025143 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9954fe-430f-4bc3-95c6-6d066afafe74 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:28.025143 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9954fe-430f-4bc3-95c6-6d066afafe74 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:28.025143 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9954fe-430f-4bc3-95c6-6d066afafe74 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:28.025411 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba850d-c579-47b9-a559-c2d658b406eb None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:28.025498 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 493/975] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:28.026050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be23d3-6c23-4d4b-a23c-d106f0726f95 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:28.026340 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be23d3-6c23-4d4b-a23c-d106f0726f95 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:28.026614 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be23d3-6c23-4d4b-a23c-d106f0726f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:28.050660 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-c0be23d3-6c23-4d4b-a23c-d106f0726f95 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:28.051939 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-c0be23d3-6c23-4d4b-a23c-d106f0726f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:28.151304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 494/976] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:26:28.152666 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba850d-c579-47b9-a559-c2d658b406eb None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:28.156175 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:28.165998 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be23d3-6c23-4d4b-a23c-d106f0726f95 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:28.194942 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc700a-1534-4735-a57a-f161457fef45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:28.195809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc700a-1534-4735-a57a-f161457fef45 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:28.196075 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc700a-1534-4735-a57a-f161457fef45 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:28.196547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc700a-1534-4735-a57a-f161457fef45 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:28.206401 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc700a-1534-4735-a57a-f161457fef45 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:28.207909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc700a-1534-4735-a57a-f161457fef45 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:28.223314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-c8fc700a-1534-4735-a57a-f161457fef45 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:26:28.223314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:28.223314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:28.223314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:28.223314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:28.223314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:28.223314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:28.223314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:28.223314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:28.223314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:28.223314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:28.223314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:28.223314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:26:28.223314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:26:28.223314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:26:28.223314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:26:28.224771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:28.224771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:28.224771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:26:28.224771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:28.224771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:26:28.224771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:28.224771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:28.224771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:28.224771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:28.224771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:28.224771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:28.224771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:28.224771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:28.224771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:28.224771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:28.224771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:28.224771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:28.224771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:28.225778 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:28.225778 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:28.225778 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:26:28.225778 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:26:28.225778 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:26:28.225778 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:26:28.225778 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:26:28.225778 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:26:28.225778 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 09:26:28.225778 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:28.229421 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 483/977] 10.222.0.41 () {56 vars in 1117 bytes} [Fri May 27 09:26:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:28.230474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc700a-1534-4735-a57a-f161457fef45 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:28.275783 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be23d3-6c23-4d4b-a23c-d106f0726f95 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:28.297019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:28.312048 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb5c4c-c270-4376-9267-0666e15984ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:28.312871 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb5c4c-c270-4376-9267-0666e15984ee None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:28.313156 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb5c4c-c270-4376-9267-0666e15984ee None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:28.313433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb5c4c-c270-4376-9267-0666e15984ee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:28.314122 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb5c4c-c270-4376-9267-0666e15984ee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:28.315540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb5c4c-c270-4376-9267-0666e15984ee None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:28.327729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-f3fb5c4c-c270-4376-9267-0666e15984ee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:26:28.327729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:28.327729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:26:28.327729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:26:28.327729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:26:28.327729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:26:28.327729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:26:28.327729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:28.327729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:26:28.327729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:28.327729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:28.327729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:28.327729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:28.327729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:28.327729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:28.327729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:28.327729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:28.328915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:28.328915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:28.328915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:28.328915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:28.328915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:28.328915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:28.328915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:26:28.328915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:26:28.328915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:26:28.328915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:26:28.328915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:28.328915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:28.328915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:28.328915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:28.328915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:28.328915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:28.330316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:28.330316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:28.330316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:28.330316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:28.330316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:28.330316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:28.330316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:28.330316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:28.330316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:28.330316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:28.330316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:26:28.330316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:28.330316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:26:28.330316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:28.330316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 495/978] 10.222.0.41 () {56 vars in 1126 bytes} [Fri May 27 09:26:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:28.335403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb5c4c-c270-4376-9267-0666e15984ee None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:28.338747 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc700a-1534-4735-a57a-f161457fef45 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:28.373638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea6810-98be-4de4-8b85-1db965d79822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:28.374328 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea6810-98be-4de4-8b85-1db965d79822 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:28.374613 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea6810-98be-4de4-8b85-1db965d79822 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:28.374889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea6810-98be-4de4-8b85-1db965d79822 None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:28.375777 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea6810-98be-4de4-8b85-1db965d79822 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:28.376088 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea6810-98be-4de4-8b85-1db965d79822 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:28.378758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea6810-98be-4de4-8b85-1db965d79822 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:28.404022 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 484/979] 10.222.0.41 () {56 vars in 1149 bytes} [Fri May 27 09:26:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:28.412423 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea6810-98be-4de4-8b85-1db965d79822 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:28.438367 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:28.462207 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb5c4c-c270-4376-9267-0666e15984ee None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:28.498749 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5faa4-60a1-4b1f-a9bb-4e3e05ec6e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:28.499457 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5faa4-60a1-4b1f-a9bb-4e3e05ec6e55 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:28.499762 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5faa4-60a1-4b1f-a9bb-4e3e05ec6e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:28.500023 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5faa4-60a1-4b1f-a9bb-4e3e05ec6e55 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:28.500746 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5faa4-60a1-4b1f-a9bb-4e3e05ec6e55 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:28.501057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5faa4-60a1-4b1f-a9bb-4e3e05ec6e55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:28.502487 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5faa4-60a1-4b1f-a9bb-4e3e05ec6e55 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:28.507366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 496/980] 10.222.0.41 () {56 vars in 1122 bytes} [Fri May 27 09:26:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:28.512999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5faa4-60a1-4b1f-a9bb-4e3e05ec6e55 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:28.536632 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea6810-98be-4de4-8b85-1db965d79822 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:28.570683 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:28.578747 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decaf6f-b091-4c66-be66-486391328cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:28.579430 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decaf6f-b091-4c66-be66-486391328cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:28.580295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decaf6f-b091-4c66-be66-486391328cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:28.580742 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decaf6f-b091-4c66-be66-486391328cd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:28.629916 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5faa4-60a1-4b1f-a9bb-4e3e05ec6e55 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:28.665216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f17e25-2196-40cb-a91d-86a6d035236b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:28.665771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decaf6f-b091-4c66-be66-486391328cd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:28.665881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f17e25-2196-40cb-a91d-86a6d035236b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:28.666073 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f17e25-2196-40cb-a91d-86a6d035236b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:28.666348 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f17e25-2196-40cb-a91d-86a6d035236b None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:28.667040 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f17e25-2196-40cb-a91d-86a6d035236b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:28.667209 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decaf6f-b091-4c66-be66-486391328cd0 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:28.667386 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f17e25-2196-40cb-a91d-86a6d035236b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:28.668724 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f17e25-2196-40cb-a91d-86a6d035236b None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:28.673777 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 497/981] 10.222.0.41 () {56 vars in 1122 bytes} [Fri May 27 09:26:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:28.679599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f17e25-2196-40cb-a91d-86a6d035236b None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:28.693476 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:28.777751 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 485/982] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:26:28 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 09:26:28.782982 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decaf6f-b091-4c66-be66-486391328cd0 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:28.787239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f17e25-2196-40cb-a91d-86a6d035236b None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:28.800255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:28.825556 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23b7c0-fa0c-4626-907a-76dca8219c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:28.826226 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23b7c0-fa0c-4626-907a-76dca8219c9c None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:28.826514 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23b7c0-fa0c-4626-907a-76dca8219c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:28.826794 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23b7c0-fa0c-4626-907a-76dca8219c9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:28.827626 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23b7c0-fa0c-4626-907a-76dca8219c9c None admin] RBAC: Adding query filter params (interface=admin, service_id=f4b5627a5ae148d5ba5ec24ab0472dce, region_id=RegionOne) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:28.827951 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23b7c0-fa0c-4626-907a-76dca8219c9c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:28.829375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23b7c0-fa0c-4626-907a-76dca8219c9c None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:28.835408 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 498/983] 10.222.0.41 () {56 vars in 1249 bytes} [Fri May 27 09:26:28 2022] GET /identity/v3/endpoints?service_id=f4b5627a5ae148d5ba5ec24ab0472dce&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:28.841161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23b7c0-fa0c-4626-907a-76dca8219c9c None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:28.889236 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decaf6f-b091-4c66-be66-486391328cd0 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:28.915410 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:28.929832 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c58e7-854d-4d06-bd43-cc839654b224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:28.930865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c58e7-854d-4d06-bd43-cc839654b224 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:28.930977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c58e7-854d-4d06-bd43-cc839654b224 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:28.931170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c58e7-854d-4d06-bd43-cc839654b224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:28.942239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c58e7-854d-4d06-bd43-cc839654b224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:28.943684 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c58e7-854d-4d06-bd43-cc839654b224 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:28.949877 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23b7c0-fa0c-4626-907a-76dca8219c9c None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:28.962112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-346c58e7-854d-4d06-bd43-cc839654b224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:28.962112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:28.962112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:28.962112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:28.962112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:28.962112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:28.962112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:28.962112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:28.962112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:28.962112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:28.962112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:28.962112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:28.962112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:28.962112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:28.962112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:28.963024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:28.963024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:28.963024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:28.963024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:28.963024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:28.963024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:28.963024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:28.963024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:28.963024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:28.963024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:28.963024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:28.963024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:28.963024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:28.963024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:28.963024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:28.963024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:28.963024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:28.964097 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:28.964097 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:28.964097 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:28.964097 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:28.964097 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 486/984] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:28.968939 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c58e7-854d-4d06-bd43-cc839654b224 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:28.987761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358e797-e2ae-49a5-8fa8-13b1faddbf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:28.988420 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358e797-e2ae-49a5-8fa8-13b1faddbf4b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:28.988703 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358e797-e2ae-49a5-8fa8-13b1faddbf4b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:28.988976 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358e797-e2ae-49a5-8fa8-13b1faddbf4b None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:28.989642 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358e797-e2ae-49a5-8fa8-13b1faddbf4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:28.990999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358e797-e2ae-49a5-8fa8-13b1faddbf4b None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:29.007308 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 499/985] 10.222.0.41 () {56 vars in 1087 bytes} [Fri May 27 09:26:28 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:26:29.096941 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c58e7-854d-4d06-bd43-cc839654b224 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:29.134534 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e9a81-a599-4b29-8d51-b0676022d287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:29.135220 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e9a81-a599-4b29-8d51-b0676022d287 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:29.135535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e9a81-a599-4b29-8d51-b0676022d287 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:29.135951 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e9a81-a599-4b29-8d51-b0676022d287 None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:29.136699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e9a81-a599-4b29-8d51-b0676022d287 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:29.137009 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e9a81-a599-4b29-8d51-b0676022d287 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:29.138413 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e9a81-a599-4b29-8d51-b0676022d287 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:29.155461 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 487/986] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:29.157103 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358e797-e2ae-49a5-8fa8-13b1faddbf4b None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:29.206453 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:29.268454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358e797-e2ae-49a5-8fa8-13b1faddbf4b None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:29.302991 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81175bc5-5be3-46bc-b4ec-39bb59cc09cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:29.303822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81175bc5-5be3-46bc-b4ec-39bb59cc09cd None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:29.304109 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81175bc5-5be3-46bc-b4ec-39bb59cc09cd None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:29.304387 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81175bc5-5be3-46bc-b4ec-39bb59cc09cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:29.311236 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81175bc5-5be3-46bc-b4ec-39bb59cc09cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:29.312715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81175bc5-5be3-46bc-b4ec-39bb59cc09cd None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:29.327548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-81175bc5-5be3-46bc-b4ec-39bb59cc09cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:29.327548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:29.327548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:29.327548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:29.327548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:29.327548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:29.327548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:29.327548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:29.327548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:29.327548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:29.327548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:29.327548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:29.327548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:26:29.327548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:26:29.327548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:26:29.328411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:26:29.328411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:29.328411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:29.328411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:29.328411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:29.328411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:29.328411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:29.328411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:29.328411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:29.328411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:29.328411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:29.328411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:29.328411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:29.328411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:29.328411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:29.328411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:29.328411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:29.329472 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:26:29.329472 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:26:29.329472 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:26:29.329472 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:26:29.329472 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:26:29.329472 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:26:29.329472 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:29.329472 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:29.329472 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 500/987] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:26:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:29.334362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e9a81-a599-4b29-8d51-b0676022d287 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:29.374971 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:29.441986 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e9a81-a599-4b29-8d51-b0676022d287 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:29.474972 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da3318-950e-42ef-9a80-84aeb3504c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:29.475858 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da3318-950e-42ef-9a80-84aeb3504c58 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:29.476309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da3318-950e-42ef-9a80-84aeb3504c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:29.476728 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da3318-950e-42ef-9a80-84aeb3504c58 None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:29.477690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da3318-950e-42ef-9a80-84aeb3504c58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:29.478143 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da3318-950e-42ef-9a80-84aeb3504c58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:29.479832 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da3318-950e-42ef-9a80-84aeb3504c58 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:29.505973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 488/988] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:26:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:29.507179 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81175bc5-5be3-46bc-b4ec-39bb59cc09cd None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:29.605794 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:29.609682 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81175bc5-5be3-46bc-b4ec-39bb59cc09cd None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:29.643843 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318ddcc-b468-4e85-b124-316b0728ab65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:29.644505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318ddcc-b468-4e85-b124-316b0728ab65 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:29.644791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318ddcc-b468-4e85-b124-316b0728ab65 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:29.645070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318ddcc-b468-4e85-b124-316b0728ab65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:29.645903 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318ddcc-b468-4e85-b124-316b0728ab65 None admin] RBAC: Adding query filter params (role.id=582df05c56014989bfe8f0e5522d0633, scope.project.id=b1d802dc0211467fa4e709cd01d411dc, user.id=f52f0a03cc0f494d82a091bd885478e1) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:29.646224 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318ddcc-b468-4e85-b124-316b0728ab65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:29.647693 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318ddcc-b468-4e85-b124-316b0728ab65 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:29.659503 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 501/989] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:26:29 2022] GET /identity/v3/role_assignments?user.id=f52f0a03cc0f494d82a091bd885478e1&scope.project.id=b1d802dc0211467fa4e709cd01d411dc&role.id=582df05c56014989bfe8f0e5522d0633 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:30.265027 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e467c0e-bf87-413b-b75d-2dc4f9a7e254 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:30.265368 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e467c0e-bf87-413b-b75d-2dc4f9a7e254 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:30.265584 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e467c0e-bf87-413b-b75d-2dc4f9a7e254 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:30.267812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 489/990] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:30.273061 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e60de4-d128-4019-9c38-0aed36bd2e51 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:30.273352 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e60de4-d128-4019-9c38-0aed36bd2e51 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:30.273631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e60de4-d128-4019-9c38-0aed36bd2e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:30.290201 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-96e60de4-d128-4019-9c38-0aed36bd2e51 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:30.291405 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-96e60de4-d128-4019-9c38-0aed36bd2e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:30.359408 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 502/991] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:30.381475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e467c0e-bf87-413b-b75d-2dc4f9a7e254 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:30.475944 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:30.484949 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e467c0e-bf87-413b-b75d-2dc4f9a7e254 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:30.518958 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874133d-9261-4459-83e0-009320a95d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:30.519854 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874133d-9261-4459-83e0-009320a95d3c None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:30.520140 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874133d-9261-4459-83e0-009320a95d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:30.520414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874133d-9261-4459-83e0-009320a95d3c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:30.521057 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874133d-9261-4459-83e0-009320a95d3c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:30.522409 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874133d-9261-4459-83e0-009320a95d3c None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:30.537207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-a874133d-9261-4459-83e0-009320a95d3c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:26:30.537207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:30.537207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:26:30.537207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:26:30.537207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:26:30.537207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:26:30.537207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:26:30.537207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:30.537207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:26:30.537207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:30.537207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:30.537207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:30.537207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:30.537207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:30.537207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:30.537207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:30.537207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:30.538207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:30.538207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:30.538207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:30.538207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:30.538207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:30.538207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:30.538207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:26:30.538207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:26:30.538207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:26:30.538207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:26:30.538207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:30.538207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:30.538207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:30.538207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:30.538207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:30.538207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:30.539056 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:30.539056 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:30.539056 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:30.539056 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:30.539056 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:30.539056 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:30.539056 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:30.539056 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:30.539056 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:30.539056 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:30.539056 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:26:30.539056 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:30.539056 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:26:30.539056 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:30.540304 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 490/992] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:26:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:30.545396 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e60de4-d128-4019-9c38-0aed36bd2e51 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:30.644307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:30.652056 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e60de4-d128-4019-9c38-0aed36bd2e51 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:30.685808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfeecd-8578-4a4d-8654-516cc9777eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:30.686478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfeecd-8578-4a4d-8654-516cc9777eef None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:30.686758 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfeecd-8578-4a4d-8654-516cc9777eef None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:30.687034 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfeecd-8578-4a4d-8654-516cc9777eef None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:30.687763 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bfeecd-8578-4a4d-8654-516cc9777eef None admin] RBAC: Adding query filter params (name=compute) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:30.688073 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bfeecd-8578-4a4d-8654-516cc9777eef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:30.689471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bfeecd-8578-4a4d-8654-516cc9777eef None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:30.698750 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 503/993] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 09:26:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:30.699985 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874133d-9261-4459-83e0-009320a95d3c None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:30.803527 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874133d-9261-4459-83e0-009320a95d3c None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:30.837839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9e6f9-7bac-4dec-a499-c4eca10974f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:30.838501 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9e6f9-7bac-4dec-a499-c4eca10974f2 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:30.838782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9e6f9-7bac-4dec-a499-c4eca10974f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:30.839054 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9e6f9-7bac-4dec-a499-c4eca10974f2 None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:30.839843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9e6f9-7bac-4dec-a499-c4eca10974f2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:30.840149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9e6f9-7bac-4dec-a499-c4eca10974f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:30.841502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9e6f9-7bac-4dec-a499-c4eca10974f2 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:30.846778 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 491/994] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 09:26:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:30.852736 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfeecd-8578-4a4d-8654-516cc9777eef None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:30.955542 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfeecd-8578-4a4d-8654-516cc9777eef None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:30.990111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3ce5b-61a1-4aa2-bcfb-d58ffa91a931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:30.991028 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3ce5b-61a1-4aa2-bcfb-d58ffa91a931 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:30.991547 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3ce5b-61a1-4aa2-bcfb-d58ffa91a931 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:30.992008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3ce5b-61a1-4aa2-bcfb-d58ffa91a931 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:30.992974 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3ce5b-61a1-4aa2-bcfb-d58ffa91a931 None admin] RBAC: Adding query filter params (interface=public, service_id=8fb047c061bd4c24acfd0d3895899175, region_id=RegionOne) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:30.993471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3ce5b-61a1-4aa2-bcfb-d58ffa91a931 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:30.995015 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3ce5b-61a1-4aa2-bcfb-d58ffa91a931 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:31.000572 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 504/995] 10.222.0.41 () {56 vars in 1251 bytes} [Fri May 27 09:26:30 2022] GET /identity/v3/endpoints?service_id=8fb047c061bd4c24acfd0d3895899175&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:31.006334 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9e6f9-7bac-4dec-a499-c4eca10974f2 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:31.037858 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:31.118662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9e6f9-7bac-4dec-a499-c4eca10974f2 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:31.152834 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bb70b-d6ff-48d8-959e-82c6e9071387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:31.153495 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bb70b-d6ff-48d8-959e-82c6e9071387 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:31.153774 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bb70b-d6ff-48d8-959e-82c6e9071387 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:31.154044 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bb70b-d6ff-48d8-959e-82c6e9071387 None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:31.154708 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bb70b-d6ff-48d8-959e-82c6e9071387 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:31.156083 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bb70b-d6ff-48d8-959e-82c6e9071387 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:31.167332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 492/996] 10.222.0.41 () {56 vars in 1087 bytes} [Fri May 27 09:26:31 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:26:31.214455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf397437-d45a-4664-a2ff-3745155e8e87 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:31.214645 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf397437-d45a-4664-a2ff-3745155e8e87 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:31.214927 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf397437-d45a-4664-a2ff-3745155e8e87 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:31.216548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 505/997] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:31.222457 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26482d17-2d00-4308-bfb0-b3793519f7e8 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:31.222764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26482d17-2d00-4308-bfb0-b3793519f7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:31.223021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26482d17-2d00-4308-bfb0-b3793519f7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:31.241387 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-26482d17-2d00-4308-bfb0-b3793519f7e8 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:31.242604 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-26482d17-2d00-4308-bfb0-b3793519f7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:31.319976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 493/998] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:31.342536 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf397437-d45a-4664-a2ff-3745155e8e87 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:31.370154 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:31.449088 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf397437-d45a-4664-a2ff-3745155e8e87 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:31.482486 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ff29e-a166-46c7-8b90-b288aead7847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:31.483209 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ff29e-a166-46c7-8b90-b288aead7847 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:31.483513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ff29e-a166-46c7-8b90-b288aead7847 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:31.483785 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ff29e-a166-46c7-8b90-b288aead7847 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:31.484696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ff29e-a166-46c7-8b90-b288aead7847 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:31.486604 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ff29e-a166-46c7-8b90-b288aead7847 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:31.498653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-620ff29e-a166-46c7-8b90-b288aead7847 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:26:31.498653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:31.498653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:26:31.498653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:26:31.498653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:26:31.498653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:26:31.498653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:26:31.498653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:31.498653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:26:31.498653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:31.498653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:31.498653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:31.498653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:31.498653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:31.498653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:31.498653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:31.498653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:31.499646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:31.499646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:31.499646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:31.499646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:31.499646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:31.499646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:31.499646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:26:31.499646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:26:31.499646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:26:31.499646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:26:31.499646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:31.499646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:31.499646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:31.499646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:31.499646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:31.499646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:31.500559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:31.500559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:31.500559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:31.500559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:31.500559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:31.500559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:31.500559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:31.500559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:31.500559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:31.500559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:31.500559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:26:31.500559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:31.500559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 09:26:31.500559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:31.500559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 506/999] 10.222.0.41 () {56 vars in 1126 bytes} [Fri May 27 09:26:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:31.506482 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26482d17-2d00-4308-bfb0-b3793519f7e8 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:31.524589 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:31.617435 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26482d17-2d00-4308-bfb0-b3793519f7e8 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:31.650741 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c46f0-c754-4ecf-aae1-ec3c6400c9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:31.651436 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c46f0-c754-4ecf-aae1-ec3c6400c9ca None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:31.651719 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c46f0-c754-4ecf-aae1-ec3c6400c9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:31.651992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c46f0-c754-4ecf-aae1-ec3c6400c9ca None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:31.652680 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c46f0-c754-4ecf-aae1-ec3c6400c9ca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:31.652985 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c46f0-c754-4ecf-aae1-ec3c6400c9ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:31.654332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c46f0-c754-4ecf-aae1-ec3c6400c9ca None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:31.664354 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 494/1000] 10.222.0.41 () {56 vars in 1122 bytes} [Fri May 27 09:26:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:31.665879 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ff29e-a166-46c7-8b90-b288aead7847 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:31.761274 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:31.777221 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ff29e-a166-46c7-8b90-b288aead7847 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:31.811362 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52baaf-9d2b-43ab-9426-fdb3aebe5b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:31.812027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52baaf-9d2b-43ab-9426-fdb3aebe5b29 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:31.812312 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52baaf-9d2b-43ab-9426-fdb3aebe5b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:31.812589 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52baaf-9d2b-43ab-9426-fdb3aebe5b29 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:31.813296 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52baaf-9d2b-43ab-9426-fdb3aebe5b29 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:31.813604 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52baaf-9d2b-43ab-9426-fdb3aebe5b29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:31.815003 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52baaf-9d2b-43ab-9426-fdb3aebe5b29 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:31.820007 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 507/1001] 10.222.0.41 () {56 vars in 1122 bytes} [Fri May 27 09:26:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:31.825539 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c46f0-c754-4ecf-aae1-ec3c6400c9ca None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:31.910520 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:31.921818 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41534b68-16c1-4939-b330-5be1e216d301 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:31.922117 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41534b68-16c1-4939-b330-5be1e216d301 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:31.922408 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41534b68-16c1-4939-b330-5be1e216d301 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:31.924369 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 508/1002] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:26:31.929210 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8842946-9b1b-475c-9cad-04a7689df937 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:31.929508 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8842946-9b1b-475c-9cad-04a7689df937 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:31.929798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8842946-9b1b-475c-9cad-04a7689df937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:31.932041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c46f0-c754-4ecf-aae1-ec3c6400c9ca None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:31.946780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-e8842946-9b1b-475c-9cad-04a7689df937 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:31.948015 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-e8842946-9b1b-475c-9cad-04a7689df937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:31.969212 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdf8d8-1bb1-49f3-b15b-9c0445ee7de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:31.969863 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdf8d8-1bb1-49f3-b15b-9c0445ee7de2 None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:31.970769 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdf8d8-1bb1-49f3-b15b-9c0445ee7de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:31.971047 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdf8d8-1bb1-49f3-b15b-9c0445ee7de2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:31.971839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bdf8d8-1bb1-49f3-b15b-9c0445ee7de2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:31.973184 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bdf8d8-1bb1-49f3-b15b-9c0445ee7de2 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:31.999319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 495/1003] 10.222.0.41 () {60 vars in 1144 bytes} [Fri May 27 09:26:31 2022] POST /identity/v3/endpoints => generated 325 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:26:32.042177 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 509/1004] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:31 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:26:32.067534 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdf8d8-1bb1-49f3-b15b-9c0445ee7de2 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:32.173595 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdf8d8-1bb1-49f3-b15b-9c0445ee7de2 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:32.207994 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddf840-de02-4830-89de-920edf38fb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:32.208790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddf840-de02-4830-89de-920edf38fb62 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:32.209072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddf840-de02-4830-89de-920edf38fb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:32.209345 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddf840-de02-4830-89de-920edf38fb62 None admin] PATH_INFO: `/v3/services/image` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:32.210003 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddf840-de02-4830-89de-920edf38fb62 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:32.211432 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddf840-de02-4830-89de-920edf38fb62 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:32.223890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-c6ddf840-de02-4830-89de-920edf38fb62 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:26:32.223890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:32.223890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:26:32.223890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:26:32.223890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:26:32.223890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:26:32.223890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:26:32.223890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:32.223890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:26:32.223890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:32.223890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:32.223890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:32.223890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:32.223890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:32.223890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:32.223890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:32.223890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:32.224901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:32.224901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:32.224901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:32.224901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:32.224901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:32.224901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:32.224901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:26:32.224901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:26:32.224901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:26:32.224901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:26:32.224901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:32.224901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:32.224901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:32.224901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:32.224901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:32.224901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:32.225740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:32.225740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:32.225740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:32.225740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:32.225740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:32.225740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:32.225740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:32.225740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:32.225740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:32.225740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:32.225740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:26:32.225740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:32.225740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:26:32.225740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:32.225740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 496/1005] 10.222.0.41 () {56 vars in 1105 bytes} [Fri May 27 09:26:32 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:32.232683 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8842946-9b1b-475c-9cad-04a7689df937 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:32.314490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:32.343018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8842946-9b1b-475c-9cad-04a7689df937 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:32.377803 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355b9b8-29ea-433a-8424-b549ce845d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:32.378564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355b9b8-29ea-433a-8424-b549ce845d49 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:32.378749 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355b9b8-29ea-433a-8424-b549ce845d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:32.379025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355b9b8-29ea-433a-8424-b549ce845d49 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:32.379756 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355b9b8-29ea-433a-8424-b549ce845d49 None admin] RBAC: Adding query filter params (name=image) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:32.380067 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355b9b8-29ea-433a-8424-b549ce845d49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:32.381445 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355b9b8-29ea-433a-8424-b549ce845d49 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:32.386500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 510/1006] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:32.391849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddf840-de02-4830-89de-920edf38fb62 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:32.396204 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:32.494133 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddf840-de02-4830-89de-920edf38fb62 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:32.529533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741d6ba-e64a-4ba9-a688-f07b52ec5ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:32.530196 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741d6ba-e64a-4ba9-a688-f07b52ec5ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:32.530482 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741d6ba-e64a-4ba9-a688-f07b52ec5ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:32.530759 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741d6ba-e64a-4ba9-a688-f07b52ec5ad0 None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:32.531495 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741d6ba-e64a-4ba9-a688-f07b52ec5ad0 None admin] RBAC: Adding query filter params (type=image) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:32.531799 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741d6ba-e64a-4ba9-a688-f07b52ec5ad0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:32.533187 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741d6ba-e64a-4ba9-a688-f07b52ec5ad0 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:32.537667 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 497/1007] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:32 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:33.387019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec489bb-fc6b-4a05-9320-384bc352b4fa None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:33.387549 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec489bb-fc6b-4a05-9320-384bc352b4fa None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:33.387549 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec489bb-fc6b-4a05-9320-384bc352b4fa None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:33.389035 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 511/1008] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:33.393930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767aaeaf-8c35-4e42-9333-93ac14fd8794 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:33.394227 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767aaeaf-8c35-4e42-9333-93ac14fd8794 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:33.394505 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767aaeaf-8c35-4e42-9333-93ac14fd8794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:33.411346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-767aaeaf-8c35-4e42-9333-93ac14fd8794 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:33.412503 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-767aaeaf-8c35-4e42-9333-93ac14fd8794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:33.474468 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:33.481031 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 498/1009] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:33.510484 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec489bb-fc6b-4a05-9320-384bc352b4fa None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:33.614359 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec489bb-fc6b-4a05-9320-384bc352b4fa None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:33.650472 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1eca4e-c9c5-4eb6-8616-17392bca1862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:33.651196 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1eca4e-c9c5-4eb6-8616-17392bca1862 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:33.651525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1eca4e-c9c5-4eb6-8616-17392bca1862 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:33.651808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1eca4e-c9c5-4eb6-8616-17392bca1862 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:33.652468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1eca4e-c9c5-4eb6-8616-17392bca1862 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:33.653836 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1eca4e-c9c5-4eb6-8616-17392bca1862 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:33.666216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-6c1eca4e-c9c5-4eb6-8616-17392bca1862 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:26:33.666216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:33.666216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:26:33.666216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:26:33.666216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:26:33.666216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:26:33.666216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:26:33.666216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:33.666216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:26:33.666216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:33.666216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:33.666216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:33.666216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:33.666216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:33.666216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:33.666216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:33.666216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:33.667193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:33.667193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:33.667193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:33.667193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:33.667193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:33.667193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:33.667193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:26:33.667193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:26:33.667193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:26:33.667193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:26:33.667193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:33.667193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:33.667193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:33.667193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:33.667193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:33.667193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:33.668079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:33.668079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:33.668079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:33.668079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:33.668079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:33.668079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:33.668079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:33.668079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:33.668079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:33.668079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:33.668079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:26:33.668079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:33.668079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 09:26:33.668079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:33.668079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 512/1010] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:26:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:33.673448 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767aaeaf-8c35-4e42-9333-93ac14fd8794 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:33.781010 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767aaeaf-8c35-4e42-9333-93ac14fd8794 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:33.816427 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f962cdb-2933-4cb1-9912-f6b5fd7eeb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:33.817089 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f962cdb-2933-4cb1-9912-f6b5fd7eeb60 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:33.817367 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f962cdb-2933-4cb1-9912-f6b5fd7eeb60 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:33.817638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f962cdb-2933-4cb1-9912-f6b5fd7eeb60 None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:33.818327 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f962cdb-2933-4cb1-9912-f6b5fd7eeb60 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:33.818630 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f962cdb-2933-4cb1-9912-f6b5fd7eeb60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:33.820016 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f962cdb-2933-4cb1-9912-f6b5fd7eeb60 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:33.829359 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 499/1011] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 09:26:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:33.831453 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1eca4e-c9c5-4eb6-8616-17392bca1862 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:33.835460 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:33.932846 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1eca4e-c9c5-4eb6-8616-17392bca1862 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:33.965617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ed06e-6659-4fd0-a354-820d7a639780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:33.966289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ed06e-6659-4fd0-a354-820d7a639780 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:33.966574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ed06e-6659-4fd0-a354-820d7a639780 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:33.966851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ed06e-6659-4fd0-a354-820d7a639780 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:33.967588 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ed06e-6659-4fd0-a354-820d7a639780 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:33.967900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ed06e-6659-4fd0-a354-820d7a639780 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:33.969270 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ed06e-6659-4fd0-a354-820d7a639780 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:33.979328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 513/1012] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 09:26:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:33.980385 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f962cdb-2933-4cb1-9912-f6b5fd7eeb60 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:34.044100 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:34.088890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f962cdb-2933-4cb1-9912-f6b5fd7eeb60 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:34.124066 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26948d-f762-4879-a4b5-ce03dbb7668c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:34.124738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26948d-f762-4879-a4b5-ce03dbb7668c None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:34.125021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26948d-f762-4879-a4b5-ce03dbb7668c None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:34.125296 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26948d-f762-4879-a4b5-ce03dbb7668c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:34.126041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26948d-f762-4879-a4b5-ce03dbb7668c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:34.127954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26948d-f762-4879-a4b5-ce03dbb7668c None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:34.155300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 500/1013] 10.222.0.41 () {60 vars in 1144 bytes} [Fri May 27 09:26:33 2022] POST /identity/v3/endpoints => generated 334 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:26:34.249500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f050fb8-779c-4c38-8461-865c8a674f94 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:34.249825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f050fb8-779c-4c38-8461-865c8a674f94 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:34.249994 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f050fb8-779c-4c38-8461-865c8a674f94 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:34.252139 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 514/1014] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:34.257688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893773ea-4096-4cd7-8cc5-0248c0d0226b None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:34.257983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893773ea-4096-4cd7-8cc5-0248c0d0226b None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:34.258265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893773ea-4096-4cd7-8cc5-0248c0d0226b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:34.276093 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-893773ea-4096-4cd7-8cc5-0248c0d0226b None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:34.277295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-893773ea-4096-4cd7-8cc5-0248c0d0226b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:34.358106 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 501/1015] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:34 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:34.382418 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f050fb8-779c-4c38-8461-865c8a674f94 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:34.452469 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:34.487447 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f050fb8-779c-4c38-8461-865c8a674f94 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:34.520093 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32008a-88cd-4467-800b-c4c314aa8a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:34.520892 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32008a-88cd-4467-800b-c4c314aa8a78 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:34.521175 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32008a-88cd-4467-800b-c4c314aa8a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:34.521453 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32008a-88cd-4467-800b-c4c314aa8a78 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:34.522624 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32008a-88cd-4467-800b-c4c314aa8a78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:34.524106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32008a-88cd-4467-800b-c4c314aa8a78 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:34.525709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 515/1016] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:34.531649 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893773ea-4096-4cd7-8cc5-0248c0d0226b None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:34.587502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:34.647768 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893773ea-4096-4cd7-8cc5-0248c0d0226b None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:34.682169 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f7221-3ed8-46ea-8fde-b53ad0ef296a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:34.682914 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f7221-3ed8-46ea-8fde-b53ad0ef296a None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:34.683115 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f7221-3ed8-46ea-8fde-b53ad0ef296a None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:34.683423 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f7221-3ed8-46ea-8fde-b53ad0ef296a None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:34.684133 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f7221-3ed8-46ea-8fde-b53ad0ef296a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:34.685580 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f7221-3ed8-46ea-8fde-b53ad0ef296a None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:34.716233 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 502/1017] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 09:26:34 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:26:34.749105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d51452-30df-4973-af0b-90db17691f32 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:34.749449 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d51452-30df-4973-af0b-90db17691f32 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:34.749681 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d51452-30df-4973-af0b-90db17691f32 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:34.751268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 516/1018] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:34.757376 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f400103-d447-49e6-bbc4-05a6de3a22fa None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:34.757673 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f400103-d447-49e6-bbc4-05a6de3a22fa None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:34.757948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f400103-d447-49e6-bbc4-05a6de3a22fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:34.776258 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-5f400103-d447-49e6-bbc4-05a6de3a22fa None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:34.777411 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-5f400103-d447-49e6-bbc4-05a6de3a22fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:34.856555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 503/1019] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:34 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:34.880221 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d51452-30df-4973-af0b-90db17691f32 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:34.988080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d51452-30df-4973-af0b-90db17691f32 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:35.023475 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd51075-0a44-4036-95b0-a450ccb7be46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:35.024484 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd51075-0a44-4036-95b0-a450ccb7be46 None admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:35.024966 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd51075-0a44-4036-95b0-a450ccb7be46 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:35.025435 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd51075-0a44-4036-95b0-a450ccb7be46 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:35.026423 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd51075-0a44-4036-95b0-a450ccb7be46 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:35.028032 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd51075-0a44-4036-95b0-a450ccb7be46 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:35.038991 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:35.049899 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 517/1020] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 09:26:34 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:26:36.466504 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f4b8d-627c-47fd-a9b8-131fd6cf8353 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:36.467050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f4b8d-627c-47fd-a9b8-131fd6cf8353 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:36.467050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f4b8d-627c-47fd-a9b8-131fd6cf8353 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:36.468402 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 504/1021] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:36.473983 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7127a61-6d26-4e83-9aee-271fad1d7cfb None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:36.474361 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7127a61-6d26-4e83-9aee-271fad1d7cfb None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:36.474545 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7127a61-6d26-4e83-9aee-271fad1d7cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:36.491204 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-f7127a61-6d26-4e83-9aee-271fad1d7cfb None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:36.492405 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f7127a61-6d26-4e83-9aee-271fad1d7cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:36.567243 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 518/1022] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:36.590690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f4b8d-627c-47fd-a9b8-131fd6cf8353 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:36.619996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:36.699998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f4b8d-627c-47fd-a9b8-131fd6cf8353 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:36.735110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ea219-95ac-46df-8ffc-361233ebf2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:36.735910 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ea219-95ac-46df-8ffc-361233ebf2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:36.736203 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ea219-95ac-46df-8ffc-361233ebf2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:36.736479 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ea219-95ac-46df-8ffc-361233ebf2a7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:36.746753 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ea219-95ac-46df-8ffc-361233ebf2a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:26:36.755541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-908ea219-95ac-46df-8ffc-361233ebf2a7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:26:36.755541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:36.755541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:36.755541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:36.755541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:36.755541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:36.755541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:36.755541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:36.755541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:36.755541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:36.755541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:36.755541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:36.755541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:26:36.755541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:26:36.755541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:26:36.755541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:26:36.756533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:26:36.756533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:26:36.756533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:26:36.756533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:26:36.756533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:36.756533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:36.756533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:36.756533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:36.756533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:36.756533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:36.756533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:36.756533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:36.756533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:36.756533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:36.756533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:36.756533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:36.762572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:36.762572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:36.762572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:36.762572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:36.762572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:26:36.762572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:26:36.762572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:26:36.762572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:26:36.762572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:26:36.762572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:26:36.762572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:26:36.762572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:36.762572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 505/1023] 10.222.0.41 () {56 vars in 1120 bytes} [Fri May 27 09:26:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:36.763295 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7127a61-6d26-4e83-9aee-271fad1d7cfb None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:36.879407 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7127a61-6d26-4e83-9aee-271fad1d7cfb None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:36.902653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:36.914945 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226b7a5-9a6f-4f30-b150-0aa942967941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:36.915649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226b7a5-9a6f-4f30-b150-0aa942967941 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:36.915931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226b7a5-9a6f-4f30-b150-0aa942967941 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:36.916205 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226b7a5-9a6f-4f30-b150-0aa942967941 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:36.916949 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226b7a5-9a6f-4f30-b150-0aa942967941 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:36.917256 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226b7a5-9a6f-4f30-b150-0aa942967941 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:36.918647 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226b7a5-9a6f-4f30-b150-0aa942967941 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:36.931435 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 519/1024] 10.222.0.41 () {56 vars in 1115 bytes} [Fri May 27 09:26:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:36.932997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ea219-95ac-46df-8ffc-361233ebf2a7 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:36.993451 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f35dc4-d57a-4eca-84a8-a18de8a27365 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:36.993710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f35dc4-d57a-4eca-84a8-a18de8a27365 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:36.993939 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f35dc4-d57a-4eca-84a8-a18de8a27365 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:36.995574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 520/1025] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:26:37.000323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fdfef-5372-47cc-8a8e-8d19eca05f9a None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:37.000617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fdfef-5372-47cc-8a8e-8d19eca05f9a None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:37.000896 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fdfef-5372-47cc-8a8e-8d19eca05f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:37.019291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-054fdfef-5372-47cc-8a8e-8d19eca05f9a None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:37.020487 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-054fdfef-5372-47cc-8a8e-8d19eca05f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:37.023192 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:37.043892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ea219-95ac-46df-8ffc-361233ebf2a7 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:37.077828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3363ff-8d5a-499b-9f73-51358fb2bdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:37.078621 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3363ff-8d5a-499b-9f73-51358fb2bdc2 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:37.078904 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3363ff-8d5a-499b-9f73-51358fb2bdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:37.079196 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3363ff-8d5a-499b-9f73-51358fb2bdc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:37.090694 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3363ff-8d5a-499b-9f73-51358fb2bdc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:37.092176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3363ff-8d5a-499b-9f73-51358fb2bdc2 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:37.094952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 521/1026] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:26:37.111878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-6e3363ff-8d5a-499b-9f73-51358fb2bdc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:37.111878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:37.111878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:37.111878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:37.111878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:37.111878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:37.111878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:37.111878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:37.111878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:37.111878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:37.111878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:37.111878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:37.111878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:37.111878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:37.111878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:37.112888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:37.112888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:37.112888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:37.112888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:37.112888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:37.112888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:37.112888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:37.112888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:37.112888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:37.112888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:37.112888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:37.112888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:37.112888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:37.112888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:37.112888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:37.112888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:37.112888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:37.113795 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:37.113795 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:37.113795 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:37.113795 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:37.113795 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 506/1027] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:37.119299 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fdfef-5372-47cc-8a8e-8d19eca05f9a None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:37.121462 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3363ff-8d5a-499b-9f73-51358fb2bdc2 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:37.229764 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fdfef-5372-47cc-8a8e-8d19eca05f9a None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:37.230559 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3363ff-8d5a-499b-9f73-51358fb2bdc2 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:37.245603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:37.268339 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be835cd-c913-4a35-a367-dad1887a3d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:37.268555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992549c-5619-4d98-a298-85378fe62887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:37.269033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be835cd-c913-4a35-a367-dad1887a3d1b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:37.269259 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992549c-5619-4d98-a298-85378fe62887 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:37.269359 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be835cd-c913-4a35-a367-dad1887a3d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:37.269546 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992549c-5619-4d98-a298-85378fe62887 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:37.269644 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be835cd-c913-4a35-a367-dad1887a3d1b None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:37.269820 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992549c-5619-4d98-a298-85378fe62887 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:37.270276 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be835cd-c913-4a35-a367-dad1887a3d1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:37.270579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be835cd-c913-4a35-a367-dad1887a3d1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:37.271144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992549c-5619-4d98-a298-85378fe62887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:37.271976 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be835cd-c913-4a35-a367-dad1887a3d1b None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:37.272596 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992549c-5619-4d98-a298-85378fe62887 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:37.274226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 507/1028] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:37.279752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992549c-5619-4d98-a298-85378fe62887 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:37.287594 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 522/1029] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:37.288899 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:37.291036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be835cd-c913-4a35-a367-dad1887a3d1b None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:37.381125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992549c-5619-4d98-a298-85378fe62887 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:37.391068 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be835cd-c913-4a35-a367-dad1887a3d1b None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:37.414602 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607f6a9-74f4-4f7c-9d2d-f930cfbbbd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:37.415294 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607f6a9-74f4-4f7c-9d2d-f930cfbbbd11 None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:37.415589 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607f6a9-74f4-4f7c-9d2d-f930cfbbbd11 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:37.415870 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607f6a9-74f4-4f7c-9d2d-f930cfbbbd11 None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:37.416571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607f6a9-74f4-4f7c-9d2d-f930cfbbbd11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:37.418061 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607f6a9-74f4-4f7c-9d2d-f930cfbbbd11 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:37.423888 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975ba30-eecb-4a92-b07c-4efbecd02499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:37.424687 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975ba30-eecb-4a92-b07c-4efbecd02499 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:37.425148 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975ba30-eecb-4a92-b07c-4efbecd02499 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:37.425436 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975ba30-eecb-4a92-b07c-4efbecd02499 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:37.434014 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975ba30-eecb-4a92-b07c-4efbecd02499 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:37.435496 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975ba30-eecb-4a92-b07c-4efbecd02499 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:37.445646 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 508/1030] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 09:26:37 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:26:37.445646 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032ea10-1e0e-46e8-8101-9894854d0165 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:37.445646 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032ea10-1e0e-46e8-8101-9894854d0165 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:37.445646 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032ea10-1e0e-46e8-8101-9894854d0165 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:37.445646 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 509/1031] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:37.446986 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3173a09-4f35-44b5-ba02-e9b80e88d150 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:37.447304 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3173a09-4f35-44b5-ba02-e9b80e88d150 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:37.447572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3173a09-4f35-44b5-ba02-e9b80e88d150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:37.460028 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-9975ba30-eecb-4a92-b07c-4efbecd02499 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:26:37.460028 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:37.460028 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:37.460028 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:37.460028 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:37.460028 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:37.460028 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:37.460028 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:37.460028 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:37.460028 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:37.460028 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:37.460028 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:37.460028 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:26:37.460028 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:26:37.460028 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:26:37.460028 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:26:37.461062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:37.461062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:37.461062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:26:37.461062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:37.461062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:26:37.461062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:37.461062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:37.461062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:37.461062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:37.461062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:37.461062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:37.461062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:37.461062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:37.461062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:37.461062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:37.461062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:37.461062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:37.461062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:37.467176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:37.467176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:37.467176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:26:37.467176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:26:37.467176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:26:37.467176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:26:37.467176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:26:37.467176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:26:37.467176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:26:37.467176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:37.467176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 523/1032] 10.222.0.41 () {56 vars in 1093 bytes} [Fri May 27 09:26:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:37.467952 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-d3173a09-4f35-44b5-ba02-e9b80e88d150 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:37.467952 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-d3173a09-4f35-44b5-ba02-e9b80e88d150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:37.469162 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975ba30-eecb-4a92-b07c-4efbecd02499 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:37.508754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:37.540045 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:37.556685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 510/1033] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:26:37.580164 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3173a09-4f35-44b5-ba02-e9b80e88d150 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:37.589664 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975ba30-eecb-4a92-b07c-4efbecd02499 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:37.631598 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cdc1c-e2b2-495b-94b1-9f6184a99396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:37.632277 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cdc1c-e2b2-495b-94b1-9f6184a99396 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:37.632564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cdc1c-e2b2-495b-94b1-9f6184a99396 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:37.632839 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cdc1c-e2b2-495b-94b1-9f6184a99396 None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:37.633698 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cdc1c-e2b2-495b-94b1-9f6184a99396 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:37.634011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cdc1c-e2b2-495b-94b1-9f6184a99396 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:37.635488 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cdc1c-e2b2-495b-94b1-9f6184a99396 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:37.655805 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 524/1034] 10.222.0.41 () {56 vars in 1133 bytes} [Fri May 27 09:26:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:37.661637 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cdc1c-e2b2-495b-94b1-9f6184a99396 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:37.705332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3173a09-4f35-44b5-ba02-e9b80e88d150 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:37.743636 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033ac91-8f54-4a6d-bc1a-26d40744a460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:37.744431 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033ac91-8f54-4a6d-bc1a-26d40744a460 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:37.744749 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033ac91-8f54-4a6d-bc1a-26d40744a460 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:37.745101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033ac91-8f54-4a6d-bc1a-26d40744a460 None admin] PATH_INFO: `/v3/services/image` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:37.745879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033ac91-8f54-4a6d-bc1a-26d40744a460 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:37.747243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033ac91-8f54-4a6d-bc1a-26d40744a460 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:37.755378 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:37.761288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-2033ac91-8f54-4a6d-bc1a-26d40744a460 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:26:37.761288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:37.761288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:26:37.761288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:26:37.761288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:26:37.761288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:26:37.761288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:26:37.761288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:37.761288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:26:37.761288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:37.761288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:37.761288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:37.761288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:37.761288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:37.761288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:37.761288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:37.761288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:37.762265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:37.762265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:37.762265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:37.762265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:37.762265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:37.762265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:37.762265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:26:37.762265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:26:37.762265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:26:37.762265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:26:37.762265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:37.762265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:37.762265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:37.762265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:37.762265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:37.762265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:37.763177 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:37.763177 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:37.763177 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:37.763177 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:37.763177 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:37.763177 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:37.763177 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:37.763177 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:37.763177 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:37.763177 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:37.763177 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:26:37.763177 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:37.763177 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:26:37.763177 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:37.763177 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 511/1035] 10.222.0.41 () {56 vars in 1105 bytes} [Fri May 27 09:26:37 2022] GET /identity/v3/services/image => generated 86 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:37.767582 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cdc1c-e2b2-495b-94b1-9f6184a99396 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:37.768407 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033ac91-8f54-4a6d-bc1a-26d40744a460 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:37.803462 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b35fb-83bc-4b66-8726-d8e0849ab1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:37.804113 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b35fb-83bc-4b66-8726-d8e0849ab1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:37.804398 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b35fb-83bc-4b66-8726-d8e0849ab1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:37.804779 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b35fb-83bc-4b66-8726-d8e0849ab1f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:37.825510 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:37.872724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033ac91-8f54-4a6d-bc1a-26d40744a460 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:37.875863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b35fb-83bc-4b66-8726-d8e0849ab1f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:37.877367 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b35fb-83bc-4b66-8726-d8e0849ab1f0 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:37.910871 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593de923-b247-428a-a324-059fc9e52e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:37.911681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593de923-b247-428a-a324-059fc9e52e28 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:37.911963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593de923-b247-428a-a324-059fc9e52e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:37.912240 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593de923-b247-428a-a324-059fc9e52e28 None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:37.912929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593de923-b247-428a-a324-059fc9e52e28 None admin] RBAC: Adding query filter params (name=image) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:37.913236 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593de923-b247-428a-a324-059fc9e52e28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:37.914586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593de923-b247-428a-a324-059fc9e52e28 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:37.925131 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 512/1036] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:37.926277 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593de923-b247-428a-a324-059fc9e52e28 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:37.972367 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:37.985608 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 525/1037] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:26:37 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 09:26:37.990987 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b35fb-83bc-4b66-8726-d8e0849ab1f0 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:38.036489 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593de923-b247-428a-a324-059fc9e52e28 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:38.058314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:38.076730 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef28a2c-01b0-41af-9ee5-a67fb58d4162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:38.077407 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef28a2c-01b0-41af-9ee5-a67fb58d4162 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:38.077704 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef28a2c-01b0-41af-9ee5-a67fb58d4162 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:38.078039 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef28a2c-01b0-41af-9ee5-a67fb58d4162 None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:38.078660 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef28a2c-01b0-41af-9ee5-a67fb58d4162 None admin] RBAC: Adding query filter params (type=image) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:38.078970 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef28a2c-01b0-41af-9ee5-a67fb58d4162 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:38.080929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef28a2c-01b0-41af-9ee5-a67fb58d4162 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:38.090775 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 513/1038] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:38.091642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef28a2c-01b0-41af-9ee5-a67fb58d4162 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:38.100599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b35fb-83bc-4b66-8726-d8e0849ab1f0 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:38.137758 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815a268-e489-48a9-bd2d-f3b1f0ad8ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:38.138857 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815a268-e489-48a9-bd2d-f3b1f0ad8ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:38.138970 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815a268-e489-48a9-bd2d-f3b1f0ad8ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:38.139188 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815a268-e489-48a9-bd2d-f3b1f0ad8ed6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:38.150447 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815a268-e489-48a9-bd2d-f3b1f0ad8ed6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:38.152058 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815a268-e489-48a9-bd2d-f3b1f0ad8ed6 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:38.170654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-6815a268-e489-48a9-bd2d-f3b1f0ad8ed6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:38.170654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:38.170654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:38.170654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:38.170654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:38.170654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:38.170654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:38.170654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:38.170654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:38.170654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:38.170654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:38.170654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:38.170654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:38.170654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:38.170654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:38.171651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:38.171651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:38.171651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:38.171651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:38.171651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:38.171651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:38.171651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:38.171651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:38.171651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:38.171651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:38.171651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:38.171651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:38.171651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:38.171651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:38.171651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:38.171651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:38.171651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:38.172555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:38.172555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:38.172555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:38.172555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:38.172555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 526/1039] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:38.177983 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815a268-e489-48a9-bd2d-f3b1f0ad8ed6 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:38.197803 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef28a2c-01b0-41af-9ee5-a67fb58d4162 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:38.224689 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:38.231468 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f166d-e2c0-4610-b236-08bfac8b9438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:38.232155 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f166d-e2c0-4610-b236-08bfac8b9438 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:38.232435 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f166d-e2c0-4610-b236-08bfac8b9438 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:38.232709 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f166d-e2c0-4610-b236-08bfac8b9438 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:38.233515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f166d-e2c0-4610-b236-08bfac8b9438 None admin] RBAC: Adding query filter params (interface=public, service_id=e42a0bd1be3b4c12b2b03febadc5e930, region_id=RegionOne) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:38.234094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f166d-e2c0-4610-b236-08bfac8b9438 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:38.235984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f166d-e2c0-4610-b236-08bfac8b9438 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:38.245486 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 514/1040] 10.222.0.41 () {56 vars in 1251 bytes} [Fri May 27 09:26:38 2022] GET /identity/v3/endpoints?service_id=e42a0bd1be3b4c12b2b03febadc5e930&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:38.246418 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f166d-e2c0-4610-b236-08bfac8b9438 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:38.285333 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815a268-e489-48a9-bd2d-f3b1f0ad8ed6 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:38.294694 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:38.322378 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0ec36-c109-4748-8438-797fba92ce91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:38.323045 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0ec36-c109-4748-8438-797fba92ce91 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:38.323357 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0ec36-c109-4748-8438-797fba92ce91 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:38.324020 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0ec36-c109-4748-8438-797fba92ce91 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:38.324758 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0ec36-c109-4748-8438-797fba92ce91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:38.325070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0ec36-c109-4748-8438-797fba92ce91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:38.326795 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0ec36-c109-4748-8438-797fba92ce91 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:38.343502 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 527/1041] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:38.344648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0ec36-c109-4748-8438-797fba92ce91 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:38.349035 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f166d-e2c0-4610-b236-08bfac8b9438 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:38.384532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41852137-cf95-48cf-8327-b7fcd796cb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:38.385199 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41852137-cf95-48cf-8327-b7fcd796cb52 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:38.385486 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41852137-cf95-48cf-8327-b7fcd796cb52 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:38.385764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41852137-cf95-48cf-8327-b7fcd796cb52 None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:38.386445 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41852137-cf95-48cf-8327-b7fcd796cb52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:38.387838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41852137-cf95-48cf-8327-b7fcd796cb52 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:38.408543 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 515/1042] 10.222.0.41 () {56 vars in 1087 bytes} [Fri May 27 09:26:38 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:26:38.452992 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0ec36-c109-4748-8438-797fba92ce91 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:38.456286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:38.491581 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9176eea-e121-4492-be3c-ecdee9175417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:38.492399 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9176eea-e121-4492-be3c-ecdee9175417 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:38.492682 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9176eea-e121-4492-be3c-ecdee9175417 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:38.492960 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9176eea-e121-4492-be3c-ecdee9175417 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:38.500463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9176eea-e121-4492-be3c-ecdee9175417 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:38.502475 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9176eea-e121-4492-be3c-ecdee9175417 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:38.518158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-b9176eea-e121-4492-be3c-ecdee9175417 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:38.518158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:38.518158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:38.518158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:38.518158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:38.518158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:38.518158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:38.518158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:38.518158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:38.518158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:38.518158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:38.518158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:38.518158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:26:38.518158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:26:38.518158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:26:38.524574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:26:38.524574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:38.524574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:38.524574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:38.524574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:38.524574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:38.524574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:38.524574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:38.524574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:38.524574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:38.524574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:38.524574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:38.524574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:38.524574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:38.524574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:38.524574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:38.524574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:38.525680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:26:38.525680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:26:38.525680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:26:38.525680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:26:38.525680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:26:38.525680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:26:38.525680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:38.525680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:38.525680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 528/1043] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:26:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:38.527973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41852137-cf95-48cf-8327-b7fcd796cb52 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:38.640609 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41852137-cf95-48cf-8327-b7fcd796cb52 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:38.654503 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:38.676687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a23ee3-5030-4298-9109-7dd217a604cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:38.677356 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a23ee3-5030-4298-9109-7dd217a604cd None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:38.677642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a23ee3-5030-4298-9109-7dd217a604cd None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:38.677922 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a23ee3-5030-4298-9109-7dd217a604cd None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:38.678692 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a23ee3-5030-4298-9109-7dd217a604cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:38.679002 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a23ee3-5030-4298-9109-7dd217a604cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:38.680566 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a23ee3-5030-4298-9109-7dd217a604cd None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:38.693570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 516/1044] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:26:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:38.699235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9176eea-e121-4492-be3c-ecdee9175417 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:38.801066 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9176eea-e121-4492-be3c-ecdee9175417 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:38.835017 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d39ac-88f5-48e1-9a52-0d9347567e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:38.835754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d39ac-88f5-48e1-9a52-0d9347567e5c None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:38.836035 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d39ac-88f5-48e1-9a52-0d9347567e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:38.836306 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d39ac-88f5-48e1-9a52-0d9347567e5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:38.837122 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d39ac-88f5-48e1-9a52-0d9347567e5c None admin] RBAC: Adding query filter params (role.id=582df05c56014989bfe8f0e5522d0633, scope.project.id=b1d802dc0211467fa4e709cd01d411dc, user.id=d2b1c12e88c549208894fc0dd0c60b88) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:38.837432 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d39ac-88f5-48e1-9a52-0d9347567e5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:38.838860 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d39ac-88f5-48e1-9a52-0d9347567e5c None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:38.851301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 529/1045] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:26:38 2022] GET /identity/v3/role_assignments?user.id=d2b1c12e88c549208894fc0dd0c60b88&scope.project.id=b1d802dc0211467fa4e709cd01d411dc&role.id=582df05c56014989bfe8f0e5522d0633 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:39.714943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d803ea-a0a0-48d0-b6ad-c350e977033b None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:39.715518 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d803ea-a0a0-48d0-b6ad-c350e977033b None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:39.715518 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d803ea-a0a0-48d0-b6ad-c350e977033b None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:39.716943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 517/1046] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:39.722270 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b20e8-1b4f-4a12-a18b-481cf23c4456 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:39.722711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b20e8-1b4f-4a12-a18b-481cf23c4456 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:39.722857 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b20e8-1b4f-4a12-a18b-481cf23c4456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:39.740588 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-815b20e8-1b4f-4a12-a18b-481cf23c4456 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:39.741766 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-815b20e8-1b4f-4a12-a18b-481cf23c4456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:39.765428 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:39.810431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 530/1047] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:39.833641 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d803ea-a0a0-48d0-b6ad-c350e977033b None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:39.937426 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d803ea-a0a0-48d0-b6ad-c350e977033b None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:39.972273 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bb410-d471-4161-93cc-9758ad92e9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:39.972988 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bb410-d471-4161-93cc-9758ad92e9ac None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:39.973274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bb410-d471-4161-93cc-9758ad92e9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:39.973552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bb410-d471-4161-93cc-9758ad92e9ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:39.984274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042bb410-d471-4161-93cc-9758ad92e9ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:26:39.992515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-042bb410-d471-4161-93cc-9758ad92e9ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:26:39.992515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:39.992515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:39.992515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:39.992515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:39.992515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:39.992515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:39.992515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:39.992515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:39.992515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:39.992515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:39.992515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:39.992515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:26:39.992515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:26:39.992515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:26:39.992515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:26:39.993420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:26:39.993420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:26:39.993420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:26:39.993420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:26:39.993420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:39.993420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:39.993420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:39.993420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:39.993420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:39.993420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:39.993420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:39.993420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:39.993420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:39.993420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:39.993420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:39.993420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:39.994276 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:39.994276 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:39.994276 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:39.994276 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:39.994276 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:26:39.994276 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:26:39.994276 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:26:39.994276 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:26:39.994276 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:26:39.994276 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:26:39.994276 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:26:39.994276 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:40.001634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 518/1048] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:26:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:40.001769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b20e8-1b4f-4a12-a18b-481cf23c4456 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:40.110207 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b20e8-1b4f-4a12-a18b-481cf23c4456 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:40.144951 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2aaaf-e565-4576-afcd-1577aff2145b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:40.145619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2aaaf-e565-4576-afcd-1577aff2145b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:40.145902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2aaaf-e565-4576-afcd-1577aff2145b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:40.146177 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2aaaf-e565-4576-afcd-1577aff2145b None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:40.146916 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2aaaf-e565-4576-afcd-1577aff2145b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:40.147226 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2aaaf-e565-4576-afcd-1577aff2145b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:40.148615 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2aaaf-e565-4576-afcd-1577aff2145b None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:40.156914 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 531/1049] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:26:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:40.162413 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bb410-d471-4161-93cc-9758ad92e9ac None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:40.194030 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:40.263470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bb410-d471-4161-93cc-9758ad92e9ac None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:40.295905 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1cfca-516d-455a-9dd2-0f141560d9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:40.296782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1cfca-516d-455a-9dd2-0f141560d9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:40.297062 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1cfca-516d-455a-9dd2-0f141560d9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:40.297334 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1cfca-516d-455a-9dd2-0f141560d9b7 None admin] PATH_INFO: `/v3/users/459a9f0ae7aa4580823e96959803a70e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:40.311064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1cfca-516d-455a-9dd2-0f141560d9b7 None admin] RBAC: Authorizing `identity:get_user(user_id=459a9f0ae7aa4580823e96959803a70e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:40.312552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1cfca-516d-455a-9dd2-0f141560d9b7 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:40.314908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 519/1050] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:26:40 2022] GET /identity/v3/users/459a9f0ae7aa4580823e96959803a70e => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:40.320436 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2aaaf-e565-4576-afcd-1577aff2145b None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:40.343843 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:40.423354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2aaaf-e565-4576-afcd-1577aff2145b None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:40.458586 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cba53b-43bc-4cbe-94d9-c4ef7e9e123c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:40.459268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cba53b-43bc-4cbe-94d9-c4ef7e9e123c None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:40.459580 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cba53b-43bc-4cbe-94d9-c4ef7e9e123c None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:40.459856 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cba53b-43bc-4cbe-94d9-c4ef7e9e123c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:40.530408 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cba53b-43bc-4cbe-94d9-c4ef7e9e123c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:40.531914 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cba53b-43bc-4cbe-94d9-c4ef7e9e123c None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:40.553109 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:40.644882 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 532/1051] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:26:40 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 09:26:40.646141 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1cfca-516d-455a-9dd2-0f141560d9b7 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:40.648324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b23c4-a39d-44ad-968f-2a369bd053d9 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:40.648617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b23c4-a39d-44ad-968f-2a369bd053d9 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:40.649087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b23c4-a39d-44ad-968f-2a369bd053d9 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:40.650363 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 533/1052] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:40.655231 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d03b6-0a8a-4e90-bbaf-83a8501b2642 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:40.655550 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d03b6-0a8a-4e90-bbaf-83a8501b2642 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:40.655832 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d03b6-0a8a-4e90-bbaf-83a8501b2642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:40.672940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-106d03b6-0a8a-4e90-bbaf-83a8501b2642 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:40.674555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-106d03b6-0a8a-4e90-bbaf-83a8501b2642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:40.746274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:40.751387 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 534/1053] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:26:40.761070 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1cfca-516d-455a-9dd2-0f141560d9b7 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:40.774167 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d03b6-0a8a-4e90-bbaf-83a8501b2642 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:40.797016 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e507a3-a251-49c4-adcc-9ee52ddf7ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:40.797849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e507a3-a251-49c4-adcc-9ee52ddf7ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:40.798139 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e507a3-a251-49c4-adcc-9ee52ddf7ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:40.798416 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e507a3-a251-49c4-adcc-9ee52ddf7ee7 None admin] PATH_INFO: `/v3/projects/83c4cb575aab4909b2aaf3f0d7763882` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:40.800269 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e507a3-a251-49c4-adcc-9ee52ddf7ee7 None admin] RBAC: Authorizing `identity:get_project(project_id=83c4cb575aab4909b2aaf3f0d7763882)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:40.801819 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e507a3-a251-49c4-adcc-9ee52ddf7ee7 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:40.808734 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 520/1054] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:26:40 2022] GET /identity/v3/projects/83c4cb575aab4909b2aaf3f0d7763882 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:40.809712 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e507a3-a251-49c4-adcc-9ee52ddf7ee7 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:40.826307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:40.889479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d03b6-0a8a-4e90-bbaf-83a8501b2642 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:40.928372 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50eb754-caa8-4602-8d5e-cebbaed0ba81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:40.929737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50eb754-caa8-4602-8d5e-cebbaed0ba81 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:40.930032 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50eb754-caa8-4602-8d5e-cebbaed0ba81 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:40.930313 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50eb754-caa8-4602-8d5e-cebbaed0ba81 None admin] PATH_INFO: `/v3/services/image` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:40.930975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50eb754-caa8-4602-8d5e-cebbaed0ba81 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:40.931346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e507a3-a251-49c4-adcc-9ee52ddf7ee7 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:40.932400 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50eb754-caa8-4602-8d5e-cebbaed0ba81 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:40.947506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-f50eb754-caa8-4602-8d5e-cebbaed0ba81 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:26:40.947506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:40.947506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:26:40.947506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:26:40.947506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:26:40.947506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:26:40.947506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:26:40.947506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:40.947506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:26:40.947506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:40.947506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:26:40.947506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:40.947506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:40.947506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:40.947506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:40.947506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:40.947506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:40.948532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:40.948532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:40.948532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:40.948532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:40.948532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:40.948532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:40.948532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:26:40.948532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:26:40.948532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:26:40.948532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:26:40.948532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:40.948532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:40.948532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:40.948532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:40.948532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:40.948532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:40.949557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:40.949557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:40.949557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:40.949557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:40.949557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:40.949557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:40.949557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:40.949557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:40.949557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:40.949557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:40.949557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:26:40.949557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:26:40.949557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 09:26:40.949557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:40.949557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 535/1055] 10.222.0.41 () {56 vars in 1105 bytes} [Fri May 27 09:26:40 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:40.955431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50eb754-caa8-4602-8d5e-cebbaed0ba81 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:40.970511 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5b814-d3b8-44b5-9e80-f1dc150d60b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:40.971227 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5b814-d3b8-44b5-9e80-f1dc150d60b7 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:40.971544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5b814-d3b8-44b5-9e80-f1dc150d60b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:40.971817 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5b814-d3b8-44b5-9e80-f1dc150d60b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:40.972643 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5b814-d3b8-44b5-9e80-f1dc150d60b7 None admin] RBAC: Adding query filter params (role.id=bb6c5483d9be4a16ac64750536c5e2e2, scope.project.id=83c4cb575aab4909b2aaf3f0d7763882, user.id=459a9f0ae7aa4580823e96959803a70e) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:40.972959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5b814-d3b8-44b5-9e80-f1dc150d60b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:40.974426 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5b814-d3b8-44b5-9e80-f1dc150d60b7 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:40.980326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 521/1056] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:26:40 2022] GET /identity/v3/role_assignments?user.id=459a9f0ae7aa4580823e96959803a70e&scope.project.id=83c4cb575aab4909b2aaf3f0d7763882&role.id=bb6c5483d9be4a16ac64750536c5e2e2 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:41.053566 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb63183-3cc2-49e5-ab70-2b43d6871a15 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:41.053754 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb63183-3cc2-49e5-ab70-2b43d6871a15 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:41.054033 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb63183-3cc2-49e5-ab70-2b43d6871a15 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:41.055599 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 522/1057] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:26:41.063597 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfced8f-ba8c-4d11-bc70-0941af877b37 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:41.063597 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfced8f-ba8c-4d11-bc70-0941af877b37 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:41.063597 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfced8f-ba8c-4d11-bc70-0941af877b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:41.077915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50eb754-caa8-4602-8d5e-cebbaed0ba81 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:41.080364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-9dfced8f-ba8c-4d11-bc70-0941af877b37 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:41.082531 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-9dfced8f-ba8c-4d11-bc70-0941af877b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:41.093968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:41.103773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:41.119796 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dd4cf-0577-4aba-8af3-0f9edf5ccc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:41.120794 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dd4cf-0577-4aba-8af3-0f9edf5ccc0d None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:41.121242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dd4cf-0577-4aba-8af3-0f9edf5ccc0d None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:41.121524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dd4cf-0577-4aba-8af3-0f9edf5ccc0d None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:41.122250 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94dd4cf-0577-4aba-8af3-0f9edf5ccc0d None admin] RBAC: Adding query filter params (name=image) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:41.122566 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94dd4cf-0577-4aba-8af3-0f9edf5ccc0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:41.124013 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94dd4cf-0577-4aba-8af3-0f9edf5ccc0d None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:41.130599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 536/1058] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:41.136371 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dd4cf-0577-4aba-8af3-0f9edf5ccc0d None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:41.175316 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 523/1059] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:26:41.198937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfced8f-ba8c-4d11-bc70-0941af877b37 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:41.254195 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dd4cf-0577-4aba-8af3-0f9edf5ccc0d None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:41.290589 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d2f82-7f87-474f-a70e-16493f975999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:41.291267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d2f82-7f87-474f-a70e-16493f975999 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:41.291586 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d2f82-7f87-474f-a70e-16493f975999 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:41.291864 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d2f82-7f87-474f-a70e-16493f975999 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:41.292570 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d2f82-7f87-474f-a70e-16493f975999 None admin] RBAC: Adding query filter params (type=image) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:41.292879 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d2f82-7f87-474f-a70e-16493f975999 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:41.294264 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d2f82-7f87-474f-a70e-16493f975999 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:41.304149 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 537/1060] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:41.304741 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d2f82-7f87-474f-a70e-16493f975999 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:41.315777 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfced8f-ba8c-4d11-bc70-0941af877b37 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:41.350256 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:41.350794 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60fa56-b774-45cc-ade2-46812e4f908b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:41.352021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60fa56-b774-45cc-ade2-46812e4f908b None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:41.352455 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60fa56-b774-45cc-ade2-46812e4f908b None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:41.352730 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60fa56-b774-45cc-ade2-46812e4f908b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:41.364598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60fa56-b774-45cc-ade2-46812e4f908b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:26:41.372879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-5e60fa56-b774-45cc-ade2-46812e4f908b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:26:41.372879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:41.372879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:41.372879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:41.372879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:41.372879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:41.372879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:41.372879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:41.372879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:41.372879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:41.372879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:41.372879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:41.372879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:26:41.372879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:26:41.372879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:26:41.372879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:26:41.373811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:26:41.373811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:26:41.373811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:26:41.373811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:26:41.373811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:41.373811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:41.373811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:41.373811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:41.373811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:41.373811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:41.373811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:41.373811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:41.373811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:41.373811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:41.373811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:41.373811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:41.374637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:41.374637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:41.374637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:41.374637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:41.374637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:26:41.374637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:26:41.374637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:26:41.374637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:26:41.374637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:26:41.374637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:26:41.374637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:26:41.374637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:41.379586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 524/1061] 10.222.0.41 () {56 vars in 1120 bytes} [Fri May 27 09:26:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:41.380307 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60fa56-b774-45cc-ade2-46812e4f908b None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:41.396020 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:41.412287 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d2f82-7f87-474f-a70e-16493f975999 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:41.452551 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6031c-9f52-477f-a264-3c88cadd78ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:41.453257 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6031c-9f52-477f-a264-3c88cadd78ae None admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:41.453543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6031c-9f52-477f-a264-3c88cadd78ae None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:41.453774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6031c-9f52-477f-a264-3c88cadd78ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:41.455088 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6031c-9f52-477f-a264-3c88cadd78ae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:41.456780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6031c-9f52-477f-a264-3c88cadd78ae None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:41.475478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 538/1062] 10.222.0.41 () {60 vars in 1144 bytes} [Fri May 27 09:26:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:26:41.498166 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60fa56-b774-45cc-ade2-46812e4f908b None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:41.553175 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f6497-4ce4-4c2f-8212-b5548340e5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:41.553866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f6497-4ce4-4c2f-8212-b5548340e5db None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:41.554213 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f6497-4ce4-4c2f-8212-b5548340e5db None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:41.554434 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f6497-4ce4-4c2f-8212-b5548340e5db None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:41.555209 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f6497-4ce4-4c2f-8212-b5548340e5db None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:41.555551 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f6497-4ce4-4c2f-8212-b5548340e5db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:41.556984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f6497-4ce4-4c2f-8212-b5548340e5db None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:41.573395 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 525/1063] 10.222.0.41 () {56 vars in 1115 bytes} [Fri May 27 09:26:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:41.574967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6031c-9f52-477f-a264-3c88cadd78ae None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:41.684764 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:41.690115 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6031c-9f52-477f-a264-3c88cadd78ae None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:41.727050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868e00e-107b-4a41-bd31-c3555ef3f375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:41.727886 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868e00e-107b-4a41-bd31-c3555ef3f375 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:41.728175 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868e00e-107b-4a41-bd31-c3555ef3f375 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:41.728459 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868e00e-107b-4a41-bd31-c3555ef3f375 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:41.740261 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868e00e-107b-4a41-bd31-c3555ef3f375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:41.741716 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868e00e-107b-4a41-bd31-c3555ef3f375 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:41.759767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-b868e00e-107b-4a41-bd31-c3555ef3f375 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:41.759767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:41.759767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:41.759767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:41.759767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:41.759767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:41.759767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:41.759767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:41.759767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:41.759767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:41.759767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:41.759767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:41.759767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:41.759767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:41.759767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:41.761098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:41.761098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:41.761098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:41.761098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:41.761098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:41.761098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:41.761098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:41.761098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:41.761098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:41.761098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:41.761098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:41.761098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:41.761098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:41.761098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:41.761098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:41.761098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:41.761098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:41.761991 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:41.761991 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:41.761991 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:41.761991 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:41.761991 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 539/1064] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:41.767995 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f6497-4ce4-4c2f-8212-b5548340e5db None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:41.839472 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:41.872346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f6497-4ce4-4c2f-8212-b5548340e5db None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:41.906525 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990163f7-bed9-4481-ae06-1eb73eee0fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:41.907217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990163f7-bed9-4481-ae06-1eb73eee0fbc None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:41.907533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990163f7-bed9-4481-ae06-1eb73eee0fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:41.907813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990163f7-bed9-4481-ae06-1eb73eee0fbc None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:41.908525 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990163f7-bed9-4481-ae06-1eb73eee0fbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:41.908834 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990163f7-bed9-4481-ae06-1eb73eee0fbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:41.910196 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990163f7-bed9-4481-ae06-1eb73eee0fbc None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:41.921677 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 526/1065] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:41.927781 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868e00e-107b-4a41-bd31-c3555ef3f375 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:42.031814 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868e00e-107b-4a41-bd31-c3555ef3f375 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:42.073199 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092f657-e9ea-473c-a34b-bf9a90ce0d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:42.073992 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092f657-e9ea-473c-a34b-bf9a90ce0d89 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:42.074271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092f657-e9ea-473c-a34b-bf9a90ce0d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:42.074541 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092f657-e9ea-473c-a34b-bf9a90ce0d89 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:42.082290 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092f657-e9ea-473c-a34b-bf9a90ce0d89 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:42.083759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092f657-e9ea-473c-a34b-bf9a90ce0d89 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:42.098829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-d092f657-e9ea-473c-a34b-bf9a90ce0d89 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:26:42.098829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:42.098829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:42.098829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:42.098829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:42.098829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:42.098829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:42.098829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:42.098829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:42.098829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:42.098829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:42.098829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:42.098829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:26:42.098829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:26:42.098829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:26:42.098829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:26:42.099827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:42.099827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:42.099827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:26:42.099827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:42.099827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:26:42.099827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:42.099827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:42.099827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:42.099827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:42.099827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:42.099827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:42.099827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:42.099827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:42.099827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:42.099827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:42.099827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:42.099827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:42.099827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:42.100768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:42.100768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:42.100768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:26:42.100768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:26:42.100768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:26:42.100768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:26:42.100768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:26:42.100768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:26:42.100768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:26:42.100768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:42.103679 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 540/1066] 10.222.0.41 () {56 vars in 1093 bytes} [Fri May 27 09:26:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:42.105921 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990163f7-bed9-4481-ae06-1eb73eee0fbc None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:42.205337 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990163f7-bed9-4481-ae06-1eb73eee0fbc None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:42.233073 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:42.240852 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583bd74-4582-4feb-a066-db837c0867c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:42.241528 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583bd74-4582-4feb-a066-db837c0867c9 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:42.241810 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583bd74-4582-4feb-a066-db837c0867c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:42.242084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583bd74-4582-4feb-a066-db837c0867c9 None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:42.242909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583bd74-4582-4feb-a066-db837c0867c9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:42.243217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583bd74-4582-4feb-a066-db837c0867c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:42.244677 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583bd74-4582-4feb-a066-db837c0867c9 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:42.266384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 527/1067] 10.222.0.41 () {56 vars in 1133 bytes} [Fri May 27 09:26:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:42.268080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092f657-e9ea-473c-a34b-bf9a90ce0d89 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:42.280999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:42.371862 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092f657-e9ea-473c-a34b-bf9a90ce0d89 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:42.409375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22debd-4ac8-4aa3-a5f6-de2fc887b4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:42.410169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22debd-4ac8-4aa3-a5f6-de2fc887b4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:42.410450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22debd-4ac8-4aa3-a5f6-de2fc887b4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:42.410723 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22debd-4ac8-4aa3-a5f6-de2fc887b4a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:42.421892 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22debd-4ac8-4aa3-a5f6-de2fc887b4a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:42.423916 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22debd-4ac8-4aa3-a5f6-de2fc887b4a4 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:42.440648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-9a22debd-4ac8-4aa3-a5f6-de2fc887b4a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:42.440648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:42.440648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:42.440648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:42.440648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:42.440648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:42.440648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:42.440648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:42.440648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:42.440648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:42.440648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:42.440648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:42.440648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:42.440648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:42.440648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:42.441524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:42.441524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:42.441524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:42.441524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:42.441524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:42.441524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:42.441524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:42.441524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:42.441524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:42.441524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:42.441524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:42.441524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:42.441524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:42.441524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:42.441524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:42.441524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:42.441524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:42.442407 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:42.442407 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:42.442407 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:42.442407 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:42.443621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 541/1068] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:42.447412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583bd74-4582-4feb-a066-db837c0867c9 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:42.552220 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583bd74-4582-4feb-a066-db837c0867c9 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:42.586616 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6a096-330f-4b97-b866-9dcb34c2358c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:42.587298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6a096-330f-4b97-b866-9dcb34c2358c None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:42.587592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6a096-330f-4b97-b866-9dcb34c2358c None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:42.587864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6a096-330f-4b97-b866-9dcb34c2358c None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:42.588577 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6a096-330f-4b97-b866-9dcb34c2358c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:42.588881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6a096-330f-4b97-b866-9dcb34c2358c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:42.590249 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6a096-330f-4b97-b866-9dcb34c2358c None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:42.607779 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 528/1069] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:42.609585 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22debd-4ac8-4aa3-a5f6-de2fc887b4a4 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:42.674842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:42.715566 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22debd-4ac8-4aa3-a5f6-de2fc887b4a4 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:42.750084 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aed8c8-e497-40ea-9071-e3c6c9b2cc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:42.750925 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aed8c8-e497-40ea-9071-e3c6c9b2cc25 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:42.751200 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aed8c8-e497-40ea-9071-e3c6c9b2cc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:42.751505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aed8c8-e497-40ea-9071-e3c6c9b2cc25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:42.759099 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aed8c8-e497-40ea-9071-e3c6c9b2cc25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:42.760597 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aed8c8-e497-40ea-9071-e3c6c9b2cc25 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:42.775999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-b8aed8c8-e497-40ea-9071-e3c6c9b2cc25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:42.775999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:42.775999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:42.775999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:42.775999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:42.775999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:42.775999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:42.775999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:42.775999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:42.775999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:42.775999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:42.775999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:42.775999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:26:42.775999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:26:42.775999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:26:42.776952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:26:42.776952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:42.776952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:42.776952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:42.776952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:42.776952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:42.776952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:42.776952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:42.776952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:42.776952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:42.776952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:42.776952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:42.776952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:42.776952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:42.776952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:42.776952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:42.776952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:42.783890 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:26:42.783890 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:26:42.783890 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:26:42.783890 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:26:42.783890 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:26:42.783890 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:26:42.783890 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:42.783890 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:42.783890 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 542/1070] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:26:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:42.784375 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6a096-330f-4b97-b866-9dcb34c2358c None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:42.834934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:42.888413 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6a096-330f-4b97-b866-9dcb34c2358c None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:42.925716 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364299ae-ea49-425a-b3ff-9d1a25f711a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:42.925716 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364299ae-ea49-425a-b3ff-9d1a25f711a9 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:42.925716 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364299ae-ea49-425a-b3ff-9d1a25f711a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:42.925716 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364299ae-ea49-425a-b3ff-9d1a25f711a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:42.926193 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364299ae-ea49-425a-b3ff-9d1a25f711a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:42.926193 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364299ae-ea49-425a-b3ff-9d1a25f711a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:42.927584 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364299ae-ea49-425a-b3ff-9d1a25f711a9 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:42.945630 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 529/1071] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:26:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:42.947304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aed8c8-e497-40ea-9071-e3c6c9b2cc25 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:43.055304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aed8c8-e497-40ea-9071-e3c6c9b2cc25 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:43.084418 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:43.098350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298b4d3-ce6c-43a2-b835-f26be8adf50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:43.099249 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298b4d3-ce6c-43a2-b835-f26be8adf50d None admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:43.099573 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298b4d3-ce6c-43a2-b835-f26be8adf50d None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:43.099852 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298b4d3-ce6c-43a2-b835-f26be8adf50d None admin] PATH_INFO: `/v3/projects/b1d802dc0211467fa4e709cd01d411dc/users/d2b1c12e88c549208894fc0dd0c60b88/roles/582df05c56014989bfe8f0e5522d0633` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:43.102038 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298b4d3-ce6c-43a2-b835-f26be8adf50d None admin] RBAC: Authorizing `identity:create_grant(project_id=b1d802dc0211467fa4e709cd01d411dc, user_id=d2b1c12e88c549208894fc0dd0c60b88, role_id=582df05c56014989bfe8f0e5522d0633)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:43.103507 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298b4d3-ce6c-43a2-b835-f26be8adf50d None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:43.117149 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 543/1072] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:26:42 2022] PUT /identity/v3/projects/b1d802dc0211467fa4e709cd01d411dc/users/d2b1c12e88c549208894fc0dd0c60b88/roles/582df05c56014989bfe8f0e5522d0633 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:26:43.278554 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96525626-8a71-4d4a-84f7-fa32b57077a3 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:43.278895 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96525626-8a71-4d4a-84f7-fa32b57077a3 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:43.279125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96525626-8a71-4d4a-84f7-fa32b57077a3 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:43.280763 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 530/1073] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:43.286373 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825e600-2df7-4f28-a9ed-e6cb04354d3b None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:43.286684 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825e600-2df7-4f28-a9ed-e6cb04354d3b None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:43.286955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825e600-2df7-4f28-a9ed-e6cb04354d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:43.306692 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-b825e600-2df7-4f28-a9ed-e6cb04354d3b None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:43.307929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-b825e600-2df7-4f28-a9ed-e6cb04354d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:43.379032 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 544/1074] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:43.401975 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96525626-8a71-4d4a-84f7-fa32b57077a3 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:43.510308 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96525626-8a71-4d4a-84f7-fa32b57077a3 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:43.524395 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:43.554691 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a54cb-bb04-4e8a-9080-7fab116da01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:43.555454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a54cb-bb04-4e8a-9080-7fab116da01c None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:43.555742 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a54cb-bb04-4e8a-9080-7fab116da01c None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:43.556018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a54cb-bb04-4e8a-9080-7fab116da01c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:43.566900 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a54cb-bb04-4e8a-9080-7fab116da01c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:26:43.574592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-526a54cb-bb04-4e8a-9080-7fab116da01c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:26:43.574592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:43.574592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:43.574592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:43.574592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:43.574592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:43.574592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:43.574592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:43.574592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:43.574592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:43.574592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:43.574592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:43.574592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:26:43.574592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:26:43.574592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:26:43.574592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:26:43.575532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:26:43.575532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:26:43.575532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:26:43.575532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:26:43.575532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:43.575532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:43.575532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:43.575532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:43.575532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:43.575532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:43.575532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:43.575532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:43.575532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:43.575532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:43.575532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:43.575532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:43.581966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:43.581966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:43.581966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:43.581966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:43.581966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:26:43.581966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:26:43.581966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:26:43.581966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:26:43.581966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:26:43.581966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:26:43.581966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:26:43.581966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:43.581966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 531/1075] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:26:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:43.584304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825e600-2df7-4f28-a9ed-e6cb04354d3b None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:43.692555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825e600-2df7-4f28-a9ed-e6cb04354d3b None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:43.706009 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:43.729189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472e631-fc08-49b1-9e4a-354f707abd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:43.729867 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472e631-fc08-49b1-9e4a-354f707abd5c None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:43.730160 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472e631-fc08-49b1-9e4a-354f707abd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:43.730441 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472e631-fc08-49b1-9e4a-354f707abd5c None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:43.731216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472e631-fc08-49b1-9e4a-354f707abd5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:43.731609 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472e631-fc08-49b1-9e4a-354f707abd5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:43.732932 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472e631-fc08-49b1-9e4a-354f707abd5c None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:43.747153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 545/1076] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:26:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:43.748732 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a54cb-bb04-4e8a-9080-7fab116da01c None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:43.847042 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419af4b5-8498-4a2a-991e-1cd30b81e1b5 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:43.847939 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419af4b5-8498-4a2a-991e-1cd30b81e1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:43.848374 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419af4b5-8498-4a2a-991e-1cd30b81e1b5 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:43.849878 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 546/1077] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:43.850696 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a54cb-bb04-4e8a-9080-7fab116da01c None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:43.856648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c99c63-2c02-48ae-9b44-943dd2628f91 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:43.856929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c99c63-2c02-48ae-9b44-943dd2628f91 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:43.857208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c99c63-2c02-48ae-9b44-943dd2628f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:43.874746 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-14c99c63-2c02-48ae-9b44-943dd2628f91 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:43.876537 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-14c99c63-2c02-48ae-9b44-943dd2628f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:43.886735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e394b8-6e4f-4c0e-96a4-28e87ec42015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:43.887638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e394b8-6e4f-4c0e-96a4-28e87ec42015 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:43.887927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e394b8-6e4f-4c0e-96a4-28e87ec42015 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:43.888204 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e394b8-6e4f-4c0e-96a4-28e87ec42015 None admin] PATH_INFO: `/v3/users/459a9f0ae7aa4580823e96959803a70e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:43.889389 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e394b8-6e4f-4c0e-96a4-28e87ec42015 None admin] RBAC: Authorizing `identity:get_user(user_id=459a9f0ae7aa4580823e96959803a70e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:43.890818 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e394b8-6e4f-4c0e-96a4-28e87ec42015 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:43.897583 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 532/1078] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:26:43 2022] GET /identity/v3/users/459a9f0ae7aa4580823e96959803a70e => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:43.898583 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e394b8-6e4f-4c0e-96a4-28e87ec42015 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:43.937683 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:43.951312 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 547/1079] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:43.969395 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c99c63-2c02-48ae-9b44-943dd2628f91 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:44.012120 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e394b8-6e4f-4c0e-96a4-28e87ec42015 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:44.050405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2d469-1db3-4942-8fb5-3a3e4c620fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:44.051632 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2d469-1db3-4942-8fb5-3a3e4c620fdc None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:44.052072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2d469-1db3-4942-8fb5-3a3e4c620fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:44.052357 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2d469-1db3-4942-8fb5-3a3e4c620fdc None admin] PATH_INFO: `/v3/projects/83c4cb575aab4909b2aaf3f0d7763882` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:44.053605 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2d469-1db3-4942-8fb5-3a3e4c620fdc None admin] RBAC: Authorizing `identity:get_project(project_id=83c4cb575aab4909b2aaf3f0d7763882)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:44.055075 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2d469-1db3-4942-8fb5-3a3e4c620fdc None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:44.061795 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 533/1080] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:26:43 2022] GET /identity/v3/projects/83c4cb575aab4909b2aaf3f0d7763882 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:44.063908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2d469-1db3-4942-8fb5-3a3e4c620fdc None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:44.079553 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c99c63-2c02-48ae-9b44-943dd2628f91 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:44.081909 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:44.115581 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb2633-f6b5-41f1-91ed-2ace57760369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:44.116158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb2633-f6b5-41f1-91ed-2ace57760369 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:44.116443 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb2633-f6b5-41f1-91ed-2ace57760369 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:44.116722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb2633-f6b5-41f1-91ed-2ace57760369 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:44.177236 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2d469-1db3-4942-8fb5-3a3e4c620fdc None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:44.180519 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:44.192441 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb2633-f6b5-41f1-91ed-2ace57760369 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:44.194315 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb2633-f6b5-41f1-91ed-2ace57760369 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:44.214158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54603ca2-8f7e-4754-8e9d-d592767394b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:44.215049 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54603ca2-8f7e-4754-8e9d-d592767394b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:44.220035 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54603ca2-8f7e-4754-8e9d-d592767394b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:44.220035 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54603ca2-8f7e-4754-8e9d-d592767394b4 None admin] PATH_INFO: `/v3/projects/83c4cb575aab4909b2aaf3f0d7763882/users/459a9f0ae7aa4580823e96959803a70e/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:44.222503 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54603ca2-8f7e-4754-8e9d-d592767394b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=83c4cb575aab4909b2aaf3f0d7763882, user_id=459a9f0ae7aa4580823e96959803a70e, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:44.223994 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54603ca2-8f7e-4754-8e9d-d592767394b4 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:44.247308 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 534/1081] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:26:44 2022] PUT /identity/v3/projects/83c4cb575aab4909b2aaf3f0d7763882/users/459a9f0ae7aa4580823e96959803a70e/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:26:44.319134 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 548/1082] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:26:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 09:26:44.325602 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54603ca2-8f7e-4754-8e9d-d592767394b4 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:44.436701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54603ca2-8f7e-4754-8e9d-d592767394b4 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:44.471577 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fab9a0-23fa-47c9-bdae-0206bb5afc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:44.472378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fab9a0-23fa-47c9-bdae-0206bb5afc63 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:44.472661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fab9a0-23fa-47c9-bdae-0206bb5afc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:44.472938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fab9a0-23fa-47c9-bdae-0206bb5afc63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:44.483839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fab9a0-23fa-47c9-bdae-0206bb5afc63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:44.485315 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fab9a0-23fa-47c9-bdae-0206bb5afc63 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:44.503239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-a9fab9a0-23fa-47c9-bdae-0206bb5afc63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:44.503239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:44.503239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:44.503239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:44.503239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:44.503239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:44.503239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:44.503239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:44.503239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:44.503239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:44.503239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:44.503239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:44.503239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:44.503239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:44.503239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:44.504346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:44.504346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:44.504346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:44.504346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:44.504346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:44.504346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:44.504346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:44.504346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:44.504346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:44.504346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:44.504346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:44.504346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:44.504346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:44.504346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:44.504346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:44.504346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:44.504346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:44.510624 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:44.510624 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:44.510624 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:44.510624 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:44.510624 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 535/1083] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:44.512405 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb2633-f6b5-41f1-91ed-2ace57760369 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:44.515679 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:44.616033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb2633-f6b5-41f1-91ed-2ace57760369 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:44.650993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3f21d-4643-4287-a468-7bd044763eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:44.651701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3f21d-4643-4287-a468-7bd044763eae None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:44.651984 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3f21d-4643-4287-a468-7bd044763eae None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:44.652263 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3f21d-4643-4287-a468-7bd044763eae None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:44.652979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3f21d-4643-4287-a468-7bd044763eae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:44.653288 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3f21d-4643-4287-a468-7bd044763eae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:44.654663 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3f21d-4643-4287-a468-7bd044763eae None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:44.666029 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 549/1084] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:45.368099 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f377617-2368-48fc-bcfc-cfbaa606d807 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:45.368611 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f377617-2368-48fc-bcfc-cfbaa606d807 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:45.368611 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f377617-2368-48fc-bcfc-cfbaa606d807 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:45.369945 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 536/1085] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:45.375207 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f936a-b5b5-4842-ad5d-1d85ce5e2939 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:45.375710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f936a-b5b5-4842-ad5d-1d85ce5e2939 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:45.376446 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f936a-b5b5-4842-ad5d-1d85ce5e2939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:45.393444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-502f936a-b5b5-4842-ad5d-1d85ce5e2939 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:45.394641 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-502f936a-b5b5-4842-ad5d-1d85ce5e2939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:45.452142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:45.460825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 550/1086] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:45.483924 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f377617-2368-48fc-bcfc-cfbaa606d807 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:45.503464 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:45.585043 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f377617-2368-48fc-bcfc-cfbaa606d807 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:45.617253 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed24a0e-9a89-485a-8be9-146782fde65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:45.618047 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed24a0e-9a89-485a-8be9-146782fde65f None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:45.618376 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed24a0e-9a89-485a-8be9-146782fde65f None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:45.618598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed24a0e-9a89-485a-8be9-146782fde65f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:45.630066 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed24a0e-9a89-485a-8be9-146782fde65f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:26:45.638201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-5ed24a0e-9a89-485a-8be9-146782fde65f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:26:45.638201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:45.638201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:45.638201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:45.638201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:45.638201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:45.638201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:45.638201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:45.638201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:45.638201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:45.638201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:45.638201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:45.638201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:26:45.638201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:26:45.638201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:26:45.638201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:26:45.639358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:26:45.639358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:26:45.639358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:26:45.639358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:26:45.639358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:45.639358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:45.639358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:45.639358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:45.639358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:45.639358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:45.639358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:45.639358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:45.639358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:45.639358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:45.639358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:45.639358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:45.640323 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:45.640323 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:45.640323 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:45.640323 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:45.640323 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:26:45.640323 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:26:45.640323 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:26:45.640323 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:26:45.640323 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:26:45.640323 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:26:45.640323 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 09:26:45.640323 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:45.640323 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 537/1087] 10.222.0.41 () {56 vars in 1120 bytes} [Fri May 27 09:26:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:45.645300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f936a-b5b5-4842-ad5d-1d85ce5e2939 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:45.739880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f936a-b5b5-4842-ad5d-1d85ce5e2939 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:45.774464 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c99c22-5304-42d5-909d-d71eb6801d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:45.775137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c99c22-5304-42d5-909d-d71eb6801d70 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:45.775457 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c99c22-5304-42d5-909d-d71eb6801d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:45.775736 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c99c22-5304-42d5-909d-d71eb6801d70 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:45.776477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c99c22-5304-42d5-909d-d71eb6801d70 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:45.776788 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c99c22-5304-42d5-909d-d71eb6801d70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:45.778160 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c99c22-5304-42d5-909d-d71eb6801d70 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:45.786658 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 551/1088] 10.222.0.41 () {56 vars in 1115 bytes} [Fri May 27 09:26:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:45.792261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed24a0e-9a89-485a-8be9-146782fde65f None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:45.867218 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:45.891094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed24a0e-9a89-485a-8be9-146782fde65f None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:45.924516 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab92cb5-c12e-4803-899d-cedc95de1875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:45.925302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab92cb5-c12e-4803-899d-cedc95de1875 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:45.925584 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab92cb5-c12e-4803-899d-cedc95de1875 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:45.925857 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab92cb5-c12e-4803-899d-cedc95de1875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:45.935837 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab92cb5-c12e-4803-899d-cedc95de1875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:45.937276 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab92cb5-c12e-4803-899d-cedc95de1875 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:45.955522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-0ab92cb5-c12e-4803-899d-cedc95de1875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:45.955522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:45.955522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:45.955522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:45.955522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:45.955522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:45.955522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:45.955522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:45.955522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:45.955522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:45.955522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:45.955522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:45.955522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:45.955522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:45.955522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:45.956439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:45.956439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:45.956439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:45.956439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:45.956439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:45.956439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:45.956439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:45.956439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:45.956439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:45.956439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:45.956439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:45.956439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:45.956439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:45.956439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:45.956439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:45.956439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:45.956439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:45.957318 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:45.957318 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:45.957318 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:45.957318 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:45.957318 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 538/1089] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:45.962363 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c99c22-5304-42d5-909d-d71eb6801d70 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:46.018534 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:46.062911 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c99c22-5304-42d5-909d-d71eb6801d70 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:46.097169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91115629-1a60-477b-a59b-182f3efb2f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:46.097839 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91115629-1a60-477b-a59b-182f3efb2f7c None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:46.098124 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91115629-1a60-477b-a59b-182f3efb2f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:46.098407 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91115629-1a60-477b-a59b-182f3efb2f7c None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:46.099125 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91115629-1a60-477b-a59b-182f3efb2f7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:46.099471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91115629-1a60-477b-a59b-182f3efb2f7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:46.100859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91115629-1a60-477b-a59b-182f3efb2f7c None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:46.112768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 552/1090] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:46.118273 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab92cb5-c12e-4803-899d-cedc95de1875 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:46.220737 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab92cb5-c12e-4803-899d-cedc95de1875 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:46.246662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:46.256040 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c896323-b5cc-47a1-aac1-e37843abc839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:46.256861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c896323-b5cc-47a1-aac1-e37843abc839 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:46.257147 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c896323-b5cc-47a1-aac1-e37843abc839 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:46.257427 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c896323-b5cc-47a1-aac1-e37843abc839 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:46.266201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c896323-b5cc-47a1-aac1-e37843abc839 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:46.267781 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c896323-b5cc-47a1-aac1-e37843abc839 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:46.283114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-5c896323-b5cc-47a1-aac1-e37843abc839 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 09:26:46.283114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:46.283114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:46.283114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:46.283114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:46.283114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:46.283114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:46.283114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:46.283114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:46.283114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:46.283114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:46.283114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:46.283114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:26:46.283114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:26:46.283114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:26:46.283114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:26:46.284208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:46.284208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:46.284208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:26:46.284208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:46.284208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:26:46.284208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:26:46.284208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:46.284208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:46.284208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:46.284208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:46.284208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:46.284208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:46.284208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:46.284208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:46.284208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:46.284208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:46.284208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:46.284208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:46.285151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:46.285151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:46.285151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:26:46.285151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:26:46.285151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:26:46.285151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:26:46.285151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:26:46.285151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:26:46.285151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 09:26:46.285151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:46.285151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 539/1091] 10.222.0.41 () {56 vars in 1093 bytes} [Fri May 27 09:26:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:26:46.290150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91115629-1a60-477b-a59b-182f3efb2f7c None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:46.387573 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91115629-1a60-477b-a59b-182f3efb2f7c None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:46.403831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:46.422347 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f422046-96c0-41c1-8c45-567745ef005d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:46.423054 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f422046-96c0-41c1-8c45-567745ef005d None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:46.423363 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f422046-96c0-41c1-8c45-567745ef005d None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:46.423642 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f422046-96c0-41c1-8c45-567745ef005d None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:46.424467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f422046-96c0-41c1-8c45-567745ef005d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:46.424777 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f422046-96c0-41c1-8c45-567745ef005d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:46.426204 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f422046-96c0-41c1-8c45-567745ef005d None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:46.443196 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 553/1092] 10.222.0.41 () {56 vars in 1133 bytes} [Fri May 27 09:26:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:46.443388 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e29b9b-fcf7-417a-abe0-3da31d4da92e None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:46.443817 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e29b9b-fcf7-417a-abe0-3da31d4da92e None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:46.443817 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e29b9b-fcf7-417a-abe0-3da31d4da92e None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:46.445036 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 540/1093] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:46.448424 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f422046-96c0-41c1-8c45-567745ef005d None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:46.449927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f397b12-cd4b-496f-b4a3-0739963ee8d7 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:46.450280 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f397b12-cd4b-496f-b4a3-0739963ee8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:46.450624 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f397b12-cd4b-496f-b4a3-0739963ee8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:46.467455 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-7f397b12-cd4b-496f-b4a3-0739963ee8d7 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:46.468624 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-7f397b12-cd4b-496f-b4a3-0739963ee8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:46.535192 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 541/1094] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 09:26:46.547201 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f422046-96c0-41c1-8c45-567745ef005d None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:46.558393 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f397b12-cd4b-496f-b4a3-0739963ee8d7 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:46.581869 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8d945-ea75-4898-bdfe-b1a80e20b098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:46.582522 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8d945-ea75-4898-bdfe-b1a80e20b098 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:46.582804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8d945-ea75-4898-bdfe-b1a80e20b098 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:46.583089 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8d945-ea75-4898-bdfe-b1a80e20b098 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:46.624392 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:46.651759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8d945-ea75-4898-bdfe-b1a80e20b098 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:46.653217 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8d945-ea75-4898-bdfe-b1a80e20b098 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:46.659626 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f397b12-cd4b-496f-b4a3-0739963ee8d7 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:46.676736 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:46.694911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794261a-c466-4ca6-b651-49166692d11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:46.695731 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794261a-c466-4ca6-b651-49166692d11d None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:46.696009 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794261a-c466-4ca6-b651-49166692d11d None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:46.696276 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794261a-c466-4ca6-b651-49166692d11d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:46.706737 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794261a-c466-4ca6-b651-49166692d11d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:26:46.714230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-f794261a-c466-4ca6-b651-49166692d11d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:26:46.714230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:46.714230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:46.714230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:46.714230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:46.714230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:46.714230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:46.714230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:46.714230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:46.714230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:46.714230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:46.714230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:46.714230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:26:46.714230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:26:46.714230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:26:46.714230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:26:46.715365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:26:46.715365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:26:46.715365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:26:46.715365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:26:46.715365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:46.715365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:46.715365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:46.715365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:46.715365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:46.715365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:46.715365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:46.715365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:26:46.715365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:46.715365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:46.715365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:46.715365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:46.716787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:46.716787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:46.716787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:46.716787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:46.716787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:26:46.716787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:26:46.716787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:26:46.716787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:26:46.716787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:26:46.716787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:26:46.716787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:26:46.716787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:26:46.716787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 542/1095] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:26:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:46.721219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794261a-c466-4ca6-b651-49166692d11d None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:46.757270 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 554/1096] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:26:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:26:46.762947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8d945-ea75-4898-bdfe-b1a80e20b098 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:46.820447 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794261a-c466-4ca6-b651-49166692d11d None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:46.834405 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:46.853057 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45f3a9-9b5b-4c6f-a22e-1724e0736631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:46.853714 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45f3a9-9b5b-4c6f-a22e-1724e0736631 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:46.854002 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45f3a9-9b5b-4c6f-a22e-1724e0736631 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:46.854278 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45f3a9-9b5b-4c6f-a22e-1724e0736631 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:46.855004 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45f3a9-9b5b-4c6f-a22e-1724e0736631 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:46.855339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45f3a9-9b5b-4c6f-a22e-1724e0736631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:46.856704 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45f3a9-9b5b-4c6f-a22e-1724e0736631 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:46.860467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8d945-ea75-4898-bdfe-b1a80e20b098 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:46.864915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 543/1097] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:26:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:46.870614 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45f3a9-9b5b-4c6f-a22e-1724e0736631 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:46.895046 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f9f81-09e7-4ac5-aafd-a93f932ffb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:46.895857 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f9f81-09e7-4ac5-aafd-a93f932ffb37 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:46.896136 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f9f81-09e7-4ac5-aafd-a93f932ffb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:46.896408 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f9f81-09e7-4ac5-aafd-a93f932ffb37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:46.906378 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f9f81-09e7-4ac5-aafd-a93f932ffb37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:46.907878 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f9f81-09e7-4ac5-aafd-a93f932ffb37 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:46.911771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:46.926159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-918f9f81-09e7-4ac5-aafd-a93f932ffb37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:46.926159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:46.926159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:46.926159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:46.926159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:46.926159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:46.926159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:46.926159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:46.926159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:46.926159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:46.926159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:46.926159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:46.926159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:26:46.926159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:26:46.926159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:26:46.927229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:26:46.927229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:46.927229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:46.927229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:46.927229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:46.927229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:46.927229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:46.927229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:46.927229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:46.927229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:46.927229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:46.927229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:46.927229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:46.927229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:46.927229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:46.927229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:46.927229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:46.928174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:26:46.928174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:26:46.928174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:26:46.928174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:46.928174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 555/1098] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:46.932898 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f9f81-09e7-4ac5-aafd-a93f932ffb37 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:46.972798 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45f3a9-9b5b-4c6f-a22e-1724e0736631 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:47.006785 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d31a46-d1b0-46cc-ab85-e01db7c755e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:47.007696 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d31a46-d1b0-46cc-ab85-e01db7c755e4 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:47.007978 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d31a46-d1b0-46cc-ab85-e01db7c755e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:47.008252 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d31a46-d1b0-46cc-ab85-e01db7c755e4 None admin] PATH_INFO: `/v3/users/459a9f0ae7aa4580823e96959803a70e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:47.009428 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d31a46-d1b0-46cc-ab85-e01db7c755e4 None admin] RBAC: Authorizing `identity:get_user(user_id=459a9f0ae7aa4580823e96959803a70e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:47.012824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d31a46-d1b0-46cc-ab85-e01db7c755e4 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:47.012824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 544/1099] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:26:46 2022] GET /identity/v3/users/459a9f0ae7aa4580823e96959803a70e => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:47.018406 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d31a46-d1b0-46cc-ab85-e01db7c755e4 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:47.028330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f9f81-09e7-4ac5-aafd-a93f932ffb37 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:47.054278 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:47.064625 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c7d4c-1db1-4d38-b9a9-1f7d8ad81665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:47.065804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c7d4c-1db1-4d38-b9a9-1f7d8ad81665 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:47.065804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c7d4c-1db1-4d38-b9a9-1f7d8ad81665 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:47.065804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c7d4c-1db1-4d38-b9a9-1f7d8ad81665 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:47.066516 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c7d4c-1db1-4d38-b9a9-1f7d8ad81665 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:47.066822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c7d4c-1db1-4d38-b9a9-1f7d8ad81665 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:47.068245 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c7d4c-1db1-4d38-b9a9-1f7d8ad81665 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:47.079476 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 556/1100] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:47.084814 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c7d4c-1db1-4d38-b9a9-1f7d8ad81665 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:47.123006 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d31a46-d1b0-46cc-ab85-e01db7c755e4 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:47.132496 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:47.156946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9da13-ad5b-44c8-873b-6b40b7edb08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:47.157600 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9da13-ad5b-44c8-873b-6b40b7edb08f None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:47.157880 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9da13-ad5b-44c8-873b-6b40b7edb08f None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:47.158152 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9da13-ad5b-44c8-873b-6b40b7edb08f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:47.181979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c7d4c-1db1-4d38-b9a9-1f7d8ad81665 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:47.215510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e05d7-96c6-449b-af35-c850e8341b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:47.216305 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e05d7-96c6-449b-af35-c850e8341b1a None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:47.216590 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e05d7-96c6-449b-af35-c850e8341b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:47.216868 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e05d7-96c6-449b-af35-c850e8341b1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:47.223831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9da13-ad5b-44c8-873b-6b40b7edb08f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:47.224014 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e05d7-96c6-449b-af35-c850e8341b1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:47.225276 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9da13-ad5b-44c8-873b-6b40b7edb08f None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:47.225444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e05d7-96c6-449b-af35-c850e8341b1a None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:47.239865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-8c4e05d7-96c6-449b-af35-c850e8341b1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:47.239865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:26:47.239865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:26:47.239865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:26:47.239865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:26:47.239865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:26:47.239865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:26:47.239865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:26:47.239865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:26:47.239865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:26:47.239865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:26:47.239865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:26:47.239865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:26:47.239865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:26:47.239865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:26:47.240754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:26:47.240754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:26:47.240754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:26:47.240754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:26:47.240754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:26:47.240754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:26:47.240754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:26:47.240754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:26:47.240754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:26:47.240754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:26:47.240754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:26:47.240754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:26:47.240754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:26:47.240754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:26:47.240754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:26:47.240754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:26:47.240754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:26:47.241824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:26:47.241824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:26:47.241824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:26:47.241824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:26:47.241824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:26:47.241824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:26:47.241824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:26:47.241824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:26:47.241824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 557/1101] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:26:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:26:47.246739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e05d7-96c6-449b-af35-c850e8341b1a None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:47.292640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:47.322314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 545/1102] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:26:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 09:26:47.328103 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9da13-ad5b-44c8-873b-6b40b7edb08f None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:47.337884 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:47.347120 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e05d7-96c6-449b-af35-c850e8341b1a None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:47.380434 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37df5c7-9da2-4a23-bdbb-99b1ba04e064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:47.381086 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37df5c7-9da2-4a23-bdbb-99b1ba04e064 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:47.381373 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37df5c7-9da2-4a23-bdbb-99b1ba04e064 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:47.381653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37df5c7-9da2-4a23-bdbb-99b1ba04e064 None admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:47.382425 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37df5c7-9da2-4a23-bdbb-99b1ba04e064 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:47.382740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37df5c7-9da2-4a23-bdbb-99b1ba04e064 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:47.384203 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37df5c7-9da2-4a23-bdbb-99b1ba04e064 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:47.396936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 558/1103] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:26:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:47.402873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37df5c7-9da2-4a23-bdbb-99b1ba04e064 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:47.425460 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9da13-ad5b-44c8-873b-6b40b7edb08f None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:47.463837 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eacd9e-b288-4d1a-9457-34410cfb2ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:47.464692 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eacd9e-b288-4d1a-9457-34410cfb2ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:47.464978 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eacd9e-b288-4d1a-9457-34410cfb2ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:47.465256 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eacd9e-b288-4d1a-9457-34410cfb2ef5 None admin] PATH_INFO: `/v3/projects/83c4cb575aab4909b2aaf3f0d7763882` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:47.466426 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eacd9e-b288-4d1a-9457-34410cfb2ef5 None admin] RBAC: Authorizing `identity:get_project(project_id=83c4cb575aab4909b2aaf3f0d7763882)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:47.467888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eacd9e-b288-4d1a-9457-34410cfb2ef5 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:47.469586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 546/1104] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:26:47 2022] GET /identity/v3/projects/83c4cb575aab4909b2aaf3f0d7763882 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:47.475483 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eacd9e-b288-4d1a-9457-34410cfb2ef5 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:47.503244 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37df5c7-9da2-4a23-bdbb-99b1ba04e064 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:47.510137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:47.538142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdf0b8-4ecd-4e4d-99d9-799a0fdf0366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:47.538886 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdf0b8-4ecd-4e4d-99d9-799a0fdf0366 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:47.539242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdf0b8-4ecd-4e4d-99d9-799a0fdf0366 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:47.539644 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdf0b8-4ecd-4e4d-99d9-799a0fdf0366 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:47.540477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdf0b8-4ecd-4e4d-99d9-799a0fdf0366 None admin] RBAC: Adding query filter params (role.id=582df05c56014989bfe8f0e5522d0633, scope.project.id=b1d802dc0211467fa4e709cd01d411dc, user.id=d2b1c12e88c549208894fc0dd0c60b88) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:47.540795 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdf0b8-4ecd-4e4d-99d9-799a0fdf0366 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:47.542236 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdf0b8-4ecd-4e4d-99d9-799a0fdf0366 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:47.548094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 559/1105] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:26:47 2022] GET /identity/v3/role_assignments?user.id=d2b1c12e88c549208894fc0dd0c60b88&scope.project.id=b1d802dc0211467fa4e709cd01d411dc&role.id=582df05c56014989bfe8f0e5522d0633 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:47.551457 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:47.576910 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eacd9e-b288-4d1a-9457-34410cfb2ef5 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:47.613506 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3aebe1-56da-47a9-9ea4-b31c2ccb2073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:47.614097 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3aebe1-56da-47a9-9ea4-b31c2ccb2073 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:47.614380 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3aebe1-56da-47a9-9ea4-b31c2ccb2073 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:47.614655 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3aebe1-56da-47a9-9ea4-b31c2ccb2073 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:47.615530 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3aebe1-56da-47a9-9ea4-b31c2ccb2073 None admin] RBAC: Adding query filter params (role.id=bb6c5483d9be4a16ac64750536c5e2e2, scope.project.id=83c4cb575aab4909b2aaf3f0d7763882, user.id=459a9f0ae7aa4580823e96959803a70e) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:47.615849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3aebe1-56da-47a9-9ea4-b31c2ccb2073 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:47.617317 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3aebe1-56da-47a9-9ea4-b31c2ccb2073 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:47.624018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 547/1106] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:26:47 2022] GET /identity/v3/role_assignments?user.id=459a9f0ae7aa4580823e96959803a70e&scope.project.id=83c4cb575aab4909b2aaf3f0d7763882&role.id=bb6c5483d9be4a16ac64750536c5e2e2 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:49.850359 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35ea71-70f3-44b1-95b7-cea355423056 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:49.850887 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35ea71-70f3-44b1-95b7-cea355423056 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:49.850887 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35ea71-70f3-44b1-95b7-cea355423056 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:49.852300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 560/1107] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:26:49.857610 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd025b-48d4-4ae2-86d6-659b1760ed3d None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:49.857995 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd025b-48d4-4ae2-86d6-659b1760ed3d None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:49.858190 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd025b-48d4-4ae2-86d6-659b1760ed3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:49.876370 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-f3cd025b-48d4-4ae2-86d6-659b1760ed3d None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:49.877562 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f3cd025b-48d4-4ae2-86d6-659b1760ed3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:49.943222 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 548/1108] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:49.967212 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35ea71-70f3-44b1-95b7-cea355423056 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:50.070144 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35ea71-70f3-44b1-95b7-cea355423056 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:50.102110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7c499-d33c-4434-b22d-9c3c7823941c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:50.102838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7c499-d33c-4434-b22d-9c3c7823941c None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:50.103121 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7c499-d33c-4434-b22d-9c3c7823941c None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:50.103430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7c499-d33c-4434-b22d-9c3c7823941c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:50.104597 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7c499-d33c-4434-b22d-9c3c7823941c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:50.106038 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7c499-d33c-4434-b22d-9c3c7823941c None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:50.107655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 561/1109] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:26:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:50.114175 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd025b-48d4-4ae2-86d6-659b1760ed3d None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:50.179907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:50.210768 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd025b-48d4-4ae2-86d6-659b1760ed3d None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:50.243186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b3cff-9cde-413c-9476-29765b76f4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:50.243879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b3cff-9cde-413c-9476-29765b76f4ac None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:50.244157 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b3cff-9cde-413c-9476-29765b76f4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:50.244429 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b3cff-9cde-413c-9476-29765b76f4ac None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:50.245124 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b3cff-9cde-413c-9476-29765b76f4ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:50.246593 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b3cff-9cde-413c-9476-29765b76f4ac None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:50.266029 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 549/1110] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 09:26:50 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:26:52.509103 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3e1db-03d8-4804-8953-fdd846d50d94 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:52.509622 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3e1db-03d8-4804-8953-fdd846d50d94 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:52.509622 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3e1db-03d8-4804-8953-fdd846d50d94 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:52.510953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 562/1111] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:52.516202 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74568332-6a1d-4d08-9ae1-140b27128100 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:52.516633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74568332-6a1d-4d08-9ae1-140b27128100 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:52.516751 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74568332-6a1d-4d08-9ae1-140b27128100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:52.533052 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-74568332-6a1d-4d08-9ae1-140b27128100 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:52.534216 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-74568332-6a1d-4d08-9ae1-140b27128100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:52.598531 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 550/1112] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:52.622630 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3e1db-03d8-4804-8953-fdd846d50d94 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:52.662621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:52.722527 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3e1db-03d8-4804-8953-fdd846d50d94 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:52.755530 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7f5f8-0867-4c0c-8557-4ee36609ed89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:52.756634 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7f5f8-0867-4c0c-8557-4ee36609ed89 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:52.756822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7f5f8-0867-4c0c-8557-4ee36609ed89 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:52.757223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7f5f8-0867-4c0c-8557-4ee36609ed89 None admin] PATH_INFO: `/v3/roles/580d60e140704327b90a80fc59a2165c` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:52.758712 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7f5f8-0867-4c0c-8557-4ee36609ed89 None admin] RBAC: Authorizing `identity:get_role(role_id=580d60e140704327b90a80fc59a2165c)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:52.760352 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7f5f8-0867-4c0c-8557-4ee36609ed89 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:52.761631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 563/1113] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:26:52 2022] GET /identity/v3/roles/580d60e140704327b90a80fc59a2165c => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:52.767992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74568332-6a1d-4d08-9ae1-140b27128100 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:52.821475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:52.864276 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74568332-6a1d-4d08-9ae1-140b27128100 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:52.897477 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78104f53-52a5-4489-97cd-cf607b51b17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:52.898337 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78104f53-52a5-4489-97cd-cf607b51b17d None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:52.898622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78104f53-52a5-4489-97cd-cf607b51b17d None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:52.898900 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78104f53-52a5-4489-97cd-cf607b51b17d None admin] PATH_INFO: `/v3/users/cd0dd1955a394f3e88f1d709b44e7601` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:52.911459 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78104f53-52a5-4489-97cd-cf607b51b17d None admin] RBAC: Authorizing `identity:get_user(user_id=cd0dd1955a394f3e88f1d709b44e7601)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:52.912889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78104f53-52a5-4489-97cd-cf607b51b17d None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:52.914515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 551/1114] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:26:52 2022] GET /identity/v3/users/cd0dd1955a394f3e88f1d709b44e7601 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:26:52.920174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7f5f8-0867-4c0c-8557-4ee36609ed89 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:53.016685 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7f5f8-0867-4c0c-8557-4ee36609ed89 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:53.023195 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:53.049784 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b410355-cdc7-4522-93e9-e4fcc3b76ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:53.050424 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b410355-cdc7-4522-93e9-e4fcc3b76ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:53.050708 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b410355-cdc7-4522-93e9-e4fcc3b76ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:53.050984 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b410355-cdc7-4522-93e9-e4fcc3b76ce5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:53.115567 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b410355-cdc7-4522-93e9-e4fcc3b76ce5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:53.117007 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b410355-cdc7-4522-93e9-e4fcc3b76ce5 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:53.210301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 564/1115] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:26:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:26:53.216086 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78104f53-52a5-4489-97cd-cf607b51b17d None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:53.312969 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78104f53-52a5-4489-97cd-cf607b51b17d None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:53.326437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:53.347641 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b2181-825c-4829-8148-b718c4412cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:53.348490 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b2181-825c-4829-8148-b718c4412cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:53.348775 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b2181-825c-4829-8148-b718c4412cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:53.349049 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b2181-825c-4829-8148-b718c4412cf6 None admin] PATH_INFO: `/v3/projects/83c4cb575aab4909b2aaf3f0d7763882` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:53.350210 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b2181-825c-4829-8148-b718c4412cf6 None admin] RBAC: Authorizing `identity:get_project(project_id=83c4cb575aab4909b2aaf3f0d7763882)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:53.351670 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b2181-825c-4829-8148-b718c4412cf6 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:53.353335 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 552/1116] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:26:53 2022] GET /identity/v3/projects/83c4cb575aab4909b2aaf3f0d7763882 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:53.359423 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b410355-cdc7-4522-93e9-e4fcc3b76ce5 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:53.367211 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:53.456659 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b410355-cdc7-4522-93e9-e4fcc3b76ce5 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:53.490530 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aced0c-5a47-4002-9567-0d7bc3a8875b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:53.491168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aced0c-5a47-4002-9567-0d7bc3a8875b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:53.491479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aced0c-5a47-4002-9567-0d7bc3a8875b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:53.491754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aced0c-5a47-4002-9567-0d7bc3a8875b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:53.492569 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aced0c-5a47-4002-9567-0d7bc3a8875b None admin] RBAC: Adding query filter params (role.id=580d60e140704327b90a80fc59a2165c, scope.project.id=83c4cb575aab4909b2aaf3f0d7763882, user.id=cd0dd1955a394f3e88f1d709b44e7601) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:53.492881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aced0c-5a47-4002-9567-0d7bc3a8875b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:53.494293 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aced0c-5a47-4002-9567-0d7bc3a8875b None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:53.499625 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 565/1117] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:26:53 2022] GET /identity/v3/role_assignments?user.id=cd0dd1955a394f3e88f1d709b44e7601&scope.project.id=83c4cb575aab4909b2aaf3f0d7763882&role.id=580d60e140704327b90a80fc59a2165c => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:55.647685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69ce7e-f4fe-4fee-81e6-f3fec90c3d76 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:55.648213 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69ce7e-f4fe-4fee-81e6-f3fec90c3d76 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:55.648305 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69ce7e-f4fe-4fee-81e6-f3fec90c3d76 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:55.649603 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 553/1118] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:55.654680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830a375-9ebf-4dff-a081-aa0689bd270b None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:55.655068 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830a375-9ebf-4dff-a081-aa0689bd270b None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:55.655226 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830a375-9ebf-4dff-a081-aa0689bd270b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:55.673058 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-0830a375-9ebf-4dff-a081-aa0689bd270b None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:55.674271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-0830a375-9ebf-4dff-a081-aa0689bd270b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:55.734777 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:55.740243 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 566/1119] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:55.763425 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69ce7e-f4fe-4fee-81e6-f3fec90c3d76 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:55.863847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69ce7e-f4fe-4fee-81e6-f3fec90c3d76 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:55.897570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053482f1-49b9-48c2-b5cf-51014fe17f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:55.898477 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053482f1-49b9-48c2-b5cf-51014fe17f94 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:55.898702 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053482f1-49b9-48c2-b5cf-51014fe17f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:55.898977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053482f1-49b9-48c2-b5cf-51014fe17f94 None admin] PATH_INFO: `/v3/roles/580d60e140704327b90a80fc59a2165c` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:55.900444 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053482f1-49b9-48c2-b5cf-51014fe17f94 None admin] RBAC: Authorizing `identity:get_role(role_id=580d60e140704327b90a80fc59a2165c)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:55.901807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053482f1-49b9-48c2-b5cf-51014fe17f94 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:55.903163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 554/1120] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:26:55 2022] GET /identity/v3/roles/580d60e140704327b90a80fc59a2165c => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:55.908960 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830a375-9ebf-4dff-a081-aa0689bd270b None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:56.008222 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830a375-9ebf-4dff-a081-aa0689bd270b None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:56.041259 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168e57b-760e-4478-b21e-f9d7224e2404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:56.042123 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168e57b-760e-4478-b21e-f9d7224e2404 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:56.042403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168e57b-760e-4478-b21e-f9d7224e2404 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:56.042676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168e57b-760e-4478-b21e-f9d7224e2404 None admin] PATH_INFO: `/v3/users/cd0dd1955a394f3e88f1d709b44e7601` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:56.043868 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168e57b-760e-4478-b21e-f9d7224e2404 None admin] RBAC: Authorizing `identity:get_user(user_id=cd0dd1955a394f3e88f1d709b44e7601)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:56.045293 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168e57b-760e-4478-b21e-f9d7224e2404 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:56.046881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 567/1121] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:26:55 2022] GET /identity/v3/users/cd0dd1955a394f3e88f1d709b44e7601 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:56.053190 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053482f1-49b9-48c2-b5cf-51014fe17f94 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:56.101351 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:56.148958 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053482f1-49b9-48c2-b5cf-51014fe17f94 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:56.181897 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f8d35-9fb0-42cd-96ff-0ec099d689bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:56.182750 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f8d35-9fb0-42cd-96ff-0ec099d689bb None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:56.183034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f8d35-9fb0-42cd-96ff-0ec099d689bb None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:56.183395 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f8d35-9fb0-42cd-96ff-0ec099d689bb None admin] PATH_INFO: `/v3/projects/83c4cb575aab4909b2aaf3f0d7763882` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:56.184552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f8d35-9fb0-42cd-96ff-0ec099d689bb None admin] RBAC: Authorizing `identity:get_project(project_id=83c4cb575aab4909b2aaf3f0d7763882)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:56.185964 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f8d35-9fb0-42cd-96ff-0ec099d689bb None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:56.187659 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 555/1122] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:26:56 2022] GET /identity/v3/projects/83c4cb575aab4909b2aaf3f0d7763882 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:56.193487 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168e57b-760e-4478-b21e-f9d7224e2404 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:56.257447 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:56.288880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168e57b-760e-4478-b21e-f9d7224e2404 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:56.321142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d07cd-48cb-4ee2-b772-b9d81d35ee91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:56.322014 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d07cd-48cb-4ee2-b772-b9d81d35ee91 None admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:56.322295 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d07cd-48cb-4ee2-b772-b9d81d35ee91 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:56.322569 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d07cd-48cb-4ee2-b772-b9d81d35ee91 None admin] PATH_INFO: `/v3/projects/83c4cb575aab4909b2aaf3f0d7763882/users/cd0dd1955a394f3e88f1d709b44e7601/roles/580d60e140704327b90a80fc59a2165c` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:56.324748 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d07cd-48cb-4ee2-b772-b9d81d35ee91 None admin] RBAC: Authorizing `identity:create_grant(project_id=83c4cb575aab4909b2aaf3f0d7763882, user_id=cd0dd1955a394f3e88f1d709b44e7601, role_id=580d60e140704327b90a80fc59a2165c)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:56.326179 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d07cd-48cb-4ee2-b772-b9d81d35ee91 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:56.339018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 568/1123] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:26:56 2022] PUT /identity/v3/projects/83c4cb575aab4909b2aaf3f0d7763882/users/cd0dd1955a394f3e88f1d709b44e7601/roles/580d60e140704327b90a80fc59a2165c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:26:58.519149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2724ba-ba1c-48b0-9eb3-6a5394069456 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:58.519683 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2724ba-ba1c-48b0-9eb3-6a5394069456 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:58.519773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2724ba-ba1c-48b0-9eb3-6a5394069456 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:58.521093 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 556/1124] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:26:58.526201 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dabea4-e4bf-49fa-bb42-bbc9bd913968 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:58.526573 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dabea4-e4bf-49fa-bb42-bbc9bd913968 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:58.526756 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dabea4-e4bf-49fa-bb42-bbc9bd913968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:58.543554 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-d6dabea4-e4bf-49fa-bb42-bbc9bd913968 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:26:58.544716 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d6dabea4-e4bf-49fa-bb42-bbc9bd913968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:26:58.608755 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 569/1125] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:26:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:26:58.631297 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2724ba-ba1c-48b0-9eb3-6a5394069456 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:58.729763 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2724ba-ba1c-48b0-9eb3-6a5394069456 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:58.746434 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:58.762967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8759b51-1381-4b74-9aca-e0fad9c271a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:58.763850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8759b51-1381-4b74-9aca-e0fad9c271a7 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:58.764135 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8759b51-1381-4b74-9aca-e0fad9c271a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:58.764412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8759b51-1381-4b74-9aca-e0fad9c271a7 None admin] PATH_INFO: `/v3/roles/580d60e140704327b90a80fc59a2165c` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:58.765863 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8759b51-1381-4b74-9aca-e0fad9c271a7 None admin] RBAC: Authorizing `identity:get_role(role_id=580d60e140704327b90a80fc59a2165c)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:58.767774 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8759b51-1381-4b74-9aca-e0fad9c271a7 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:58.769142 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 557/1126] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:26:58 2022] GET /identity/v3/roles/580d60e140704327b90a80fc59a2165c => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:58.774973 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dabea4-e4bf-49fa-bb42-bbc9bd913968 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:58.830472 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:58.871337 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dabea4-e4bf-49fa-bb42-bbc9bd913968 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:58.904021 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590b975-265c-459a-9e4a-07e43cb2b8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:58.904880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590b975-265c-459a-9e4a-07e43cb2b8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:58.905162 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590b975-265c-459a-9e4a-07e43cb2b8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:58.905436 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590b975-265c-459a-9e4a-07e43cb2b8b5 None admin] PATH_INFO: `/v3/users/cd0dd1955a394f3e88f1d709b44e7601` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:58.906605 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590b975-265c-459a-9e4a-07e43cb2b8b5 None admin] RBAC: Authorizing `identity:get_user(user_id=cd0dd1955a394f3e88f1d709b44e7601)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:58.908637 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590b975-265c-459a-9e4a-07e43cb2b8b5 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:58.910232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 570/1127] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:26:58 2022] GET /identity/v3/users/cd0dd1955a394f3e88f1d709b44e7601 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:58.915852 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8759b51-1381-4b74-9aca-e0fad9c271a7 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:59.016174 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8759b51-1381-4b74-9aca-e0fad9c271a7 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:59.049101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43160da6-f881-4ba3-ac33-bac8eadb0131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:59.049681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43160da6-f881-4ba3-ac33-bac8eadb0131 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:59.049967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43160da6-f881-4ba3-ac33-bac8eadb0131 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:59.050245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43160da6-f881-4ba3-ac33-bac8eadb0131 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:59.102763 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:59.115889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43160da6-f881-4ba3-ac33-bac8eadb0131 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:59.117319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43160da6-f881-4ba3-ac33-bac8eadb0131 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:59.210946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 558/1128] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:26:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:26:59.216819 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590b975-265c-459a-9e4a-07e43cb2b8b5 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:59.322404 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590b975-265c-459a-9e4a-07e43cb2b8b5 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:59.347859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:59.356639 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d592b8-9f2c-4a30-b0a2-519cd42ee18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:59.357496 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d592b8-9f2c-4a30-b0a2-519cd42ee18a None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:59.357785 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d592b8-9f2c-4a30-b0a2-519cd42ee18a None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:59.358060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d592b8-9f2c-4a30-b0a2-519cd42ee18a None admin] PATH_INFO: `/v3/projects/83c4cb575aab4909b2aaf3f0d7763882` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:59.359514 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d592b8-9f2c-4a30-b0a2-519cd42ee18a None admin] RBAC: Authorizing `identity:get_project(project_id=83c4cb575aab4909b2aaf3f0d7763882)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:59.361486 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d592b8-9f2c-4a30-b0a2-519cd42ee18a None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:59.363144 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 571/1129] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:26:59 2022] GET /identity/v3/projects/83c4cb575aab4909b2aaf3f0d7763882 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:26:59.369313 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43160da6-f881-4ba3-ac33-bac8eadb0131 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:26:59.450419 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:26:59.465281 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43160da6-f881-4ba3-ac33-bac8eadb0131 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:26:59.499953 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e37e2-12e8-4c15-820c-1f928fc848be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:26:59.501404 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e37e2-12e8-4c15-820c-1f928fc848be None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:26:59.501687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e37e2-12e8-4c15-820c-1f928fc848be None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:26:59.501958 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e37e2-12e8-4c15-820c-1f928fc848be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:26:59.502771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e37e2-12e8-4c15-820c-1f928fc848be None admin] RBAC: Adding query filter params (role.id=580d60e140704327b90a80fc59a2165c, scope.project.id=83c4cb575aab4909b2aaf3f0d7763882, user.id=cd0dd1955a394f3e88f1d709b44e7601) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:26:59.503080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e37e2-12e8-4c15-820c-1f928fc848be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:26:59.504536 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e37e2-12e8-4c15-820c-1f928fc848be None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:26:59.510108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 559/1130] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:26:59 2022] GET /identity/v3/role_assignments?user.id=cd0dd1955a394f3e88f1d709b44e7601&scope.project.id=83c4cb575aab4909b2aaf3f0d7763882&role.id=580d60e140704327b90a80fc59a2165c => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:01.700895 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0e3b7-a55a-4706-9f86-4ea90017bd13 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:01.701446 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0e3b7-a55a-4706-9f86-4ea90017bd13 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:01.701446 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0e3b7-a55a-4706-9f86-4ea90017bd13 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:01.702796 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 572/1131] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:01.708220 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40964c-770d-4b04-b4a4-7d465a548d3a None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:01.708613 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40964c-770d-4b04-b4a4-7d465a548d3a None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:01.708780 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40964c-770d-4b04-b4a4-7d465a548d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:01.725874 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-5b40964c-770d-4b04-b4a4-7d465a548d3a None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:01.727052 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-5b40964c-770d-4b04-b4a4-7d465a548d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:01.792746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 560/1132] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:27:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:27:01.817110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0e3b7-a55a-4706-9f86-4ea90017bd13 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:01.912914 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0e3b7-a55a-4706-9f86-4ea90017bd13 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:01.945394 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba3b17-da3d-485f-a7c7-91a8183c4e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:01.946164 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba3b17-da3d-485f-a7c7-91a8183c4e4e None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:01.946444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba3b17-da3d-485f-a7c7-91a8183c4e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:01.946716 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba3b17-da3d-485f-a7c7-91a8183c4e4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:01.947880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba3b17-da3d-485f-a7c7-91a8183c4e4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:01.949306 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba3b17-da3d-485f-a7c7-91a8183c4e4e None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:01.950853 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 573/1133] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:27:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:01.956662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40964c-770d-4b04-b4a4-7d465a548d3a None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:02.034242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:02.053592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40964c-770d-4b04-b4a4-7d465a548d3a None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:02.086057 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bff6e9-b58b-4bc1-90fc-a31aefccf1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:02.086714 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bff6e9-b58b-4bc1-90fc-a31aefccf1af None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:02.086998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bff6e9-b58b-4bc1-90fc-a31aefccf1af None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:02.087291 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bff6e9-b58b-4bc1-90fc-a31aefccf1af None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:02.088003 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bff6e9-b58b-4bc1-90fc-a31aefccf1af None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:02.089415 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bff6e9-b58b-4bc1-90fc-a31aefccf1af None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:02.114504 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 561/1134] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 09:27:01 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:27:04.304521 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124f870-01c9-45d0-93cf-7aa74394eea6 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:04.305036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124f870-01c9-45d0-93cf-7aa74394eea6 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:04.305150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124f870-01c9-45d0-93cf-7aa74394eea6 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:04.306416 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 574/1135] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:04.311753 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f97713-8b2b-48dc-acc6-83d6b833c08d None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:04.312120 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f97713-8b2b-48dc-acc6-83d6b833c08d None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:04.312313 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f97713-8b2b-48dc-acc6-83d6b833c08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:04.329718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-e3f97713-8b2b-48dc-acc6-83d6b833c08d None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:04.330826 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e3f97713-8b2b-48dc-acc6-83d6b833c08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:04.394373 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 562/1136] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:27:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:27:04.418062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124f870-01c9-45d0-93cf-7aa74394eea6 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:04.478502 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:04.517587 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124f870-01c9-45d0-93cf-7aa74394eea6 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:04.549808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ca9b7-64c4-46e8-9f99-d67b9f49e0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:04.550583 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ca9b7-64c4-46e8-9f99-d67b9f49e0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:04.550867 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ca9b7-64c4-46e8-9f99-d67b9f49e0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:04.551141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ca9b7-64c4-46e8-9f99-d67b9f49e0d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:04.552329 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ca9b7-64c4-46e8-9f99-d67b9f49e0d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:04.553758 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ca9b7-64c4-46e8-9f99-d67b9f49e0d2 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:04.555344 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 575/1137] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:27:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:04.560790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f97713-8b2b-48dc-acc6-83d6b833c08d None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:04.619252 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:04.656141 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f97713-8b2b-48dc-acc6-83d6b833c08d None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:04.696038 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c49bad-17c8-45cd-887f-ca940924fe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:04.696692 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c49bad-17c8-45cd-887f-ca940924fe05 None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:04.696969 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c49bad-17c8-45cd-887f-ca940924fe05 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:04.697238 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c49bad-17c8-45cd-887f-ca940924fe05 None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:04.697943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c49bad-17c8-45cd-887f-ca940924fe05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:04.699427 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c49bad-17c8-45cd-887f-ca940924fe05 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:04.718185 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 563/1138] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 09:27:04 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:27:06.947394 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca171c0b-fd4b-45ea-b095-e63d2361dd55 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:06.947983 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca171c0b-fd4b-45ea-b095-e63d2361dd55 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:06.947983 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca171c0b-fd4b-45ea-b095-e63d2361dd55 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:06.949284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 576/1139] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:06.955088 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a61fab-7920-46e5-b247-68bc8944aca8 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:06.955536 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a61fab-7920-46e5-b247-68bc8944aca8 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:06.955685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a61fab-7920-46e5-b247-68bc8944aca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:06.972526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-55a61fab-7920-46e5-b247-68bc8944aca8 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:06.973700 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-55a61fab-7920-46e5-b247-68bc8944aca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:07.044981 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 564/1140] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:27:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:27:07.068739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca171c0b-fd4b-45ea-b095-e63d2361dd55 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:07.166602 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca171c0b-fd4b-45ea-b095-e63d2361dd55 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:07.193815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:07.199864 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f56dd-c7a3-44f2-9e18-c542cf4374a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:07.200593 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f56dd-c7a3-44f2-9e18-c542cf4374a3 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:07.200877 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f56dd-c7a3-44f2-9e18-c542cf4374a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:07.201155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f56dd-c7a3-44f2-9e18-c542cf4374a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:07.211605 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f56dd-c7a3-44f2-9e18-c542cf4374a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:27:07.219254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-100f56dd-c7a3-44f2-9e18-c542cf4374a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:27:07.219254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:27:07.219254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:27:07.219254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:27:07.219254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:27:07.219254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:27:07.219254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:27:07.219254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:27:07.219254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:27:07.219254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:27:07.219254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:27:07.219254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:27:07.219254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:27:07.219254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:27:07.219254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:27:07.219254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:27:07.220354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:27:07.220354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:27:07.220354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:27:07.220354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:27:07.220354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:27:07.220354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:27:07.220354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:27:07.220354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:27:07.220354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:27:07.220354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:27:07.220354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:27:07.220354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:27:07.220354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:27:07.220354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:27:07.220354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:27:07.220354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:27:07.221375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:27:07.221375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:27:07.221375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:27:07.221375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:27:07.221375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:27:07.221375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:27:07.221375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:27:07.221375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:27:07.221375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:27:07.221375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:27:07.221375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:27:07.221375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:27:07.221375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 577/1141] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:27:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:27:07.226403 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a61fab-7920-46e5-b247-68bc8944aca8 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:07.273873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:07.327117 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a61fab-7920-46e5-b247-68bc8944aca8 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:07.360899 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b66560-363b-4ccf-b667-be732a3def29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:07.361555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b66560-363b-4ccf-b667-be732a3def29 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:07.361838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b66560-363b-4ccf-b667-be732a3def29 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:07.362108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b66560-363b-4ccf-b667-be732a3def29 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:07.362843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b66560-363b-4ccf-b667-be732a3def29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:27:07.363148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b66560-363b-4ccf-b667-be732a3def29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:07.364538 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b66560-363b-4ccf-b667-be732a3def29 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:07.372365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 565/1142] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:27:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:07.378126 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f56dd-c7a3-44f2-9e18-c542cf4374a3 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:07.474903 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f56dd-c7a3-44f2-9e18-c542cf4374a3 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:07.507203 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71219e-98b1-44d3-9447-5a310e97284d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:07.508089 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71219e-98b1-44d3-9447-5a310e97284d None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:07.508376 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71219e-98b1-44d3-9447-5a310e97284d None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:07.508654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71219e-98b1-44d3-9447-5a310e97284d None admin] PATH_INFO: `/v3/users/33d74215cafa4d2a943142399645bff8` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:07.521282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71219e-98b1-44d3-9447-5a310e97284d None admin] RBAC: Authorizing `identity:get_user(user_id=33d74215cafa4d2a943142399645bff8)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:07.522726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71219e-98b1-44d3-9447-5a310e97284d None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:07.524344 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 578/1143] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:27:07 2022] GET /identity/v3/users/33d74215cafa4d2a943142399645bff8 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:07.529784 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b66560-363b-4ccf-b667-be732a3def29 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:07.627576 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b66560-363b-4ccf-b667-be732a3def29 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:07.637305 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:07.660600 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1352f8-82ed-4e25-b704-7099039c9272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:07.661229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1352f8-82ed-4e25-b704-7099039c9272 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:07.661511 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1352f8-82ed-4e25-b704-7099039c9272 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:07.661787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1352f8-82ed-4e25-b704-7099039c9272 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:07.725742 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1352f8-82ed-4e25-b704-7099039c9272 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:07.727114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1352f8-82ed-4e25-b704-7099039c9272 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:07.820096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 566/1144] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:27:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:27:07.825847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71219e-98b1-44d3-9447-5a310e97284d None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:07.874106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:07.923200 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71219e-98b1-44d3-9447-5a310e97284d None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:07.956374 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdb0f5-301b-49db-b9d3-004e6c9be352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:07.957223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdb0f5-301b-49db-b9d3-004e6c9be352 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:07.957535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdb0f5-301b-49db-b9d3-004e6c9be352 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:07.957814 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdb0f5-301b-49db-b9d3-004e6c9be352 None admin] PATH_INFO: `/v3/projects/d9f01982f1e24e4d92c03e570d5aeaa4` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:07.958980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bdb0f5-301b-49db-b9d3-004e6c9be352 None admin] RBAC: Authorizing `identity:get_project(project_id=d9f01982f1e24e4d92c03e570d5aeaa4)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:07.960465 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bdb0f5-301b-49db-b9d3-004e6c9be352 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:07.962126 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 579/1145] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:27:07 2022] GET /identity/v3/projects/d9f01982f1e24e4d92c03e570d5aeaa4 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:07.968153 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1352f8-82ed-4e25-b704-7099039c9272 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:07.979424 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:08.064274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1352f8-82ed-4e25-b704-7099039c9272 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:08.096819 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d53f6-5fb7-4ffa-997a-dd0dfd713cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:08.097462 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d53f6-5fb7-4ffa-997a-dd0dfd713cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:08.097744 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d53f6-5fb7-4ffa-997a-dd0dfd713cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:08.098019 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d53f6-5fb7-4ffa-997a-dd0dfd713cb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:08.098836 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d53f6-5fb7-4ffa-997a-dd0dfd713cb1 None admin] RBAC: Adding query filter params (role.id=bb6c5483d9be4a16ac64750536c5e2e2, scope.project.id=d9f01982f1e24e4d92c03e570d5aeaa4, user.id=33d74215cafa4d2a943142399645bff8) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:27:08.099148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d53f6-5fb7-4ffa-997a-dd0dfd713cb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:08.100584 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d53f6-5fb7-4ffa-997a-dd0dfd713cb1 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:08.105831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 567/1146] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:27:07 2022] GET /identity/v3/role_assignments?user.id=33d74215cafa4d2a943142399645bff8&scope.project.id=d9f01982f1e24e4d92c03e570d5aeaa4&role.id=bb6c5483d9be4a16ac64750536c5e2e2 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:10.251345 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6442f29-c911-4fd6-bcd3-6ee64259c1a0 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:10.251890 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6442f29-c911-4fd6-bcd3-6ee64259c1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:10.251890 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6442f29-c911-4fd6-bcd3-6ee64259c1a0 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:10.253256 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 580/1147] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:27:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:10.258450 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c4c46-081c-40a1-ade6-b71cd2c393df None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:10.258865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c4c46-081c-40a1-ade6-b71cd2c393df None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:10.259020 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c4c46-081c-40a1-ade6-b71cd2c393df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:10.275927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-687c4c46-081c-40a1-ade6-b71cd2c393df None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:10.277089 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-687c4c46-081c-40a1-ade6-b71cd2c393df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:10.340255 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 568/1148] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:27:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:27:10.362398 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6442f29-c911-4fd6-bcd3-6ee64259c1a0 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:10.462172 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6442f29-c911-4fd6-bcd3-6ee64259c1a0 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:10.477887 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:10.495459 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c77727-75a0-4620-aeb0-c43557685e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:10.496236 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c77727-75a0-4620-aeb0-c43557685e29 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:10.496522 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c77727-75a0-4620-aeb0-c43557685e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:10.496801 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c77727-75a0-4620-aeb0-c43557685e29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:10.507163 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c77727-75a0-4620-aeb0-c43557685e29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:27:10.514812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-35c77727-75a0-4620-aeb0-c43557685e29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:27:10.514812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:27:10.514812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:27:10.514812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:27:10.514812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:27:10.514812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:27:10.514812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:27:10.514812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:27:10.514812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:27:10.514812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:27:10.514812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:27:10.514812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:27:10.514812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:27:10.514812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:27:10.514812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:27:10.514812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:27:10.515875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:27:10.515875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:27:10.515875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:27:10.515875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:27:10.515875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:27:10.515875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:27:10.515875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:27:10.515875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:27:10.515875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:27:10.515875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:27:10.515875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:27:10.515875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:27:10.515875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:27:10.515875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:27:10.515875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:27:10.515875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:27:10.516881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:27:10.516881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:27:10.516881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:27:10.516881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:27:10.516881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:27:10.516881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:27:10.516881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:27:10.516881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:27:10.516881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:27:10.516881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:27:10.516881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:27:10.516881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:27:10.516881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 581/1149] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:27:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:27:10.522557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c4c46-081c-40a1-ade6-b71cd2c393df None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:10.525617 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:10.617812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c4c46-081c-40a1-ade6-b71cd2c393df None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:10.650418 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7656b76-17be-4153-9f73-9edf3adb2c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:10.651075 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7656b76-17be-4153-9f73-9edf3adb2c0f None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:10.651391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7656b76-17be-4153-9f73-9edf3adb2c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:10.651673 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7656b76-17be-4153-9f73-9edf3adb2c0f None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:10.652407 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7656b76-17be-4153-9f73-9edf3adb2c0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:27:10.652717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7656b76-17be-4153-9f73-9edf3adb2c0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:10.654075 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7656b76-17be-4153-9f73-9edf3adb2c0f None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:10.661888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 569/1150] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:27:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:10.667561 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c77727-75a0-4620-aeb0-c43557685e29 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:10.764757 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c77727-75a0-4620-aeb0-c43557685e29 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:10.797275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf434e43-787e-4370-bc14-565ecb534023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:10.798131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf434e43-787e-4370-bc14-565ecb534023 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:10.798411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf434e43-787e-4370-bc14-565ecb534023 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:10.798683 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf434e43-787e-4370-bc14-565ecb534023 None admin] PATH_INFO: `/v3/users/33d74215cafa4d2a943142399645bff8` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:10.799875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf434e43-787e-4370-bc14-565ecb534023 None admin] RBAC: Authorizing `identity:get_user(user_id=33d74215cafa4d2a943142399645bff8)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:10.801297 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf434e43-787e-4370-bc14-565ecb534023 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:10.802878 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 582/1151] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:27:10 2022] GET /identity/v3/users/33d74215cafa4d2a943142399645bff8 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:10.808469 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7656b76-17be-4153-9f73-9edf3adb2c0f None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:10.870764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:10.905266 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7656b76-17be-4153-9f73-9edf3adb2c0f None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:10.937109 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5004f69-846e-477d-b98a-c557a184d960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:10.938487 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5004f69-846e-477d-b98a-c557a184d960 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:10.938762 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5004f69-846e-477d-b98a-c557a184d960 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:10.939029 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5004f69-846e-477d-b98a-c557a184d960 None admin] PATH_INFO: `/v3/projects/d9f01982f1e24e4d92c03e570d5aeaa4` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:10.940199 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5004f69-846e-477d-b98a-c557a184d960 None admin] RBAC: Authorizing `identity:get_project(project_id=d9f01982f1e24e4d92c03e570d5aeaa4)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:10.941622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5004f69-846e-477d-b98a-c557a184d960 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:10.943264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 570/1152] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:27:10 2022] GET /identity/v3/projects/d9f01982f1e24e4d92c03e570d5aeaa4 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:10.949097 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf434e43-787e-4370-bc14-565ecb534023 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:10.993714 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:11.049236 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf434e43-787e-4370-bc14-565ecb534023 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:11.082754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e7474-46aa-4a37-b718-00f2b8cfd078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:11.083679 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e7474-46aa-4a37-b718-00f2b8cfd078 None admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:11.083965 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e7474-46aa-4a37-b718-00f2b8cfd078 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:11.084242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e7474-46aa-4a37-b718-00f2b8cfd078 None admin] PATH_INFO: `/v3/projects/d9f01982f1e24e4d92c03e570d5aeaa4/users/33d74215cafa4d2a943142399645bff8/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:11.086179 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e7474-46aa-4a37-b718-00f2b8cfd078 None admin] RBAC: Authorizing `identity:create_grant(project_id=d9f01982f1e24e4d92c03e570d5aeaa4, user_id=33d74215cafa4d2a943142399645bff8, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:11.087656 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e7474-46aa-4a37-b718-00f2b8cfd078 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:11.100395 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 583/1153] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:27:10 2022] PUT /identity/v3/projects/d9f01982f1e24e4d92c03e570d5aeaa4/users/33d74215cafa4d2a943142399645bff8/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:27:13.304650 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f6dec-4c5b-4c35-93e4-10fe56ef603c None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:13.305201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f6dec-4c5b-4c35-93e4-10fe56ef603c None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:13.305201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f6dec-4c5b-4c35-93e4-10fe56ef603c None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:13.306566 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 571/1154] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:13.320424 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01c741-0811-4f54-b200-e3a31bc79b07 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:13.320857 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01c741-0811-4f54-b200-e3a31bc79b07 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:13.320959 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01c741-0811-4f54-b200-e3a31bc79b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:13.341648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-9e01c741-0811-4f54-b200-e3a31bc79b07 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:13.342832 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-9e01c741-0811-4f54-b200-e3a31bc79b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:13.407496 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 584/1155] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:27:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:27:13.430953 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f6dec-4c5b-4c35-93e4-10fe56ef603c None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:13.528815 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f6dec-4c5b-4c35-93e4-10fe56ef603c None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:13.561117 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2889df-4704-4deb-9cab-d6f48fe7420b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:13.561888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2889df-4704-4deb-9cab-d6f48fe7420b None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:13.562170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2889df-4704-4deb-9cab-d6f48fe7420b None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:13.562471 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2889df-4704-4deb-9cab-d6f48fe7420b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:13.564288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:13.573755 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2889df-4704-4deb-9cab-d6f48fe7420b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:27:13.581724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-aa2889df-4704-4deb-9cab-d6f48fe7420b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:27:13.581724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:27:13.581724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:27:13.581724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:27:13.581724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:27:13.581724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:27:13.581724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:27:13.581724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:27:13.581724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:27:13.581724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:27:13.581724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:27:13.581724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:27:13.581724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:27:13.581724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:27:13.581724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:27:13.581724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:27:13.582825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:27:13.582825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:27:13.582825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:27:13.582825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:27:13.582825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:27:13.582825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:27:13.582825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:27:13.582825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:27:13.582825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:27:13.582825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:27:13.582825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:27:13.582825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:27:13.582825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:27:13.582825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:27:13.582825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:27:13.582825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:27:13.583881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:27:13.583881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:27:13.583881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:27:13.583881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:27:13.583881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:27:13.583881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:27:13.583881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:27:13.583881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:27:13.583881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:27:13.583881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:27:13.583881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:27:13.583881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:27:13.583881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 572/1156] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:27:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:27:13.588712 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01c741-0811-4f54-b200-e3a31bc79b07 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:13.622562 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:13.687359 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01c741-0811-4f54-b200-e3a31bc79b07 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:13.720643 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a16e15-8fc9-44fa-b93b-9233237c4567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:13.721301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a16e15-8fc9-44fa-b93b-9233237c4567 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:13.721586 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a16e15-8fc9-44fa-b93b-9233237c4567 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:13.721865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a16e15-8fc9-44fa-b93b-9233237c4567 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:13.722600 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a16e15-8fc9-44fa-b93b-9233237c4567 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:27:13.722911 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a16e15-8fc9-44fa-b93b-9233237c4567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:13.724322 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a16e15-8fc9-44fa-b93b-9233237c4567 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:13.732160 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 585/1157] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:27:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:13.738082 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2889df-4704-4deb-9cab-d6f48fe7420b None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:13.835056 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2889df-4704-4deb-9cab-d6f48fe7420b None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:13.868014 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f204119-a3e8-4097-b89e-b76a5ddb93d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:13.868870 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f204119-a3e8-4097-b89e-b76a5ddb93d9 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:13.869157 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f204119-a3e8-4097-b89e-b76a5ddb93d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:13.869436 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f204119-a3e8-4097-b89e-b76a5ddb93d9 None admin] PATH_INFO: `/v3/users/33d74215cafa4d2a943142399645bff8` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:13.870597 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f204119-a3e8-4097-b89e-b76a5ddb93d9 None admin] RBAC: Authorizing `identity:get_user(user_id=33d74215cafa4d2a943142399645bff8)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:13.872045 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f204119-a3e8-4097-b89e-b76a5ddb93d9 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:13.873648 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 573/1158] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:27:13 2022] GET /identity/v3/users/33d74215cafa4d2a943142399645bff8 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:13.879199 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a16e15-8fc9-44fa-b93b-9233237c4567 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:13.971159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:13.977414 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a16e15-8fc9-44fa-b93b-9233237c4567 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:14.009982 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256d266-5153-47d8-bc0f-ed80ff000667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:14.010624 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256d266-5153-47d8-bc0f-ed80ff000667 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:14.010912 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256d266-5153-47d8-bc0f-ed80ff000667 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:14.011196 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256d266-5153-47d8-bc0f-ed80ff000667 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:14.077583 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256d266-5153-47d8-bc0f-ed80ff000667 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:14.079621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256d266-5153-47d8-bc0f-ed80ff000667 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:14.167885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:14.174821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 586/1159] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:27:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:27:14.180630 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f204119-a3e8-4097-b89e-b76a5ddb93d9 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:14.239822 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:14.277275 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f204119-a3e8-4097-b89e-b76a5ddb93d9 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:14.308932 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a191738-b74a-4f4f-b0a4-60e9081ae959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:14.309775 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a191738-b74a-4f4f-b0a4-60e9081ae959 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:14.310059 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a191738-b74a-4f4f-b0a4-60e9081ae959 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:14.310335 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a191738-b74a-4f4f-b0a4-60e9081ae959 None admin] PATH_INFO: `/v3/projects/d9f01982f1e24e4d92c03e570d5aeaa4` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:14.311535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a191738-b74a-4f4f-b0a4-60e9081ae959 None admin] RBAC: Authorizing `identity:get_project(project_id=d9f01982f1e24e4d92c03e570d5aeaa4)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:14.313484 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a191738-b74a-4f4f-b0a4-60e9081ae959 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:14.315134 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 574/1160] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:27:14 2022] GET /identity/v3/projects/d9f01982f1e24e4d92c03e570d5aeaa4 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:14.321011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256d266-5153-47d8-bc0f-ed80ff000667 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:14.421199 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256d266-5153-47d8-bc0f-ed80ff000667 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:14.462837 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d133a6-26a5-4c21-a4de-d280ba94a177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:14.463504 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d133a6-26a5-4c21-a4de-d280ba94a177 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:14.463784 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d133a6-26a5-4c21-a4de-d280ba94a177 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:14.464059 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d133a6-26a5-4c21-a4de-d280ba94a177 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:14.464872 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d133a6-26a5-4c21-a4de-d280ba94a177 None admin] RBAC: Adding query filter params (role.id=bb6c5483d9be4a16ac64750536c5e2e2, scope.project.id=d9f01982f1e24e4d92c03e570d5aeaa4, user.id=33d74215cafa4d2a943142399645bff8) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:27:14.465180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d133a6-26a5-4c21-a4de-d280ba94a177 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:14.466595 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d133a6-26a5-4c21-a4de-d280ba94a177 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:14.472308 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 587/1161] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:27:14 2022] GET /identity/v3/role_assignments?user.id=33d74215cafa4d2a943142399645bff8&scope.project.id=d9f01982f1e24e4d92c03e570d5aeaa4&role.id=bb6c5483d9be4a16ac64750536c5e2e2 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:16.672911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884ae6d-56cd-43c1-ab53-a53d2cfe3ca4 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:16.673467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884ae6d-56cd-43c1-ab53-a53d2cfe3ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:16.673467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884ae6d-56cd-43c1-ab53-a53d2cfe3ca4 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:16.674821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 575/1162] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:27:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:16.679894 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bbe31-6293-40b3-8d3b-002213060f31 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:16.680304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bbe31-6293-40b3-8d3b-002213060f31 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:16.680460 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bbe31-6293-40b3-8d3b-002213060f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:16.697558 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-606bbe31-6293-40b3-8d3b-002213060f31 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:16.698735 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-606bbe31-6293-40b3-8d3b-002213060f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:16.753206 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:16.764562 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 588/1163] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:27:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:27:16.786280 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884ae6d-56cd-43c1-ab53-a53d2cfe3ca4 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:16.884101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884ae6d-56cd-43c1-ab53-a53d2cfe3ca4 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:16.911087 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:16.917118 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf58d89-b635-4947-a4f5-42d717307709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:16.917761 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf58d89-b635-4947-a4f5-42d717307709 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:16.918045 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf58d89-b635-4947-a4f5-42d717307709 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:16.918322 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf58d89-b635-4947-a4f5-42d717307709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:16.983145 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf58d89-b635-4947-a4f5-42d717307709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:16.985128 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf58d89-b635-4947-a4f5-42d717307709 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:17.080313 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 576/1164] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:27:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 09:27:17.086287 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bbe31-6293-40b3-8d3b-002213060f31 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:17.183121 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bbe31-6293-40b3-8d3b-002213060f31 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:17.216171 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e81da-8f5b-42b9-8f61-2fe83fa9f6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:17.216962 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e81da-8f5b-42b9-8f61-2fe83fa9f6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:17.217251 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e81da-8f5b-42b9-8f61-2fe83fa9f6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:17.217533 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e81da-8f5b-42b9-8f61-2fe83fa9f6b5 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:17.224650 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e81da-8f5b-42b9-8f61-2fe83fa9f6b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:17.226098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e81da-8f5b-42b9-8f61-2fe83fa9f6b5 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:17.240979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-827e81da-8f5b-42b9-8f61-2fe83fa9f6b5 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 27 09:27:17.240979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:27:17.240979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 27 09:27:17.240979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 27 09:27:17.240979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:27:17.240979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:27:17.240979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:27:17.240979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:27:17.240979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 27 09:27:17.240979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:27:17.240979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:27:17.240979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:27:17.240979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:27:17.240979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:27:17.240979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:27:17.240979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:27:17.240979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:27:17.242191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:27:17.242191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:27:17.242191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:27:17.242191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:27:17.242191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:27:17.242191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:27:17.242191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:27:17.242191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:27:17.242191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:27:17.242191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:27:17.242191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:27:17.242191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:27:17.242191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:27:17.242191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:27:17.242191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:27:17.242191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:27:17.243268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:27:17.243268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:27:17.243268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:27:17.243268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:27:17.243268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:27:17.243268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:27:17.243268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:27:17.243268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:27:17.243268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:27:17.243268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:27:17.243268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 27 09:27:17.243268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:27:17.243268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 27 09:27:17.243268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:27:17.243268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 589/1165] 10.222.0.41 () {56 vars in 1117 bytes} [Fri May 27 09:27:17 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:27:17.247810 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf58d89-b635-4947-a4f5-42d717307709 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:17.277502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:17.345449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf58d89-b635-4947-a4f5-42d717307709 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:17.377599 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c9aad-c92f-4c2d-b7d5-84f52b62c386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:17.378246 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c9aad-c92f-4c2d-b7d5-84f52b62c386 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:17.378528 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c9aad-c92f-4c2d-b7d5-84f52b62c386 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:17.378800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c9aad-c92f-4c2d-b7d5-84f52b62c386 None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:17.379545 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c9aad-c92f-4c2d-b7d5-84f52b62c386 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:27:17.379851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c9aad-c92f-4c2d-b7d5-84f52b62c386 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:17.381208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c9aad-c92f-4c2d-b7d5-84f52b62c386 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:17.388117 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 577/1166] 10.222.0.41 () {56 vars in 1115 bytes} [Fri May 27 09:27:17 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:19.542663 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54055901-7d7b-45b2-9267-610c23d294bc None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:19.543191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54055901-7d7b-45b2-9267-610c23d294bc None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:19.543403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54055901-7d7b-45b2-9267-610c23d294bc None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:19.544958 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 590/1167] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:27:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:19.550339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de201f00-3068-42eb-8e1f-b75ac8ae1f91 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:19.550774 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de201f00-3068-42eb-8e1f-b75ac8ae1f91 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:19.550898 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de201f00-3068-42eb-8e1f-b75ac8ae1f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:19.567811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-de201f00-3068-42eb-8e1f-b75ac8ae1f91 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:19.568999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-de201f00-3068-42eb-8e1f-b75ac8ae1f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:19.633662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 578/1168] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:27:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:27:19.657222 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54055901-7d7b-45b2-9267-610c23d294bc None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:19.706695 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:19.755492 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54055901-7d7b-45b2-9267-610c23d294bc None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:19.786827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e304b6-6d08-4681-afb1-ab45fde3261f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:19.787495 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e304b6-6d08-4681-afb1-ab45fde3261f None admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:19.787778 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e304b6-6d08-4681-afb1-ab45fde3261f None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:19.788049 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e304b6-6d08-4681-afb1-ab45fde3261f None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:19.788772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e304b6-6d08-4681-afb1-ab45fde3261f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:19.790123 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e304b6-6d08-4681-afb1-ab45fde3261f None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:19.804238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 591/1169] 10.222.0.41 () {60 vars in 1138 bytes} [Fri May 27 09:27:19 2022] POST /identity/v3/domains => generated 267 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:27:22.019519 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0adb9-7be1-4d51-9c64-ab84f6c02c26 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:22.020071 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0adb9-7be1-4d51-9c64-ab84f6c02c26 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:22.020071 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0adb9-7be1-4d51-9c64-ab84f6c02c26 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:22.021441 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 579/1170] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:22.026657 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d9cc3-e9d8-4e15-b30d-d542653b7058 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:22.027074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d9cc3-e9d8-4e15-b30d-d542653b7058 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:22.027215 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d9cc3-e9d8-4e15-b30d-d542653b7058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:22.044507 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-e29d9cc3-e9d8-4e15-b30d-d542653b7058 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:22.045673 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-e29d9cc3-e9d8-4e15-b30d-d542653b7058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:22.111642 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 592/1171] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:27:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:27:22.135196 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0adb9-7be1-4d51-9c64-ab84f6c02c26 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:22.159338 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:22.232532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0adb9-7be1-4d51-9c64-ab84f6c02c26 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:22.265197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9099a1-a976-405b-8640-f0633b7d926d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:22.266064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9099a1-a976-405b-8640-f0633b7d926d None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:22.266344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9099a1-a976-405b-8640-f0633b7d926d None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:22.266616 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9099a1-a976-405b-8640-f0633b7d926d None admin] PATH_INFO: `/v3/domains/9f4a60a2413b447d97f8dd77b5a31df4` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:22.276620 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9099a1-a976-405b-8640-f0633b7d926d None admin] RBAC: Authorizing `identity:get_domain(domain_id=9f4a60a2413b447d97f8dd77b5a31df4)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:22.277984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9099a1-a976-405b-8640-f0633b7d926d None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:22.279605 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 580/1172] 10.222.0.41 () {56 vars in 1183 bytes} [Fri May 27 09:27:22 2022] GET /identity/v3/domains/9f4a60a2413b447d97f8dd77b5a31df4 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:22.285726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d9cc3-e9d8-4e15-b30d-d542653b7058 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:22.325299 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:22.381314 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d9cc3-e9d8-4e15-b30d-d542653b7058 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:22.414018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e08e7-9067-4077-9e1d-8d9923e2d820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:22.414843 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e08e7-9067-4077-9e1d-8d9923e2d820 None admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:22.415124 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e08e7-9067-4077-9e1d-8d9923e2d820 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:22.415425 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e08e7-9067-4077-9e1d-8d9923e2d820 None admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:22.416132 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e08e7-9067-4077-9e1d-8d9923e2d820 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:22.417560 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e08e7-9067-4077-9e1d-8d9923e2d820 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:22.449796 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 593/1173] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 09:27:22 2022] POST /identity/v3/projects => generated 361 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:27:24.666807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4299938-1bc6-422f-bf6d-a77c66e962fd None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:24.667385 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4299938-1bc6-422f-bf6d-a77c66e962fd None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:24.667385 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4299938-1bc6-422f-bf6d-a77c66e962fd None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:24.668733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 581/1174] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:24.674585 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e09ae7-db49-4e93-9d8b-3dfd2b4e785f None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:24.674985 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e09ae7-db49-4e93-9d8b-3dfd2b4e785f None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:24.675145 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e09ae7-db49-4e93-9d8b-3dfd2b4e785f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:24.691532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-d3e09ae7-db49-4e93-9d8b-3dfd2b4e785f None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:24.692692 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d3e09ae7-db49-4e93-9d8b-3dfd2b4e785f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:24.756358 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 594/1175] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:27:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:27:24.780092 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4299938-1bc6-422f-bf6d-a77c66e962fd None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:24.865630 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:24.882584 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4299938-1bc6-422f-bf6d-a77c66e962fd None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:24.915633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548214a9-fcdd-48bd-aa7b-37096a2315e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:24.916484 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548214a9-fcdd-48bd-aa7b-37096a2315e5 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:24.916768 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548214a9-fcdd-48bd-aa7b-37096a2315e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:24.917100 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548214a9-fcdd-48bd-aa7b-37096a2315e5 None admin] PATH_INFO: `/v3/domains/9f4a60a2413b447d97f8dd77b5a31df4` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:24.918220 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548214a9-fcdd-48bd-aa7b-37096a2315e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9f4a60a2413b447d97f8dd77b5a31df4)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:24.919673 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548214a9-fcdd-48bd-aa7b-37096a2315e5 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:24.921273 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 582/1176] 10.222.0.41 () {56 vars in 1183 bytes} [Fri May 27 09:27:24 2022] GET /identity/v3/domains/9f4a60a2413b447d97f8dd77b5a31df4 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:24.926983 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e09ae7-db49-4e93-9d8b-3dfd2b4e785f None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:24.949744 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:25.023126 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e09ae7-db49-4e93-9d8b-3dfd2b4e785f None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:25.055898 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed0e3c-b255-43cc-a88b-bea4c70bc452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:25.056559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed0e3c-b255-43cc-a88b-bea4c70bc452 None admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:25.056839 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed0e3c-b255-43cc-a88b-bea4c70bc452 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:25.057111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed0e3c-b255-43cc-a88b-bea4c70bc452 None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:25.057818 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed0e3c-b255-43cc-a88b-bea4c70bc452 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:25.059247 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed0e3c-b255-43cc-a88b-bea4c70bc452 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:25.078631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 595/1177] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 09:27:24 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:27:27.293414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f869b3-43f0-48d7-b9b5-399453ce7de4 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:27.293934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f869b3-43f0-48d7-b9b5-399453ce7de4 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:27.293934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f869b3-43f0-48d7-b9b5-399453ce7de4 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:27.295342 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 583/1178] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:27.301099 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ce3ba-4942-40ff-9ebf-e8785cb7c7eb None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:27.301492 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ce3ba-4942-40ff-9ebf-e8785cb7c7eb None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:27.301658 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ce3ba-4942-40ff-9ebf-e8785cb7c7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:27.318692 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-b38ce3ba-4942-40ff-9ebf-e8785cb7c7eb None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:27.319864 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-b38ce3ba-4942-40ff-9ebf-e8785cb7c7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:27.384293 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 596/1179] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:27:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:27:27.407189 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f869b3-43f0-48d7-b9b5-399453ce7de4 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:27.509705 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f869b3-43f0-48d7-b9b5-399453ce7de4 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:27.541991 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9c5a7-971b-48ff-9cd4-b5c3fc747bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:27.542773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9c5a7-971b-48ff-9cd4-b5c3fc747bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:27.543059 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9c5a7-971b-48ff-9cd4-b5c3fc747bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:27.543363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9c5a7-971b-48ff-9cd4-b5c3fc747bd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:27.554228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9c5a7-971b-48ff-9cd4-b5c3fc747bd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:27:27.561834 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-79d9c5a7-971b-48ff-9cd4-b5c3fc747bd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:27:27.561834 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:27:27.561834 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:27:27.561834 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:27:27.561834 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:27:27.561834 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:27:27.561834 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:27:27.561834 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:27:27.561834 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:27:27.561834 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:27:27.561834 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:27:27.561834 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:27:27.561834 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:27:27.561834 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:27:27.561834 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:27:27.561834 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:27:27.562992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:27:27.562992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:27:27.562992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:27:27.562992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:27:27.562992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:27:27.562992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:27:27.562992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:27:27.562992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:27:27.562992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:27:27.562992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:27:27.562992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:27:27.562992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:27:27.562992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:27:27.562992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:27:27.562992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:27:27.562992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:27:27.564050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:27:27.564050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:27:27.564050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:27:27.564050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:27:27.564050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:27:27.564050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:27:27.564050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:27:27.564050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:27:27.564050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:27:27.564050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:27:27.564050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:27:27.564050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:27:27.564050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 584/1180] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:27:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:27:27.569296 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ce3ba-4942-40ff-9ebf-e8785cb7c7eb None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:27.579138 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:27.664568 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ce3ba-4942-40ff-9ebf-e8785cb7c7eb None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:27.697104 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8f55e-bafa-427f-be18-f19ac3522602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:27.697756 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8f55e-bafa-427f-be18-f19ac3522602 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:27.698039 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8f55e-bafa-427f-be18-f19ac3522602 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:27.698313 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8f55e-bafa-427f-be18-f19ac3522602 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:27.699046 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8f55e-bafa-427f-be18-f19ac3522602 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:27:27.699380 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8f55e-bafa-427f-be18-f19ac3522602 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:27.700747 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8f55e-bafa-427f-be18-f19ac3522602 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:27.709524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 597/1181] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:27:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:27.715132 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9c5a7-971b-48ff-9cd4-b5c3fc747bd7 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:27.730831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:27.815589 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9c5a7-971b-48ff-9cd4-b5c3fc747bd7 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:27.848677 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d531772-33d5-4ad5-904a-d03bad94ca24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:27.849468 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d531772-33d5-4ad5-904a-d03bad94ca24 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:27.849751 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d531772-33d5-4ad5-904a-d03bad94ca24 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:27.850024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d531772-33d5-4ad5-904a-d03bad94ca24 None admin] PATH_INFO: `/v3/users/6d7041c433f44f3680df1162bc9e70ef` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:27.862768 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d531772-33d5-4ad5-904a-d03bad94ca24 None admin] RBAC: Authorizing `identity:get_user(user_id=6d7041c433f44f3680df1162bc9e70ef)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:27.864231 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d531772-33d5-4ad5-904a-d03bad94ca24 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:27.865856 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 585/1182] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:27:27 2022] GET /identity/v3/users/6d7041c433f44f3680df1162bc9e70ef => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:27.871576 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8f55e-bafa-427f-be18-f19ac3522602 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:27.942267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:27.972975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8f55e-bafa-427f-be18-f19ac3522602 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:28.004522 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbf08a-5642-48e3-9d6c-6e2d205bd68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:28.005157 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbf08a-5642-48e3-9d6c-6e2d205bd68b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:28.005437 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbf08a-5642-48e3-9d6c-6e2d205bd68b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:28.005704 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbf08a-5642-48e3-9d6c-6e2d205bd68b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:28.080053 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbf08a-5642-48e3-9d6c-6e2d205bd68b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:28.081636 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbf08a-5642-48e3-9d6c-6e2d205bd68b None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:28.161978 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:28.194021 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 598/1183] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:27:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:27:28.199931 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d531772-33d5-4ad5-904a-d03bad94ca24 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:28.267544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:28.297085 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d531772-33d5-4ad5-904a-d03bad94ca24 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:28.330099 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3357354-5f51-4d1c-b6ec-27f22734d997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:28.330948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3357354-5f51-4d1c-b6ec-27f22734d997 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:28.331230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3357354-5f51-4d1c-b6ec-27f22734d997 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:28.331533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3357354-5f51-4d1c-b6ec-27f22734d997 None admin] PATH_INFO: `/v3/projects/97d14fb39d374cda88cb2519c202dc02` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:28.332683 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3357354-5f51-4d1c-b6ec-27f22734d997 None admin] RBAC: Authorizing `identity:get_project(project_id=97d14fb39d374cda88cb2519c202dc02)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:28.334089 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3357354-5f51-4d1c-b6ec-27f22734d997 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:28.335784 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 586/1184] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:27:28 2022] GET /identity/v3/projects/97d14fb39d374cda88cb2519c202dc02 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:28.341879 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbf08a-5642-48e3-9d6c-6e2d205bd68b None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:28.443328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbf08a-5642-48e3-9d6c-6e2d205bd68b None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:28.480718 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d653599-87f9-4e20-af2d-ac9a49c28ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:28.481378 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d653599-87f9-4e20-af2d-ac9a49c28ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:28.481666 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d653599-87f9-4e20-af2d-ac9a49c28ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:28.481943 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d653599-87f9-4e20-af2d-ac9a49c28ea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:28.483017 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d653599-87f9-4e20-af2d-ac9a49c28ea8 None admin] RBAC: Adding query filter params (role.id=bb6c5483d9be4a16ac64750536c5e2e2, scope.project.id=97d14fb39d374cda88cb2519c202dc02, user.id=6d7041c433f44f3680df1162bc9e70ef) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:27:28.483362 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d653599-87f9-4e20-af2d-ac9a49c28ea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:28.484828 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d653599-87f9-4e20-af2d-ac9a49c28ea8 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:28.490147 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 599/1185] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:27:28 2022] GET /identity/v3/role_assignments?user.id=6d7041c433f44f3680df1162bc9e70ef&scope.project.id=97d14fb39d374cda88cb2519c202dc02&role.id=bb6c5483d9be4a16ac64750536c5e2e2 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:30.678559 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dc16f-d6d5-4a40-bbe7-eb7354d20d6f None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:30.679112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dc16f-d6d5-4a40-bbe7-eb7354d20d6f None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:30.679112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dc16f-d6d5-4a40-bbe7-eb7354d20d6f None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:30.680501 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 587/1186] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:30.685753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3384d34-6beb-4216-8918-31770b308b11 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:30.686121 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3384d34-6beb-4216-8918-31770b308b11 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:30.686305 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3384d34-6beb-4216-8918-31770b308b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:30.703111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-d3384d34-6beb-4216-8918-31770b308b11 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:30.704706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d3384d34-6beb-4216-8918-31770b308b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:30.732207 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:30.773269 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 600/1187] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:27:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:27:30.795742 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398dc16f-d6d5-4a40-bbe7-eb7354d20d6f None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:30.893827 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398dc16f-d6d5-4a40-bbe7-eb7354d20d6f None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:30.926257 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d1d7f-8c1f-4a54-97a9-a3cdb914010e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:30.927030 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d1d7f-8c1f-4a54-97a9-a3cdb914010e None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:30.927336 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d1d7f-8c1f-4a54-97a9-a3cdb914010e None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:30.927613 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d1d7f-8c1f-4a54-97a9-a3cdb914010e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:30.934242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:30.938145 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d1d7f-8c1f-4a54-97a9-a3cdb914010e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:27:30.946122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-446d1d7f-8c1f-4a54-97a9-a3cdb914010e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:27:30.946122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:27:30.946122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:27:30.946122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:27:30.946122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:27:30.946122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:27:30.946122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:27:30.946122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:27:30.946122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:27:30.946122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:27:30.946122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:27:30.946122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:27:30.946122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:27:30.946122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:27:30.946122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:27:30.946122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:27:30.947362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:27:30.947362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:27:30.947362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:27:30.947362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:27:30.947362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:27:30.947362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:27:30.947362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:27:30.947362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:27:30.947362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:27:30.947362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:27:30.947362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:27:30.947362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:27:30.947362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:27:30.947362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:27:30.947362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:27:30.947362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:27:30.948219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:27:30.948219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:27:30.948219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:27:30.948219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:27:30.948219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:27:30.948219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:27:30.948219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:27:30.948219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:27:30.948219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:27:30.948219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:27:30.948219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:27:30.948219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:27:30.948219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 588/1188] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:27:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:27:30.953788 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3384d34-6beb-4216-8918-31770b308b11 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:31.049599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3384d34-6beb-4216-8918-31770b308b11 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:31.082836 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cd3d8-8fbd-4b5c-9f54-250d2add81f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:31.083534 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cd3d8-8fbd-4b5c-9f54-250d2add81f8 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:31.083815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cd3d8-8fbd-4b5c-9f54-250d2add81f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:31.084090 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cd3d8-8fbd-4b5c-9f54-250d2add81f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:31.084819 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cd3d8-8fbd-4b5c-9f54-250d2add81f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:27:31.085125 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cd3d8-8fbd-4b5c-9f54-250d2add81f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:31.086494 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cd3d8-8fbd-4b5c-9f54-250d2add81f8 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:31.094838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 601/1189] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:27:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:31.100684 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d1d7f-8c1f-4a54-97a9-a3cdb914010e None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:31.196006 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d1d7f-8c1f-4a54-97a9-a3cdb914010e None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:31.227857 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd90c4a-494d-44e3-8857-b02ae47ae25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:31.228711 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd90c4a-494d-44e3-8857-b02ae47ae25d None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:31.228989 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd90c4a-494d-44e3-8857-b02ae47ae25d None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:31.229263 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd90c4a-494d-44e3-8857-b02ae47ae25d None admin] PATH_INFO: `/v3/users/6d7041c433f44f3680df1162bc9e70ef` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:31.230413 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd90c4a-494d-44e3-8857-b02ae47ae25d None admin] RBAC: Authorizing `identity:get_user(user_id=6d7041c433f44f3680df1162bc9e70ef)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:31.231851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd90c4a-494d-44e3-8857-b02ae47ae25d None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:31.233882 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 589/1190] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:27:31 2022] GET /identity/v3/users/6d7041c433f44f3680df1162bc9e70ef => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:31.239493 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cd3d8-8fbd-4b5c-9f54-250d2add81f8 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:31.267638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:31.337798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cd3d8-8fbd-4b5c-9f54-250d2add81f8 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:31.369786 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30d31a-57ce-4e19-b392-5b3949fb08e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:31.370626 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30d31a-57ce-4e19-b392-5b3949fb08e4 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:31.370916 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30d31a-57ce-4e19-b392-5b3949fb08e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:31.371196 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30d31a-57ce-4e19-b392-5b3949fb08e4 None admin] PATH_INFO: `/v3/projects/97d14fb39d374cda88cb2519c202dc02` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:31.372387 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30d31a-57ce-4e19-b392-5b3949fb08e4 None admin] RBAC: Authorizing `identity:get_project(project_id=97d14fb39d374cda88cb2519c202dc02)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:31.373822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30d31a-57ce-4e19-b392-5b3949fb08e4 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:31.376044 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 602/1191] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:27:31 2022] GET /identity/v3/projects/97d14fb39d374cda88cb2519c202dc02 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:31.381752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd90c4a-494d-44e3-8857-b02ae47ae25d None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:31.445047 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:31.479267 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd90c4a-494d-44e3-8857-b02ae47ae25d None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:31.511404 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b85b33-130d-4d1d-b7b4-cad4328c0913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:31.512274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b85b33-130d-4d1d-b7b4-cad4328c0913 None admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:31.512557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b85b33-130d-4d1d-b7b4-cad4328c0913 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:31.512831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b85b33-130d-4d1d-b7b4-cad4328c0913 None admin] PATH_INFO: `/v3/projects/97d14fb39d374cda88cb2519c202dc02/users/6d7041c433f44f3680df1162bc9e70ef/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:31.514740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b85b33-130d-4d1d-b7b4-cad4328c0913 None admin] RBAC: Authorizing `identity:create_grant(project_id=97d14fb39d374cda88cb2519c202dc02, user_id=6d7041c433f44f3680df1162bc9e70ef, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:31.516721 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b85b33-130d-4d1d-b7b4-cad4328c0913 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:31.528399 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 590/1192] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:27:31 2022] PUT /identity/v3/projects/97d14fb39d374cda88cb2519c202dc02/users/6d7041c433f44f3680df1162bc9e70ef/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:27:33.688357 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8b29c-0528-4af3-9413-bc7c853ad4e3 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:33.688928 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8b29c-0528-4af3-9413-bc7c853ad4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:33.688928 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8b29c-0528-4af3-9413-bc7c853ad4e3 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:33.690277 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 603/1193] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:27:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:27:33.695457 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e19c18-4a16-4995-8d43-be6b2a28ec67 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:33.695846 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e19c18-4a16-4995-8d43-be6b2a28ec67 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:33.696022 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e19c18-4a16-4995-8d43-be6b2a28ec67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:33.712369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-b7e19c18-4a16-4995-8d43-be6b2a28ec67 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:27:33.713545 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-b7e19c18-4a16-4995-8d43-be6b2a28ec67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:27:33.779898 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 591/1194] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:27:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:27:33.803046 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8b29c-0528-4af3-9413-bc7c853ad4e3 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:33.895349 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:33.903227 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8b29c-0528-4af3-9413-bc7c853ad4e3 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:33.936115 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fec1fa-8b5e-49fc-81e2-6c220cb4ab8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:33.936914 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fec1fa-8b5e-49fc-81e2-6c220cb4ab8c None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:33.937200 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fec1fa-8b5e-49fc-81e2-6c220cb4ab8c None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:33.937476 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fec1fa-8b5e-49fc-81e2-6c220cb4ab8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:33.947797 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fec1fa-8b5e-49fc-81e2-6c220cb4ab8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:27:33.955382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-d9fec1fa-8b5e-49fc-81e2-6c220cb4ab8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:27:33.955382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:27:33.955382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:27:33.955382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:27:33.955382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:27:33.955382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:27:33.955382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:27:33.955382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:27:33.955382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:27:33.955382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:27:33.955382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:27:33.955382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:27:33.955382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:27:33.955382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:27:33.955382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:27:33.955382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:27:33.956482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:27:33.956482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:27:33.956482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:27:33.956482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:27:33.956482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:27:33.956482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:27:33.956482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:27:33.956482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:27:33.956482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:27:33.956482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:27:33.956482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:27:33.956482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:27:33.956482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:27:33.956482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:27:33.956482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:27:33.956482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:27:33.957366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:27:33.957366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:27:33.957366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:27:33.957366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:27:33.957366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:27:33.957366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:27:33.957366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:27:33.957366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:27:33.957366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:27:33.957366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:27:33.957366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:27:33.957366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:27:33.957366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 604/1195] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:27:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:27:33.962378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e19c18-4a16-4995-8d43-be6b2a28ec67 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:34.016370 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:34.059245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e19c18-4a16-4995-8d43-be6b2a28ec67 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:34.091469 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ac337-3db6-4605-b293-6357cbfdc93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:34.092130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ac337-3db6-4605-b293-6357cbfdc93b None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:34.092409 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ac337-3db6-4605-b293-6357cbfdc93b None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:34.092681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ac337-3db6-4605-b293-6357cbfdc93b None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:34.093946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ac337-3db6-4605-b293-6357cbfdc93b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:27:34.094249 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ac337-3db6-4605-b293-6357cbfdc93b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:34.095638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ac337-3db6-4605-b293-6357cbfdc93b None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:34.103378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 592/1196] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:27:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:34.109894 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fec1fa-8b5e-49fc-81e2-6c220cb4ab8c None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:34.205369 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fec1fa-8b5e-49fc-81e2-6c220cb4ab8c None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:34.238027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cffa4f-298c-43ec-bcfc-aac62525193e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:34.238879 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cffa4f-298c-43ec-bcfc-aac62525193e None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:34.239165 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cffa4f-298c-43ec-bcfc-aac62525193e None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:34.239466 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cffa4f-298c-43ec-bcfc-aac62525193e None admin] PATH_INFO: `/v3/users/6d7041c433f44f3680df1162bc9e70ef` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:34.240632 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cffa4f-298c-43ec-bcfc-aac62525193e None admin] RBAC: Authorizing `identity:get_user(user_id=6d7041c433f44f3680df1162bc9e70ef)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:34.242064 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cffa4f-298c-43ec-bcfc-aac62525193e None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:34.243679 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 605/1197] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 09:27:34 2022] GET /identity/v3/users/6d7041c433f44f3680df1162bc9e70ef => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:34.249220 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ac337-3db6-4605-b293-6357cbfdc93b None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:34.345543 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ac337-3db6-4605-b293-6357cbfdc93b None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:34.361698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:34.377882 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ac09e-7a85-4ca4-9a73-827203f9a494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:34.378516 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ac09e-7a85-4ca4-9a73-827203f9a494 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:34.378794 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ac09e-7a85-4ca4-9a73-827203f9a494 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:34.379062 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ac09e-7a85-4ca4-9a73-827203f9a494 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:34.442398 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ac09e-7a85-4ca4-9a73-827203f9a494 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:34.443858 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ac09e-7a85-4ca4-9a73-827203f9a494 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:34.536801 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 593/1198] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:27:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:27:34.542634 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cffa4f-298c-43ec-bcfc-aac62525193e None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:34.567037 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:34.639934 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cffa4f-298c-43ec-bcfc-aac62525193e None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:34.672525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fefd6a-7dbf-4276-8521-36bbebdcae4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:34.673358 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fefd6a-7dbf-4276-8521-36bbebdcae4b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:34.673637 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fefd6a-7dbf-4276-8521-36bbebdcae4b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:34.673910 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fefd6a-7dbf-4276-8521-36bbebdcae4b None admin] PATH_INFO: `/v3/projects/97d14fb39d374cda88cb2519c202dc02` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:34.675068 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fefd6a-7dbf-4276-8521-36bbebdcae4b None admin] RBAC: Authorizing `identity:get_project(project_id=97d14fb39d374cda88cb2519c202dc02)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:34.676527 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fefd6a-7dbf-4276-8521-36bbebdcae4b None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:34.678160 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 606/1199] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 09:27:34 2022] GET /identity/v3/projects/97d14fb39d374cda88cb2519c202dc02 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:34.683997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ac09e-7a85-4ca4-9a73-827203f9a494 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:27:34.701410 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:34.777772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ac09e-7a85-4ca4-9a73-827203f9a494 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:27:34.814751 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3663c8d-1cdc-4fb5-a320-c337bba0139f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:27:34.815356 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3663c8d-1cdc-4fb5-a320-c337bba0139f None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:27:34.815649 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3663c8d-1cdc-4fb5-a320-c337bba0139f None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:27:34.815926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3663c8d-1cdc-4fb5-a320-c337bba0139f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:27:34.816747 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3663c8d-1cdc-4fb5-a320-c337bba0139f None admin] RBAC: Adding query filter params (role.id=bb6c5483d9be4a16ac64750536c5e2e2, scope.project.id=97d14fb39d374cda88cb2519c202dc02, user.id=6d7041c433f44f3680df1162bc9e70ef) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:27:34.817062 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3663c8d-1cdc-4fb5-a320-c337bba0139f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:27:34.818469 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3663c8d-1cdc-4fb5-a320-c337bba0139f None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:27:34.824130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 594/1200] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:27:34 2022] GET /identity/v3/role_assignments?user.id=6d7041c433f44f3680df1162bc9e70ef&scope.project.id=97d14fb39d374cda88cb2519c202dc02&role.id=bb6c5483d9be4a16ac64750536c5e2e2 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:27:44.668043 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=55 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:27:44.821513 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=59 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:35.117863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37cfd3-7ef4-4d8c-b343-0462bca17c8b None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:35.118664 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37cfd3-7ef4-4d8c-b343-0462bca17c8b None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:35.118664 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37cfd3-7ef4-4d8c-b343-0462bca17c8b None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:35.120093 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 607/1201] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:35.134735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17006749-2a1b-4809-a522-6f944fc8ddd8 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:35.134735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17006749-2a1b-4809-a522-6f944fc8ddd8 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:35.134735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17006749-2a1b-4809-a522-6f944fc8ddd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:35.159496 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-17006749-2a1b-4809-a522-6f944fc8ddd8 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:35.161190 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-17006749-2a1b-4809-a522-6f944fc8ddd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:35.261991 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 595/1202] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:28:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:28:35.295559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37cfd3-7ef4-4d8c-b343-0462bca17c8b None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:35.451370 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37cfd3-7ef4-4d8c-b343-0462bca17c8b None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:35.498614 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fec4f9-52ea-4872-8e36-2fa996a60496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:35.499542 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fec4f9-52ea-4872-8e36-2fa996a60496 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:35.499832 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fec4f9-52ea-4872-8e36-2fa996a60496 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:35.500108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fec4f9-52ea-4872-8e36-2fa996a60496 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:35.514128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fec4f9-52ea-4872-8e36-2fa996a60496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:35.516865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fec4f9-52ea-4872-8e36-2fa996a60496 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:35.537798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-19fec4f9-52ea-4872-8e36-2fa996a60496 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:28:35.537798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:35.537798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:35.537798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:35.537798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:35.537798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:35.537798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:35.537798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:35.537798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:35.537798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:35.537798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:35.537798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:35.537798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:28:35.537798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:28:35.537798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:28:35.539047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:28:35.539047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:35.539047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:35.539047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:35.539047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:35.539047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:35.539047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:35.539047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:35.539047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:28:35.539047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:35.539047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:35.539047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:35.539047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:35.539047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:35.539047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:35.539047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:35.539047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:35.540535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:28:35.540535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:28:35.540535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:28:35.540535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:28:35.540535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 608/1203] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:28:35.545397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17006749-2a1b-4809-a522-6f944fc8ddd8 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:35.674591 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17006749-2a1b-4809-a522-6f944fc8ddd8 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:35.713662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:35.721172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207a1cd-7c24-4741-ab36-4207062e15de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:35.721987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207a1cd-7c24-4741-ab36-4207062e15de None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:35.722295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207a1cd-7c24-4741-ab36-4207062e15de None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:35.722577 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207a1cd-7c24-4741-ab36-4207062e15de None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:35.727393 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207a1cd-7c24-4741-ab36-4207062e15de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:35.727393 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207a1cd-7c24-4741-ab36-4207062e15de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:35.728122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207a1cd-7c24-4741-ab36-4207062e15de None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:35.742343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 596/1204] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:28:35.748799 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fec4f9-52ea-4872-8e36-2fa996a60496 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:35.825139 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:35.903167 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fec4f9-52ea-4872-8e36-2fa996a60496 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:35.950148 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e890c-9e2c-4c53-bcf1-d67df6145257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:35.950912 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e890c-9e2c-4c53-bcf1-d67df6145257 None admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:35.951219 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e890c-9e2c-4c53-bcf1-d67df6145257 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:35.951559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e890c-9e2c-4c53-bcf1-d67df6145257 None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:35.952376 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e890c-9e2c-4c53-bcf1-d67df6145257 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:35.953923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e890c-9e2c-4c53-bcf1-d67df6145257 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:35.991389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 609/1205] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 09:28:35 2022] POST /identity/v3/users => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:28:38.674271 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fd8a6-fcfb-43eb-b026-a8a851fac415 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:38.674886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fd8a6-fcfb-43eb-b026-a8a851fac415 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:38.675270 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fd8a6-fcfb-43eb-b026-a8a851fac415 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:38.677823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 597/1206] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:28:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:38.687812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2e82d-f679-4a4c-b9a2-752df2309cce None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:38.688427 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2e82d-f679-4a4c-b9a2-752df2309cce None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:38.688775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2e82d-f679-4a4c-b9a2-752df2309cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:38.713204 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-51c2e82d-f679-4a4c-b9a2-752df2309cce None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:38.714469 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-51c2e82d-f679-4a4c-b9a2-752df2309cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:38.804218 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 610/1207] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:28:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:28:38.829345 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fd8a6-fcfb-43eb-b026-a8a851fac415 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:38.952359 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fd8a6-fcfb-43eb-b026-a8a851fac415 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:38.995563 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb56e6-5b75-42c8-b30e-8a8cecca88a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:38.996441 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb56e6-5b75-42c8-b30e-8a8cecca88a0 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:38.996708 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb56e6-5b75-42c8-b30e-8a8cecca88a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:38.997014 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb56e6-5b75-42c8-b30e-8a8cecca88a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:39.009979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb56e6-5b75-42c8-b30e-8a8cecca88a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:28:39.018475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-4ceb56e6-5b75-42c8-b30e-8a8cecca88a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:28:39.018475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:39.018475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:39.018475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:39.018475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:39.018475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:39.018475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:39.018475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:39.018475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:39.018475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:39.018475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:39.018475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:39.018475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:28:39.018475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:28:39.018475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:28:39.018475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:28:39.019467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:28:39.019467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:28:39.019467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:28:39.019467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:28:39.019467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:39.019467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:39.019467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:39.019467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:39.019467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:39.019467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:39.019467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:39.019467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:28:39.019467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:39.019467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:39.019467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:39.019467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:39.020507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:39.020507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:39.020507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:39.020507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:39.020507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:28:39.020507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:28:39.020507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:28:39.020507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:28:39.020507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:28:39.020507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:28:39.020507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:28:39.020507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:28:39.020507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 598/1208] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 09:28:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:28:39.025932 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2e82d-f679-4a4c-b9a2-752df2309cce None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:39.082186 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:39.157166 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2e82d-f679-4a4c-b9a2-752df2309cce None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:39.194944 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a8664-e26d-4452-bdcd-392f4b7eeffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:39.195641 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a8664-e26d-4452-bdcd-392f4b7eeffd None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:39.195922 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a8664-e26d-4452-bdcd-392f4b7eeffd None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:39.196202 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a8664-e26d-4452-bdcd-392f4b7eeffd None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:39.196936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a8664-e26d-4452-bdcd-392f4b7eeffd None admin] RBAC: Adding query filter params (name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:39.197240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a8664-e26d-4452-bdcd-392f4b7eeffd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:39.198709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a8664-e26d-4452-bdcd-392f4b7eeffd None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:39.212866 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 611/1209] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 09:28:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:28:39.214208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb56e6-5b75-42c8-b30e-8a8cecca88a0 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:39.270070 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:39.329577 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb56e6-5b75-42c8-b30e-8a8cecca88a0 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:39.376744 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a837de-a439-4d80-89cd-89a4e135ce9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:39.377971 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a837de-a439-4d80-89cd-89a4e135ce9b None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:39.378110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a837de-a439-4d80-89cd-89a4e135ce9b None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:39.378487 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a837de-a439-4d80-89cd-89a4e135ce9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:39.391217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a837de-a439-4d80-89cd-89a4e135ce9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:39.392912 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a837de-a439-4d80-89cd-89a4e135ce9b None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:39.413405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-75a837de-a439-4d80-89cd-89a4e135ce9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:28:39.413405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:39.413405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:39.413405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:39.413405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:39.413405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:39.413405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:39.413405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:39.413405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:39.413405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:39.413405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:39.413405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:39.413405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:28:39.413405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:28:39.413405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:28:39.414499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:28:39.414499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:39.414499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:39.414499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:39.414499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:39.414499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:39.414499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:39.414499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:39.414499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:28:39.414499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:39.414499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:39.414499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:39.414499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:39.414499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:39.414499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:39.414499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:39.414499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:39.415438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:28:39.415438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:28:39.415438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:28:39.415438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:28:39.415438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 599/1210] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:28:39.420684 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a8664-e26d-4452-bdcd-392f4b7eeffd None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:39.541684 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:39.545694 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a8664-e26d-4452-bdcd-392f4b7eeffd None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:39.585292 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3efdc8-dbe8-44fa-abc0-9c6ddcaa0a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:39.586074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3efdc8-dbe8-44fa-abc0-9c6ddcaa0a0f None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:39.586286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3efdc8-dbe8-44fa-abc0-9c6ddcaa0a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:39.586542 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3efdc8-dbe8-44fa-abc0-9c6ddcaa0a0f None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:39.587259 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3efdc8-dbe8-44fa-abc0-9c6ddcaa0a0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:39.588926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3efdc8-dbe8-44fa-abc0-9c6ddcaa0a0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:39.589030 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3efdc8-dbe8-44fa-abc0-9c6ddcaa0a0f None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:39.603335 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 612/1211] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:28:39.609765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a837de-a439-4d80-89cd-89a4e135ce9b None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:39.734391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a837de-a439-4d80-89cd-89a4e135ce9b None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:39.736120 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:39.773721 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246b12a-a0c6-48c9-8106-f8c967032aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:39.774913 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246b12a-a0c6-48c9-8106-f8c967032aec None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:39.779901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246b12a-a0c6-48c9-8106-f8c967032aec None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:39.779901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246b12a-a0c6-48c9-8106-f8c967032aec None admin] PATH_INFO: `/v3/users/placement` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:39.786572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246b12a-a0c6-48c9-8106-f8c967032aec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:39.788129 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246b12a-a0c6-48c9-8106-f8c967032aec None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:39.803983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-4246b12a-a0c6-48c9-8106-f8c967032aec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 09:28:39.803983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:39.803983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:39.803983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:39.803983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:39.803983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:39.803983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:39.803983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:39.803983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:39.803983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:39.803983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:39.803983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:39.803983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:28:39.803983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:28:39.803983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:28:39.803983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:28:39.805067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:39.805067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:39.805067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:28:39.805067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:28:39.805067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:28:39.805067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:28:39.805067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:39.805067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:39.805067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:39.805067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:39.805067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:39.805067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:28:39.805067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:39.805067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:39.805067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:39.805067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:39.805067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:39.805067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:39.806144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:39.806144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:39.806144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:28:39.806144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:28:39.806144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:28:39.806144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:28:39.806144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:28:39.806144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:28:39.806144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 09:28:39.806144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:28:39.806144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 600/1212] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:28:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:28:39.811745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3efdc8-dbe8-44fa-abc0-9c6ddcaa0a0f None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:39.953075 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3efdc8-dbe8-44fa-abc0-9c6ddcaa0a0f None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:39.995554 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa3829-c765-4adc-b979-3ad37480143a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:39.996235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa3829-c765-4adc-b979-3ad37480143a None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:39.996519 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa3829-c765-4adc-b979-3ad37480143a None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:39.996825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa3829-c765-4adc-b979-3ad37480143a None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:39.997825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa3829-c765-4adc-b979-3ad37480143a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:39.998161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa3829-c765-4adc-b979-3ad37480143a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:39.999659 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa3829-c765-4adc-b979-3ad37480143a None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:40.019268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 613/1213] 10.222.0.41 () {56 vars in 1143 bytes} [Fri May 27 09:28:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:28:40.028422 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246b12a-a0c6-48c9-8106-f8c967032aec None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:40.154016 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246b12a-a0c6-48c9-8106-f8c967032aec None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:40.192436 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789149bd-7397-406c-825d-b935f1dfa107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:40.193085 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789149bd-7397-406c-825d-b935f1dfa107 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:40.193428 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789149bd-7397-406c-825d-b935f1dfa107 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:40.193745 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789149bd-7397-406c-825d-b935f1dfa107 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:40.225091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:40.267726 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789149bd-7397-406c-825d-b935f1dfa107 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:40.269391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789149bd-7397-406c-825d-b935f1dfa107 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:40.397831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 601/1214] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:28:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:28:40.403916 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa3829-c765-4adc-b979-3ad37480143a None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:40.425980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:40.518492 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa3829-c765-4adc-b979-3ad37480143a None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:40.564009 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3899b-e94c-4c1b-adca-08c032f2515f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:40.565020 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3899b-e94c-4c1b-adca-08c032f2515f None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:40.565345 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3899b-e94c-4c1b-adca-08c032f2515f None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:40.565624 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3899b-e94c-4c1b-adca-08c032f2515f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:40.578038 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3899b-e94c-4c1b-adca-08c032f2515f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:40.579877 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3899b-e94c-4c1b-adca-08c032f2515f None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:40.600880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-69b3899b-e94c-4c1b-adca-08c032f2515f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:28:40.600880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:40.600880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:40.600880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:40.600880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:40.600880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:40.600880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:40.600880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:40.600880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:40.600880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:40.600880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:40.600880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:40.600880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:28:40.600880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:28:40.600880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:28:40.602468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:28:40.602468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:40.602468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:40.602468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:40.602468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:40.602468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:40.602468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:40.602468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:40.602468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:28:40.602468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:40.602468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:40.602468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:40.602468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:40.602468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:40.602468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:40.602468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:40.602468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:40.603494 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:28:40.603494 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:28:40.603494 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:28:40.603494 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:28:40.603494 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 614/1215] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:28:40.609935 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789149bd-7397-406c-825d-b935f1dfa107 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:40.678717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:40.725876 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789149bd-7397-406c-825d-b935f1dfa107 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:40.771560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6b5e9-2e1b-42ea-bc5f-71081d945d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:40.772439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6b5e9-2e1b-42ea-bc5f-71081d945d96 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:40.772668 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6b5e9-2e1b-42ea-bc5f-71081d945d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:40.772938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6b5e9-2e1b-42ea-bc5f-71081d945d96 None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:40.773915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6b5e9-2e1b-42ea-bc5f-71081d945d96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:40.774353 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6b5e9-2e1b-42ea-bc5f-71081d945d96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:40.776032 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6b5e9-2e1b-42ea-bc5f-71081d945d96 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:40.791675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 602/1216] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:28:40.799376 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3899b-e94c-4c1b-adca-08c032f2515f None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:40.881270 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:40.917942 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3899b-e94c-4c1b-adca-08c032f2515f None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:40.955968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51418180-6085-44a4-b461-5648de5eb7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:40.956817 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51418180-6085-44a4-b461-5648de5eb7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:40.957094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51418180-6085-44a4-b461-5648de5eb7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:40.957397 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51418180-6085-44a4-b461-5648de5eb7d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:40.965286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51418180-6085-44a4-b461-5648de5eb7d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:40.967701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51418180-6085-44a4-b461-5648de5eb7d7 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:40.984350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-51418180-6085-44a4-b461-5648de5eb7d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:28:40.984350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:40.984350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:40.984350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:40.984350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:40.984350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:40.984350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:40.984350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:40.984350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:40.984350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:40.984350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:40.984350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:40.984350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:28:40.984350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:28:40.984350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:28:40.985454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:28:40.985454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:40.985454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:40.985454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:40.985454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:40.985454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:40.985454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:40.985454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:40.985454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:28:40.985454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:40.985454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:40.985454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:40.985454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:40.985454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:40.985454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:40.985454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:40.985454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:40.988168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:28:40.988168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:28:40.988168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:28:40.988168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:28:40.988168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:28:40.988168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:28:40.988168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:28:40.988168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:28:40.988168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 615/1217] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:28:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:28:40.991530 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6b5e9-2e1b-42ea-bc5f-71081d945d96 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:41.107708 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6b5e9-2e1b-42ea-bc5f-71081d945d96 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:41.136624 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:41.149554 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8905ef9-0067-4fa4-813e-f0f1acbd2c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:41.151090 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8905ef9-0067-4fa4-813e-f0f1acbd2c06 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:41.151090 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8905ef9-0067-4fa4-813e-f0f1acbd2c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:41.151090 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8905ef9-0067-4fa4-813e-f0f1acbd2c06 None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:41.152873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8905ef9-0067-4fa4-813e-f0f1acbd2c06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:41.152873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8905ef9-0067-4fa4-813e-f0f1acbd2c06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:41.155981 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8905ef9-0067-4fa4-813e-f0f1acbd2c06 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:41.172962 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 603/1218] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:28:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:28:41.174836 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51418180-6085-44a4-b461-5648de5eb7d7 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:41.292429 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51418180-6085-44a4-b461-5648de5eb7d7 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:41.328810 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:41.336842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3e82e-be5e-4707-8a42-c3cff82ca55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:41.337624 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3e82e-be5e-4707-8a42-c3cff82ca55e None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:41.337950 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3e82e-be5e-4707-8a42-c3cff82ca55e None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:41.338303 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3e82e-be5e-4707-8a42-c3cff82ca55e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:41.339257 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3e82e-be5e-4707-8a42-c3cff82ca55e None admin] RBAC: Adding query filter params (role.id=5cde0d2bc9ca433b8904823fc602ab67, scope.project.id=b1d802dc0211467fa4e709cd01d411dc, user.id=746fd8ed517446fe89c53df873abb2ec) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:41.339605 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3e82e-be5e-4707-8a42-c3cff82ca55e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:41.341789 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3e82e-be5e-4707-8a42-c3cff82ca55e None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:41.348080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 616/1219] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:28:41 2022] GET /identity/v3/role_assignments?user.id=746fd8ed517446fe89c53df873abb2ec&scope.project.id=b1d802dc0211467fa4e709cd01d411dc&role.id=5cde0d2bc9ca433b8904823fc602ab67 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:28:43.727879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa36f9-8b79-4e03-9300-a38baba3adbd None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:43.728441 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa36f9-8b79-4e03-9300-a38baba3adbd None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:43.728441 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa36f9-8b79-4e03-9300-a38baba3adbd None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:43.729788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 604/1220] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:43.736005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ef8b3-fc64-406a-a7ac-db1caf14b9c5 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:43.736418 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ef8b3-fc64-406a-a7ac-db1caf14b9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:43.736561 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ef8b3-fc64-406a-a7ac-db1caf14b9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:43.756305 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-465ef8b3-fc64-406a-a7ac-db1caf14b9c5 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:43.758088 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-465ef8b3-fc64-406a-a7ac-db1caf14b9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:43.841702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 617/1221] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:28:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:28:43.865970 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa36f9-8b79-4e03-9300-a38baba3adbd None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:43.985625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa36f9-8b79-4e03-9300-a38baba3adbd None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:44.023848 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bb201-6361-4b3c-a8bc-14aa5c1cbce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:44.024933 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bb201-6361-4b3c-a8bc-14aa5c1cbce7 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:44.025316 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bb201-6361-4b3c-a8bc-14aa5c1cbce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:44.025701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bb201-6361-4b3c-a8bc-14aa5c1cbce7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:44.038337 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bb201-6361-4b3c-a8bc-14aa5c1cbce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:28:44.046741 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-b13bb201-6361-4b3c-a8bc-14aa5c1cbce7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:28:44.046741 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:44.046741 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:44.046741 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:44.046741 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:44.046741 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:44.046741 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:44.046741 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:44.046741 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:44.046741 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:44.046741 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:44.046741 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:44.046741 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:28:44.046741 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:28:44.046741 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:28:44.046741 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:28:44.047937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:28:44.047937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:28:44.047937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:28:44.047937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:28:44.047937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:44.047937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:44.047937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:44.047937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:44.047937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:44.047937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:44.047937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:44.047937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:28:44.047937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:44.047937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:44.047937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:44.047937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:44.053809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:44.053809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:44.053809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:44.053809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:44.053809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:28:44.053809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:28:44.053809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:28:44.053809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:28:44.053809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:28:44.053809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:28:44.053809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:28:44.053809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:28:44.053809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 605/1222] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 09:28:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:28:44.054516 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ef8b3-fc64-406a-a7ac-db1caf14b9c5 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:44.162104 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ef8b3-fc64-406a-a7ac-db1caf14b9c5 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:44.188452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:44.200032 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031d9f1-870d-4368-84c8-b41469b95d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:44.201265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031d9f1-870d-4368-84c8-b41469b95d0e None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:44.201548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031d9f1-870d-4368-84c8-b41469b95d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:44.201844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031d9f1-870d-4368-84c8-b41469b95d0e None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:44.202573 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031d9f1-870d-4368-84c8-b41469b95d0e None admin] RBAC: Adding query filter params (name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:44.202882 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031d9f1-870d-4368-84c8-b41469b95d0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:44.204311 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031d9f1-870d-4368-84c8-b41469b95d0e None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:44.212896 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 618/1223] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 09:28:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:28:44.220097 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bb201-6361-4b3c-a8bc-14aa5c1cbce7 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:44.267321 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:44.340133 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bb201-6361-4b3c-a8bc-14aa5c1cbce7 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:44.375907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2522cf-8779-4231-9468-b38c728258a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:44.378287 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2522cf-8779-4231-9468-b38c728258a9 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:44.378683 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2522cf-8779-4231-9468-b38c728258a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:44.378964 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2522cf-8779-4231-9468-b38c728258a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:44.391527 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2522cf-8779-4231-9468-b38c728258a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:44.393093 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2522cf-8779-4231-9468-b38c728258a9 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:44.410645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-5b2522cf-8779-4231-9468-b38c728258a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:28:44.410645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:44.410645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:44.410645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:44.410645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:44.410645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:44.410645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:44.410645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:44.410645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:44.410645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:44.410645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:44.410645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:44.410645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:28:44.410645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:28:44.410645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:28:44.411752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:28:44.411752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:44.411752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:44.411752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:44.411752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:44.411752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:44.411752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:44.411752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:44.411752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:28:44.411752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:44.411752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:44.411752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:44.411752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:44.411752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:44.411752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:44.411752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:44.411752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:44.412689 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:28:44.412689 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:28:44.412689 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:28:44.412689 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:28:44.412689 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 606/1224] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:28:44.417647 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031d9f1-870d-4368-84c8-b41469b95d0e None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:44.528786 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031d9f1-870d-4368-84c8-b41469b95d0e None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:44.564736 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438483ba-85c4-4bb4-be21-d44dd91b96ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:44.565402 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438483ba-85c4-4bb4-be21-d44dd91b96ec None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:44.565681 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438483ba-85c4-4bb4-be21-d44dd91b96ec None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:44.565955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438483ba-85c4-4bb4-be21-d44dd91b96ec None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:44.566683 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438483ba-85c4-4bb4-be21-d44dd91b96ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:44.566990 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438483ba-85c4-4bb4-be21-d44dd91b96ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:44.568484 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438483ba-85c4-4bb4-be21-d44dd91b96ec None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:44.581637 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 619/1225] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:28:44.587457 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2522cf-8779-4231-9468-b38c728258a9 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:44.702837 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:44.710465 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2522cf-8779-4231-9468-b38c728258a9 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:44.748557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4733dd7-79c5-4ff9-b887-bb9f98471532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:44.749537 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4733dd7-79c5-4ff9-b887-bb9f98471532 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:44.749920 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4733dd7-79c5-4ff9-b887-bb9f98471532 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:44.750225 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4733dd7-79c5-4ff9-b887-bb9f98471532 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:44.760949 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4733dd7-79c5-4ff9-b887-bb9f98471532 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:44.762669 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4733dd7-79c5-4ff9-b887-bb9f98471532 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:44.783909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-c4733dd7-79c5-4ff9-b887-bb9f98471532 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 09:28:44.783909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:44.783909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:44.783909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:44.783909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:44.783909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:44.783909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:44.783909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:44.783909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:44.783909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:44.783909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:44.783909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:44.783909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:28:44.783909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:28:44.783909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:28:44.783909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:28:44.785122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:44.785122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:44.785122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:28:44.785122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:28:44.785122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:28:44.785122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:28:44.785122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:44.785122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:44.785122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:44.785122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:44.785122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:44.785122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:28:44.785122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:44.785122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:44.785122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:44.785122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:44.785122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:44.785122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:44.786063 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:44.786063 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:44.786063 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:28:44.786063 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:28:44.786063 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:28:44.786063 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:28:44.786063 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:28:44.786063 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:28:44.786063 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 09:28:44.786063 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:28:44.786063 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 607/1226] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:28:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:28:44.791959 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438483ba-85c4-4bb4-be21-d44dd91b96ec None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:44.854879 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:44.931757 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438483ba-85c4-4bb4-be21-d44dd91b96ec None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:44.974928 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7b72c-12d7-4795-be15-16485931018a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:44.975691 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7b72c-12d7-4795-be15-16485931018a None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:44.975969 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7b72c-12d7-4795-be15-16485931018a None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:44.976288 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7b72c-12d7-4795-be15-16485931018a None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:44.977119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7b72c-12d7-4795-be15-16485931018a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:44.977418 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7b72c-12d7-4795-be15-16485931018a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:44.978862 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7b72c-12d7-4795-be15-16485931018a None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:44.997430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 620/1227] 10.222.0.41 () {56 vars in 1143 bytes} [Fri May 27 09:28:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:28:45.003430 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4733dd7-79c5-4ff9-b887-bb9f98471532 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:45.119994 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4733dd7-79c5-4ff9-b887-bb9f98471532 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:45.159388 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7414a25-0ec4-411f-9412-e919a5e9fb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:45.160178 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7414a25-0ec4-411f-9412-e919a5e9fb19 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:45.160459 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7414a25-0ec4-411f-9412-e919a5e9fb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:45.160733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7414a25-0ec4-411f-9412-e919a5e9fb19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:45.172990 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7414a25-0ec4-411f-9412-e919a5e9fb19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:45.174143 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7414a25-0ec4-411f-9412-e919a5e9fb19 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:45.193438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-f7414a25-0ec4-411f-9412-e919a5e9fb19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:28:45.193438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:45.193438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:45.193438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:45.193438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:45.193438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:45.193438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:45.193438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:45.193438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:45.193438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:45.193438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:45.193438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:45.193438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:28:45.193438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:28:45.193438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:28:45.197571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:28:45.197571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:45.197571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:45.197571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:45.197571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:45.197571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:45.197571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:45.197571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:45.197571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:28:45.197571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:45.197571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:45.197571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:45.197571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:45.197571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:45.197571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:45.197571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:45.197571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:45.199115 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:28:45.199115 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:28:45.199115 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:28:45.199115 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:28:45.199115 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 608/1228] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:28:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:28:45.202227 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7b72c-12d7-4795-be15-16485931018a None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:45.312715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7b72c-12d7-4795-be15-16485931018a None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:45.315500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:45.351662 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88b45b-09e0-4ed4-b015-8ee6213da595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:45.352449 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88b45b-09e0-4ed4-b015-8ee6213da595 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:45.352739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88b45b-09e0-4ed4-b015-8ee6213da595 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:45.353014 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88b45b-09e0-4ed4-b015-8ee6213da595 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:45.353733 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88b45b-09e0-4ed4-b015-8ee6213da595 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:45.354044 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88b45b-09e0-4ed4-b015-8ee6213da595 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:45.355478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88b45b-09e0-4ed4-b015-8ee6213da595 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:45.367856 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 621/1229] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:28:45.374498 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7414a25-0ec4-411f-9412-e919a5e9fb19 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:45.384755 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:45.487038 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7414a25-0ec4-411f-9412-e919a5e9fb19 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:45.528413 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e4c8f-c86e-475e-bebe-2ae4fbbafc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:45.529418 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e4c8f-c86e-475e-bebe-2ae4fbbafc48 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:45.529776 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e4c8f-c86e-475e-bebe-2ae4fbbafc48 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:45.530134 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e4c8f-c86e-475e-bebe-2ae4fbbafc48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:45.538725 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e4c8f-c86e-475e-bebe-2ae4fbbafc48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:45.540438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e4c8f-c86e-475e-bebe-2ae4fbbafc48 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:45.556230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-be7e4c8f-c86e-475e-bebe-2ae4fbbafc48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:28:45.556230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:45.556230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:45.556230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:45.556230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:45.556230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:45.556230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:45.556230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:45.556230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:45.556230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:45.556230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:45.556230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:45.556230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:28:45.556230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:28:45.556230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:28:45.557149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:28:45.557149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:45.557149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:45.557149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:45.557149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:45.557149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:45.557149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:45.557149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:45.557149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:28:45.557149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:45.557149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:45.557149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:45.557149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:45.557149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:45.557149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:45.557149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:45.557149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:45.563507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:28:45.563507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:28:45.563507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:28:45.563507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:28:45.563507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:28:45.563507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:28:45.563507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:28:45.563507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:28:45.563507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 609/1230] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:28:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:28:45.564122 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88b45b-09e0-4ed4-b015-8ee6213da595 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:45.692989 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88b45b-09e0-4ed4-b015-8ee6213da595 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:45.740011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7020e6d-866e-4284-b3c7-fe678f3bdd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:45.740791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7020e6d-866e-4284-b3c7-fe678f3bdd99 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:45.741181 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7020e6d-866e-4284-b3c7-fe678f3bdd99 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:45.741516 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7020e6d-866e-4284-b3c7-fe678f3bdd99 None admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:45.742397 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7020e6d-866e-4284-b3c7-fe678f3bdd99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:45.742705 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7020e6d-866e-4284-b3c7-fe678f3bdd99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:45.744278 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7020e6d-866e-4284-b3c7-fe678f3bdd99 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:45.757814 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 622/1231] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:28:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:28:45.763777 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e4c8f-c86e-475e-bebe-2ae4fbbafc48 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:45.841484 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:45.880039 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e4c8f-c86e-475e-bebe-2ae4fbbafc48 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:45.917098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8a7ef-674d-4935-b01a-2c5447364372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:45.918170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8a7ef-674d-4935-b01a-2c5447364372 None admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:45.918456 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8a7ef-674d-4935-b01a-2c5447364372 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:45.918777 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8a7ef-674d-4935-b01a-2c5447364372 None admin] PATH_INFO: `/v3/projects/b1d802dc0211467fa4e709cd01d411dc/users/746fd8ed517446fe89c53df873abb2ec/roles/5cde0d2bc9ca433b8904823fc602ab67` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:45.935630 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8a7ef-674d-4935-b01a-2c5447364372 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1d802dc0211467fa4e709cd01d411dc, user_id=746fd8ed517446fe89c53df873abb2ec, role_id=5cde0d2bc9ca433b8904823fc602ab67)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:45.938317 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8a7ef-674d-4935-b01a-2c5447364372 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:45.957938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 610/1232] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:28:45 2022] PUT /identity/v3/projects/b1d802dc0211467fa4e709cd01d411dc/users/746fd8ed517446fe89c53df873abb2ec/roles/5cde0d2bc9ca433b8904823fc602ab67 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:28:48.231582 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa92d76-f6ac-4d54-9071-93f9f5110bdb None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:48.232158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa92d76-f6ac-4d54-9071-93f9f5110bdb None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:48.232158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa92d76-f6ac-4d54-9071-93f9f5110bdb None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:48.233494 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 623/1233] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:28:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:28:48.238648 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe034e-fb3a-4a50-a5cd-1f274da935b1 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:48.239105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe034e-fb3a-4a50-a5cd-1f274da935b1 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:48.239200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe034e-fb3a-4a50-a5cd-1f274da935b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:48.256700 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-44fe034e-fb3a-4a50-a5cd-1f274da935b1 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:48.257969 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-44fe034e-fb3a-4a50-a5cd-1f274da935b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:48.334390 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 611/1234] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:28:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:28:48.358534 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa92d76-f6ac-4d54-9071-93f9f5110bdb None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:48.385555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:48.471146 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa92d76-f6ac-4d54-9071-93f9f5110bdb None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:48.513777 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250fe9c-f1bd-46fc-9542-6e8c22c9b7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:48.514666 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250fe9c-f1bd-46fc-9542-6e8c22c9b7ff None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:48.514950 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250fe9c-f1bd-46fc-9542-6e8c22c9b7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:48.515264 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250fe9c-f1bd-46fc-9542-6e8c22c9b7ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:48.526318 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250fe9c-f1bd-46fc-9542-6e8c22c9b7ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:28:48.534655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-e250fe9c-f1bd-46fc-9542-6e8c22c9b7ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 09:28:48.534655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:48.534655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:48.534655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:48.534655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:48.534655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:48.534655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:48.534655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:48.534655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:48.534655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:48.534655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:48.534655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:48.534655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:28:48.534655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:28:48.534655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:28:48.534655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:28:48.535745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:28:48.535745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:28:48.535745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:28:48.535745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:28:48.535745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:48.535745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:48.535745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:48.535745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:48.535745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:48.535745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:48.535745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:48.535745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:28:48.535745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:48.535745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:48.535745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:48.535745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:48.536859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:48.536859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:48.536859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:48.536859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:48.536859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:28:48.536859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:28:48.536859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:28:48.536859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:28:48.536859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:28:48.536859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:28:48.536859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 09:28:48.536859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:28:48.536859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 624/1235] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 09:28:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:28:48.542420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe034e-fb3a-4a50-a5cd-1f274da935b1 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:48.592368 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:48.648098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe034e-fb3a-4a50-a5cd-1f274da935b1 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:48.682951 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1c58e-ebdc-46fb-bddb-a3413114bbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:48.683662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1c58e-ebdc-46fb-bddb-a3413114bbad None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:48.683944 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1c58e-ebdc-46fb-bddb-a3413114bbad None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:48.684217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1c58e-ebdc-46fb-bddb-a3413114bbad None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:48.685494 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1c58e-ebdc-46fb-bddb-a3413114bbad None admin] RBAC: Adding query filter params (name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:48.685802 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1c58e-ebdc-46fb-bddb-a3413114bbad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:48.687286 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1c58e-ebdc-46fb-bddb-a3413114bbad None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:48.696384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 612/1236] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 09:28:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:28:48.702307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250fe9c-f1bd-46fc-9542-6e8c22c9b7ff None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:48.796959 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:48.818047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250fe9c-f1bd-46fc-9542-6e8c22c9b7ff None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:48.856589 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a76f0-1ad9-4053-958c-3ca7ecb0e28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:48.857293 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a76f0-1ad9-4053-958c-3ca7ecb0e28b None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:48.857619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a76f0-1ad9-4053-958c-3ca7ecb0e28b None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:48.857961 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a76f0-1ad9-4053-958c-3ca7ecb0e28b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:48.870251 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a76f0-1ad9-4053-958c-3ca7ecb0e28b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:48.871794 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a76f0-1ad9-4053-958c-3ca7ecb0e28b None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:48.891307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-578a76f0-1ad9-4053-958c-3ca7ecb0e28b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:28:48.891307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:48.891307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:48.891307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:48.891307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:48.891307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:48.891307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:48.891307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:48.891307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:48.891307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:48.891307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:48.891307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:48.891307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:28:48.891307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:28:48.891307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:28:48.892300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:28:48.892300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:48.892300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:48.892300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:48.892300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:48.892300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:48.892300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:48.892300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:48.892300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:28:48.892300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:48.892300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:48.892300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:48.892300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:48.892300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:48.892300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:48.892300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:48.892300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:48.893186 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:28:48.893186 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:28:48.893186 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:28:48.893186 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:28:48.893186 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 625/1237] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:28:48.898363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1c58e-ebdc-46fb-bddb-a3413114bbad None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:49.003391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1c58e-ebdc-46fb-bddb-a3413114bbad None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:49.013669 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:49.041924 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4ab9f-a789-4f70-b04c-9ea5021bb146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:49.042588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4ab9f-a789-4f70-b04c-9ea5021bb146 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:49.042869 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4ab9f-a789-4f70-b04c-9ea5021bb146 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:49.043226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4ab9f-a789-4f70-b04c-9ea5021bb146 None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:49.044092 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4ab9f-a789-4f70-b04c-9ea5021bb146 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:49.044417 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4ab9f-a789-4f70-b04c-9ea5021bb146 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:49.045918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4ab9f-a789-4f70-b04c-9ea5021bb146 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:49.060769 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 613/1238] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:28:49.066617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a76f0-1ad9-4053-958c-3ca7ecb0e28b None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:49.181262 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a76f0-1ad9-4053-958c-3ca7ecb0e28b None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:49.221573 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8010d8-4b5f-4bca-87cd-4eac3a13a070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:49.222593 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8010d8-4b5f-4bca-87cd-4eac3a13a070 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:49.222914 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8010d8-4b5f-4bca-87cd-4eac3a13a070 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:49.223218 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8010d8-4b5f-4bca-87cd-4eac3a13a070 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:49.226109 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:49.232998 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8010d8-4b5f-4bca-87cd-4eac3a13a070 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:49.234841 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8010d8-4b5f-4bca-87cd-4eac3a13a070 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:49.253024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-fa8010d8-4b5f-4bca-87cd-4eac3a13a070 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 09:28:49.253024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:49.253024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:49.253024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:49.253024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:49.253024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:49.253024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:49.253024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:49.253024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:49.253024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:49.253024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:49.253024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:49.253024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:28:49.253024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:28:49.253024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:28:49.253024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:28:49.254105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:49.254105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:49.254105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:28:49.254105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:28:49.254105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:28:49.254105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:28:49.254105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:49.254105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:49.254105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:49.254105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:49.254105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:49.254105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:28:49.254105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:49.254105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:49.254105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:49.254105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:49.254105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:49.254105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:49.255060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:49.255060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:49.255060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:28:49.255060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:28:49.255060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:28:49.255060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:28:49.255060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:28:49.255060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:28:49.255060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 09:28:49.255060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:28:49.255060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 626/1239] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:28:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:28:49.260654 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4ab9f-a789-4f70-b04c-9ea5021bb146 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:49.371118 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4ab9f-a789-4f70-b04c-9ea5021bb146 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:49.407608 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd915f-8368-4c91-9226-b89a4314f620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:49.408306 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd915f-8368-4c91-9226-b89a4314f620 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:49.408624 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd915f-8368-4c91-9226-b89a4314f620 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:49.408965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd915f-8368-4c91-9226-b89a4314f620 None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:49.409996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd915f-8368-4c91-9226-b89a4314f620 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:49.410317 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd915f-8368-4c91-9226-b89a4314f620 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:49.412011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd915f-8368-4c91-9226-b89a4314f620 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:49.432301 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 614/1240] 10.222.0.41 () {56 vars in 1143 bytes} [Fri May 27 09:28:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:28:49.439329 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8010d8-4b5f-4bca-87cd-4eac3a13a070 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:49.551122 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8010d8-4b5f-4bca-87cd-4eac3a13a070 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:49.587140 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd0283-9e60-4e07-9242-cc0ba28f53e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:49.587811 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd0283-9e60-4e07-9242-cc0ba28f53e4 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:49.588092 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd0283-9e60-4e07-9242-cc0ba28f53e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:49.588369 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd0283-9e60-4e07-9242-cc0ba28f53e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:49.655333 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:49.662719 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd0283-9e60-4e07-9242-cc0ba28f53e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:49.664196 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd0283-9e60-4e07-9242-cc0ba28f53e4 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:49.769114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 627/1241] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:28:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 09:28:49.775493 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd915f-8368-4c91-9226-b89a4314f620 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:49.810526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:49.897746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd915f-8368-4c91-9226-b89a4314f620 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:49.935698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad880f3-324a-45ab-8081-47db55f89620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:49.936523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad880f3-324a-45ab-8081-47db55f89620 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:49.936799 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad880f3-324a-45ab-8081-47db55f89620 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:49.937057 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad880f3-324a-45ab-8081-47db55f89620 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:49.947474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad880f3-324a-45ab-8081-47db55f89620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:49.949069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad880f3-324a-45ab-8081-47db55f89620 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:49.967158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-3ad880f3-324a-45ab-8081-47db55f89620 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:28:49.967158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:49.967158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:49.967158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:49.967158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:49.967158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:49.967158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:49.967158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:49.967158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:49.967158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:49.967158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:49.967158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:49.967158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:28:49.967158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:28:49.967158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:28:49.968397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:28:49.968397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:49.968397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:49.968397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:49.968397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:49.968397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:49.968397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:49.968397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:49.968397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:28:49.968397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:49.968397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:49.968397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:49.968397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:49.968397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:49.968397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:49.968397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:49.968397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:49.972556 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:28:49.972556 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:28:49.972556 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:28:49.972556 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:28:49.972556 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 615/1242] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:28:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:28:49.974182 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd0283-9e60-4e07-9242-cc0ba28f53e4 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:50.075500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:50.083147 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd0283-9e60-4e07-9242-cc0ba28f53e4 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:50.124170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f50387-03b3-4ed8-9468-3bd7961b3ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:50.124930 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f50387-03b3-4ed8-9468-3bd7961b3ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:50.125218 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f50387-03b3-4ed8-9468-3bd7961b3ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:50.125496 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f50387-03b3-4ed8-9468-3bd7961b3ff2 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:50.126324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f50387-03b3-4ed8-9468-3bd7961b3ff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:50.126638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f50387-03b3-4ed8-9468-3bd7961b3ff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:50.128135 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f50387-03b3-4ed8-9468-3bd7961b3ff2 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:50.141077 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 628/1243] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:28:50.146747 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad880f3-324a-45ab-8081-47db55f89620 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:50.256016 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:50.286278 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad880f3-324a-45ab-8081-47db55f89620 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:50.327324 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ad249-fa70-4d11-83b9-4fd35cc3215f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:50.328282 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ad249-fa70-4d11-83b9-4fd35cc3215f None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:50.328669 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ad249-fa70-4d11-83b9-4fd35cc3215f None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:50.328931 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ad249-fa70-4d11-83b9-4fd35cc3215f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:50.337019 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ad249-fa70-4d11-83b9-4fd35cc3215f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:50.338706 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ad249-fa70-4d11-83b9-4fd35cc3215f None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:50.353765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-397ad249-fa70-4d11-83b9-4fd35cc3215f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:28:50.353765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:50.353765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:50.353765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:50.353765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:50.353765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:50.353765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:50.353765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:50.353765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:50.353765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:50.353765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:50.353765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:50.353765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:28:50.353765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:28:50.353765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:28:50.354908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:28:50.354908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:50.354908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:50.354908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:50.354908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:50.354908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:50.354908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:50.354908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:50.354908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:28:50.354908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:50.354908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:50.354908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:50.354908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:50.354908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:50.354908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:50.354908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:50.354908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:50.357076 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:28:50.357076 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:28:50.357076 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:28:50.357076 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:28:50.357076 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:28:50.357076 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:28:50.357076 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:28:50.357076 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:28:50.357076 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 616/1244] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:28:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:28:50.362744 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f50387-03b3-4ed8-9468-3bd7961b3ff2 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:50.486608 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f50387-03b3-4ed8-9468-3bd7961b3ff2 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:50.526561 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d5b1d-9a36-45ba-a757-9dddabce909c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:50.527220 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d5b1d-9a36-45ba-a757-9dddabce909c None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:50.527597 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d5b1d-9a36-45ba-a757-9dddabce909c None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:50.527799 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d5b1d-9a36-45ba-a757-9dddabce909c None admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:50.529295 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d5b1d-9a36-45ba-a757-9dddabce909c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:50.529625 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d5b1d-9a36-45ba-a757-9dddabce909c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:50.531378 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d5b1d-9a36-45ba-a757-9dddabce909c None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:50.548440 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 629/1245] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:28:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:28:50.554578 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ad249-fa70-4d11-83b9-4fd35cc3215f None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:50.670667 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ad249-fa70-4d11-83b9-4fd35cc3215f None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:50.711333 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5e6f7-e679-45bb-9ee6-3573a1b95d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:50.712179 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5e6f7-e679-45bb-9ee6-3573a1b95d94 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:50.712508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5e6f7-e679-45bb-9ee6-3573a1b95d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:50.712795 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5e6f7-e679-45bb-9ee6-3573a1b95d94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:50.713718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5e6f7-e679-45bb-9ee6-3573a1b95d94 None admin] RBAC: Adding query filter params (role.id=5cde0d2bc9ca433b8904823fc602ab67, scope.project.id=b1d802dc0211467fa4e709cd01d411dc, user.id=746fd8ed517446fe89c53df873abb2ec) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:50.714061 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5e6f7-e679-45bb-9ee6-3573a1b95d94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:50.715704 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5e6f7-e679-45bb-9ee6-3573a1b95d94 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:50.722038 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 617/1246] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:28:50 2022] GET /identity/v3/role_assignments?user.id=746fd8ed517446fe89c53df873abb2ec&scope.project.id=b1d802dc0211467fa4e709cd01d411dc&role.id=5cde0d2bc9ca433b8904823fc602ab67 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:28:53.039407 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a16621-7537-4ada-bfd7-b56a83ed325d None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:53.039974 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a16621-7537-4ada-bfd7-b56a83ed325d None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:53.039974 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a16621-7537-4ada-bfd7-b56a83ed325d None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:53.041493 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 630/1247] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:53.046787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46b0b8-d302-4a2f-8c41-c0b112762f62 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:53.047311 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46b0b8-d302-4a2f-8c41-c0b112762f62 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:53.047410 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46b0b8-d302-4a2f-8c41-c0b112762f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:53.052767 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:53.066555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-0f46b0b8-d302-4a2f-8c41-c0b112762f62 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:53.067764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-0f46b0b8-d302-4a2f-8c41-c0b112762f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:53.142929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 618/1248] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:28:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:28:53.169858 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a16621-7537-4ada-bfd7-b56a83ed325d None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:53.188968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:53.291458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a16621-7537-4ada-bfd7-b56a83ed325d None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:53.328637 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7334f-30cc-4a6e-b244-6b6f057576a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:53.329427 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7334f-30cc-4a6e-b244-6b6f057576a9 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:53.329708 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7334f-30cc-4a6e-b244-6b6f057576a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:53.329984 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7334f-30cc-4a6e-b244-6b6f057576a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:53.340338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7334f-30cc-4a6e-b244-6b6f057576a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:28:53.348512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-38c7334f-30cc-4a6e-b244-6b6f057576a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:28:53.348512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:53.348512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:53.348512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:53.348512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:53.348512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:53.348512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:53.348512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:53.348512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:53.348512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:53.348512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:53.348512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:53.348512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:28:53.348512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:28:53.348512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:28:53.348512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:28:53.355005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:28:53.355005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:28:53.355005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:28:53.355005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:28:53.355005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:53.355005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:53.355005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:53.355005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:53.355005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:53.355005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:53.355005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:53.355005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:28:53.355005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:53.355005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:53.355005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:53.355005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:53.356241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:53.356241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:53.356241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:53.356241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:53.356241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:28:53.356241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:28:53.356241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:28:53.356241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:28:53.356241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:28:53.356241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:28:53.356241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:28:53.356241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:28:53.356241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 631/1249] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:28:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:28:53.356944 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46b0b8-d302-4a2f-8c41-c0b112762f62 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:53.474351 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46b0b8-d302-4a2f-8c41-c0b112762f62 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:53.509045 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:53.514818 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c706c-94e0-4b90-af45-65680e8aa273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:53.515551 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c706c-94e0-4b90-af45-65680e8aa273 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:53.515868 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c706c-94e0-4b90-af45-65680e8aa273 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:53.516111 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c706c-94e0-4b90-af45-65680e8aa273 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:53.517079 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c706c-94e0-4b90-af45-65680e8aa273 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:53.517392 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c706c-94e0-4b90-af45-65680e8aa273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:53.518896 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c706c-94e0-4b90-af45-65680e8aa273 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:53.528136 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 619/1250] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:28:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:28:53.534110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7334f-30cc-4a6e-b244-6b6f057576a9 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:53.624935 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:53.650218 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7334f-30cc-4a6e-b244-6b6f057576a9 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:53.688195 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671ba39-4fb5-4ddd-aea8-0815f46ca8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:53.689013 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671ba39-4fb5-4ddd-aea8-0815f46ca8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:53.689410 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671ba39-4fb5-4ddd-aea8-0815f46ca8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:53.689695 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671ba39-4fb5-4ddd-aea8-0815f46ca8c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:53.701997 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671ba39-4fb5-4ddd-aea8-0815f46ca8c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:53.703611 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671ba39-4fb5-4ddd-aea8-0815f46ca8c7 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:53.725301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-5671ba39-4fb5-4ddd-aea8-0815f46ca8c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:28:53.725301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:53.725301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:53.725301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:53.725301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:53.725301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:53.725301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:53.725301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:53.725301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:53.725301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:53.725301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:53.725301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:53.725301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:28:53.725301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:28:53.725301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:28:53.726431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:28:53.726431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:53.726431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:53.726431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:53.726431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:53.726431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:53.726431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:53.726431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:53.726431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:28:53.726431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:53.726431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:53.726431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:53.726431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:53.726431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:53.726431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:53.726431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:53.726431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:53.727541 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:28:53.727541 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:28:53.727541 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:28:53.727541 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:28:53.727541 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 632/1251] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:28:53.735258 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c706c-94e0-4b90-af45-65680e8aa273 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:53.872533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c706c-94e0-4b90-af45-65680e8aa273 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:53.918831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bcb96-cd15-47ad-98f2-ef401aa0133c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:53.919545 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bcb96-cd15-47ad-98f2-ef401aa0133c None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:53.919906 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bcb96-cd15-47ad-98f2-ef401aa0133c None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:53.920177 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bcb96-cd15-47ad-98f2-ef401aa0133c None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:53.920963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5bcb96-cd15-47ad-98f2-ef401aa0133c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:53.921271 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5bcb96-cd15-47ad-98f2-ef401aa0133c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:53.922638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5bcb96-cd15-47ad-98f2-ef401aa0133c None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:53.935230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 620/1252] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:28:53.941058 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671ba39-4fb5-4ddd-aea8-0815f46ca8c7 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:54.045672 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671ba39-4fb5-4ddd-aea8-0815f46ca8c7 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:54.072594 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:54.081903 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f616d5-aa20-4e86-8649-ae8e6b272221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:54.082715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f616d5-aa20-4e86-8649-ae8e6b272221 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:54.082999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f616d5-aa20-4e86-8649-ae8e6b272221 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:54.083297 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f616d5-aa20-4e86-8649-ae8e6b272221 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:54.091242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f616d5-aa20-4e86-8649-ae8e6b272221 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:54.092826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f616d5-aa20-4e86-8649-ae8e6b272221 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:54.107538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-16f616d5-aa20-4e86-8649-ae8e6b272221 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 09:28:54.107538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:54.107538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:54.107538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:54.107538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:54.107538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:54.107538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:54.107538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:54.107538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:54.107538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:54.107538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:54.107538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:54.107538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:28:54.107538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:28:54.107538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:28:54.107538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:28:54.108648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:54.108648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:54.108648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:28:54.108648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:28:54.108648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:28:54.108648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:28:54.108648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:54.108648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:54.108648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:54.108648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:54.108648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:54.108648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:28:54.108648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:54.108648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:54.108648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:54.108648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:54.108648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:54.108648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:54.114870 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:54.114870 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:54.114870 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:28:54.114870 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:28:54.114870 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:28:54.114870 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:28:54.114870 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:28:54.114870 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:28:54.114870 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 09:28:54.114870 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:28:54.114870 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 633/1253] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:28:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:28:54.115758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bcb96-cd15-47ad-98f2-ef401aa0133c None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:54.179535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:54.232143 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bcb96-cd15-47ad-98f2-ef401aa0133c None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:54.267653 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b6757-a2c9-48bc-b463-97b86f1bb478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:54.268327 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b6757-a2c9-48bc-b463-97b86f1bb478 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:54.268608 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b6757-a2c9-48bc-b463-97b86f1bb478 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:54.268880 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b6757-a2c9-48bc-b463-97b86f1bb478 None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:54.269717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b6757-a2c9-48bc-b463-97b86f1bb478 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:54.270141 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b6757-a2c9-48bc-b463-97b86f1bb478 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:54.271888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b6757-a2c9-48bc-b463-97b86f1bb478 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:54.290780 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 621/1254] 10.222.0.41 () {56 vars in 1143 bytes} [Fri May 27 09:28:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:28:54.297658 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f616d5-aa20-4e86-8649-ae8e6b272221 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:54.403419 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f616d5-aa20-4e86-8649-ae8e6b272221 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:54.441762 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6745a-17c2-4852-bceb-f24bd8b13d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:54.442344 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6745a-17c2-4852-bceb-f24bd8b13d9c None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:54.442633 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6745a-17c2-4852-bceb-f24bd8b13d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:54.442916 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6745a-17c2-4852-bceb-f24bd8b13d9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:54.503770 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:54.518120 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6745a-17c2-4852-bceb-f24bd8b13d9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:54.519738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6745a-17c2-4852-bceb-f24bd8b13d9c None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:54.620254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 634/1255] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:28:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 09:28:54.626130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b6757-a2c9-48bc-b463-97b86f1bb478 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:54.728656 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b6757-a2c9-48bc-b463-97b86f1bb478 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:54.744467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:54.768562 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a93d9-d9c0-4f14-a7fb-037014fe4c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:54.769340 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a93d9-d9c0-4f14-a7fb-037014fe4c0a None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:54.769630 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a93d9-d9c0-4f14-a7fb-037014fe4c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:54.769975 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a93d9-d9c0-4f14-a7fb-037014fe4c0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:54.783566 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a93d9-d9c0-4f14-a7fb-037014fe4c0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:54.785070 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a93d9-d9c0-4f14-a7fb-037014fe4c0a None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:54.806378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-ed1a93d9-d9c0-4f14-a7fb-037014fe4c0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:28:54.806378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:54.806378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:54.806378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:54.806378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:54.806378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:54.806378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:54.806378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:54.806378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:54.806378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:54.806378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:54.806378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:54.806378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:28:54.806378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:28:54.806378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:28:54.807549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:28:54.807549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:54.807549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:54.807549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:54.807549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:54.807549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:54.807549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:54.807549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:54.807549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:28:54.807549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:54.807549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:54.807549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:54.807549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:54.807549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:54.807549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:54.807549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:54.807549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:54.808494 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:28:54.808494 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:28:54.808494 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:28:54.808494 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:28:54.808494 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 622/1256] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:28:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:28:54.814496 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6745a-17c2-4852-bceb-f24bd8b13d9c None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:54.913858 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:54.927129 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6745a-17c2-4852-bceb-f24bd8b13d9c None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:54.963949 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561071dd-d27e-4b75-ab4e-abf171e19311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:54.964632 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561071dd-d27e-4b75-ab4e-abf171e19311 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:54.964916 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561071dd-d27e-4b75-ab4e-abf171e19311 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:54.965195 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561071dd-d27e-4b75-ab4e-abf171e19311 None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:54.965968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561071dd-d27e-4b75-ab4e-abf171e19311 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:54.966279 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561071dd-d27e-4b75-ab4e-abf171e19311 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:54.967704 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561071dd-d27e-4b75-ab4e-abf171e19311 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:54.984686 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 635/1257] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:28:54.985751 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a93d9-d9c0-4f14-a7fb-037014fe4c0a None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:55.092999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a93d9-d9c0-4f14-a7fb-037014fe4c0a None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:55.128689 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2251b8-3dfa-4f82-a038-e7c4cfdaa954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:55.129497 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2251b8-3dfa-4f82-a038-e7c4cfdaa954 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:55.129776 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2251b8-3dfa-4f82-a038-e7c4cfdaa954 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:55.130050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2251b8-3dfa-4f82-a038-e7c4cfdaa954 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:55.137445 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2251b8-3dfa-4f82-a038-e7c4cfdaa954 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:55.138905 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2251b8-3dfa-4f82-a038-e7c4cfdaa954 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:55.153838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-7f2251b8-3dfa-4f82-a038-e7c4cfdaa954 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:28:55.153838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:55.153838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:55.153838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:55.153838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:55.153838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:55.153838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:55.153838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:55.153838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:55.153838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:55.153838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:55.153838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:55.153838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:28:55.153838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:28:55.153838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:28:55.154957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:28:55.154957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:55.154957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:55.154957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:55.154957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:55.154957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:55.154957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:55.154957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:55.154957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:28:55.154957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:55.154957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:55.154957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:55.154957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:55.154957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:55.154957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:55.154957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:55.154957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:55.155938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:28:55.155938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:28:55.155938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:28:55.155938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:28:55.155938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:28:55.155938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:28:55.155938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:28:55.155938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:28:55.155938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 623/1258] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:28:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 09:28:55.161249 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561071dd-d27e-4b75-ab4e-abf171e19311 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:55.266842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561071dd-d27e-4b75-ab4e-abf171e19311 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:55.300506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30dfd3-6235-4ca5-9b61-8b6f066ead67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:55.301164 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30dfd3-6235-4ca5-9b61-8b6f066ead67 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:55.301444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30dfd3-6235-4ca5-9b61-8b6f066ead67 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:55.301718 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30dfd3-6235-4ca5-9b61-8b6f066ead67 None admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:55.302495 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30dfd3-6235-4ca5-9b61-8b6f066ead67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:55.302805 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30dfd3-6235-4ca5-9b61-8b6f066ead67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:55.304295 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30dfd3-6235-4ca5-9b61-8b6f066ead67 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:55.316538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 636/1259] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:28:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:28:55.322716 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2251b8-3dfa-4f82-a038-e7c4cfdaa954 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:55.350487 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:55.426863 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2251b8-3dfa-4f82-a038-e7c4cfdaa954 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:55.460254 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51361ff-c8fc-47c4-aae7-5f2636975a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:55.460900 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51361ff-c8fc-47c4-aae7-5f2636975a20 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:55.461184 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51361ff-c8fc-47c4-aae7-5f2636975a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:55.461456 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51361ff-c8fc-47c4-aae7-5f2636975a20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:55.462267 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51361ff-c8fc-47c4-aae7-5f2636975a20 None admin] RBAC: Adding query filter params (role.id=bb6c5483d9be4a16ac64750536c5e2e2, scope.project.id=b1d802dc0211467fa4e709cd01d411dc, user.id=746fd8ed517446fe89c53df873abb2ec) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:55.462575 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51361ff-c8fc-47c4-aae7-5f2636975a20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:55.464025 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51361ff-c8fc-47c4-aae7-5f2636975a20 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:55.469875 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 624/1260] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:28:55 2022] GET /identity/v3/role_assignments?user.id=746fd8ed517446fe89c53df873abb2ec&scope.project.id=b1d802dc0211467fa4e709cd01d411dc&role.id=bb6c5483d9be4a16ac64750536c5e2e2 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:28:57.598061 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6935ee4-3484-43f1-a36d-ce912f1ee6b6 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:57.598585 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6935ee4-3484-43f1-a36d-ce912f1ee6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:57.598698 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6935ee4-3484-43f1-a36d-ce912f1ee6b6 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:57.599995 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 637/1261] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:28:57.605297 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7feeed-f6f9-47ca-879b-175c833ce242 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:57.606451 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7feeed-f6f9-47ca-879b-175c833ce242 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:57.606592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7feeed-f6f9-47ca-879b-175c833ce242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:57.623556 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-3d7feeed-f6f9-47ca-879b-175c833ce242 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:28:57.624738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-3d7feeed-f6f9-47ca-879b-175c833ce242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:28:57.688756 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 625/1262] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:28:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:28:57.710617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6935ee4-3484-43f1-a36d-ce912f1ee6b6 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:57.721302 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:57.817100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6935ee4-3484-43f1-a36d-ce912f1ee6b6 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:57.853934 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d23c3-5387-4eae-93d2-b6f2b1a16b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:57.854648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d23c3-5387-4eae-93d2-b6f2b1a16b93 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:57.854931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d23c3-5387-4eae-93d2-b6f2b1a16b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:57.855209 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d23c3-5387-4eae-93d2-b6f2b1a16b93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:57.869925 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d23c3-5387-4eae-93d2-b6f2b1a16b93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:28:57.882161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-946d23c3-5387-4eae-93d2-b6f2b1a16b93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:28:57.882161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:57.882161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:57.882161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:57.882161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:57.882161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:57.882161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:57.882161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:57.882161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:57.882161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:57.882161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:57.882161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:57.882161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:28:57.882161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:28:57.882161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:28:57.882161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:28:57.883238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:28:57.883238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:28:57.883238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:28:57.883238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:28:57.883238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:57.883238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:57.883238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:57.883238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:57.883238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:57.883238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:57.883238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:57.883238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:28:57.883238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:57.883238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:57.883238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:57.883238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:57.884430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:57.884430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:57.884430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:57.884430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:57.884430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:28:57.884430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:28:57.884430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:28:57.884430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:28:57.884430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:28:57.884430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:28:57.884430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:28:57.884430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:28:57.884430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 638/1263] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:28:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:28:57.889304 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7feeed-f6f9-47ca-879b-175c833ce242 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:57.907622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:57.985956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7feeed-f6f9-47ca-879b-175c833ce242 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:58.018344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb9efe-9fcb-40d3-8c91-58049e51f451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:58.019006 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb9efe-9fcb-40d3-8c91-58049e51f451 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:58.019313 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb9efe-9fcb-40d3-8c91-58049e51f451 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:58.019590 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb9efe-9fcb-40d3-8c91-58049e51f451 None admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:58.020327 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb9efe-9fcb-40d3-8c91-58049e51f451 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:58.020633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb9efe-9fcb-40d3-8c91-58049e51f451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:58.022004 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb9efe-9fcb-40d3-8c91-58049e51f451 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:58.030406 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 626/1264] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:28:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:28:58.036363 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d23c3-5387-4eae-93d2-b6f2b1a16b93 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:58.101271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:58.134012 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d23c3-5387-4eae-93d2-b6f2b1a16b93 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:58.165979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b10ba-8edf-42d8-a094-56d044e34ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:58.166761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b10ba-8edf-42d8-a094-56d044e34ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:58.167039 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b10ba-8edf-42d8-a094-56d044e34ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:58.167335 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b10ba-8edf-42d8-a094-56d044e34ea2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:58.178658 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b10ba-8edf-42d8-a094-56d044e34ea2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:58.180147 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b10ba-8edf-42d8-a094-56d044e34ea2 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:58.196431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-e58b10ba-8edf-42d8-a094-56d044e34ea2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:28:58.196431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:58.196431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:58.196431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:58.196431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:58.196431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:58.196431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:58.196431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:58.196431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:58.196431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:58.196431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:58.196431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:58.196431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:28:58.196431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:28:58.196431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:28:58.197477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:28:58.197477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:58.197477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:58.197477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:58.197477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:58.197477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:58.197477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:58.197477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:58.197477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:28:58.197477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:58.197477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:58.197477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:58.197477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:58.197477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:58.197477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:58.197477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:58.197477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:58.198467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:28:58.198467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:28:58.198467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:28:58.198467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:28:58.198467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 639/1265] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:28:58.203314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb9efe-9fcb-40d3-8c91-58049e51f451 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:58.282030 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:58.300361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb9efe-9fcb-40d3-8c91-58049e51f451 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:58.332117 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff311bd5-29c5-48c4-98e0-1dde645e4fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:58.332762 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff311bd5-29c5-48c4-98e0-1dde645e4fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:58.333043 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff311bd5-29c5-48c4-98e0-1dde645e4fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:58.333316 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff311bd5-29c5-48c4-98e0-1dde645e4fb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:58.334015 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff311bd5-29c5-48c4-98e0-1dde645e4fb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:58.334316 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff311bd5-29c5-48c4-98e0-1dde645e4fb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:58.335689 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff311bd5-29c5-48c4-98e0-1dde645e4fb6 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:58.347419 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 627/1266] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:28:58.352960 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b10ba-8edf-42d8-a094-56d044e34ea2 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:58.451141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b10ba-8edf-42d8-a094-56d044e34ea2 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:58.470038 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:58.504745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1471a-b7e5-4b39-9f24-fa9f32f3c3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:58.505547 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1471a-b7e5-4b39-9f24-fa9f32f3c3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:58.505832 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1471a-b7e5-4b39-9f24-fa9f32f3c3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:58.506106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1471a-b7e5-4b39-9f24-fa9f32f3c3d0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:58.513486 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1471a-b7e5-4b39-9f24-fa9f32f3c3d0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:58.514959 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1471a-b7e5-4b39-9f24-fa9f32f3c3d0 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:58.528849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-4da1471a-b7e5-4b39-9f24-fa9f32f3c3d0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 09:28:58.528849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:58.528849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:58.528849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:58.528849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:58.528849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:58.528849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:58.528849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:58.528849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:58.528849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:58.528849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:58.528849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:58.528849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:28:58.528849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:28:58.528849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:28:58.528849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:28:58.529968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:58.529968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:58.529968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:28:58.529968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:28:58.529968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:28:58.529968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:28:58.529968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:58.529968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:58.529968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:58.529968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:58.529968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:58.529968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:28:58.529968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:58.529968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:58.529968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:58.529968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:58.529968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:58.529968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:58.531210 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:58.531210 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:58.531210 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:28:58.531210 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:28:58.531210 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:28:58.531210 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:28:58.531210 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:28:58.531210 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:28:58.531210 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 09:28:58.531210 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:28:58.531210 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 640/1267] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:28:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:28:58.535849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff311bd5-29c5-48c4-98e0-1dde645e4fb6 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:58.633653 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff311bd5-29c5-48c4-98e0-1dde645e4fb6 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:58.666692 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67145e46-39e7-4b9d-9e47-98845f30e6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:58.667379 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67145e46-39e7-4b9d-9e47-98845f30e6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:58.667663 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67145e46-39e7-4b9d-9e47-98845f30e6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:58.667941 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67145e46-39e7-4b9d-9e47-98845f30e6d1 None admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:58.669318 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67145e46-39e7-4b9d-9e47-98845f30e6d1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:58.669628 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67145e46-39e7-4b9d-9e47-98845f30e6d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:58.671053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67145e46-39e7-4b9d-9e47-98845f30e6d1 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:58.679483 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:58.688201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 628/1268] 10.222.0.41 () {56 vars in 1143 bytes} [Fri May 27 09:28:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:28:58.693824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1471a-b7e5-4b39-9f24-fa9f32f3c3d0 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:58.798940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1471a-b7e5-4b39-9f24-fa9f32f3c3d0 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:58.832045 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dba073-8143-42c6-bb7f-35c609d4856f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:58.832861 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dba073-8143-42c6-bb7f-35c609d4856f None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:58.833144 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dba073-8143-42c6-bb7f-35c609d4856f None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:58.833421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dba073-8143-42c6-bb7f-35c609d4856f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:58.844136 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dba073-8143-42c6-bb7f-35c609d4856f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:58.845587 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dba073-8143-42c6-bb7f-35c609d4856f None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:58.862893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-95dba073-8143-42c6-bb7f-35c609d4856f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:28:58.862893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:58.862893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:58.862893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:58.862893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:58.862893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:58.862893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:58.862893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:58.862893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:58.862893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:58.862893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:58.862893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:58.862893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:28:58.862893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:28:58.862893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:28:58.863953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:28:58.863953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:58.863953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:58.863953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:58.863953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:58.863953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:58.863953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:58.863953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:58.863953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:28:58.863953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:58.863953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:58.863953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:58.863953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:58.863953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:58.863953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:58.863953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:58.863953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:58.864902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:28:58.864902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:28:58.864902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:28:58.864902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:28:58.864902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 641/1269] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:28:58.869752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67145e46-39e7-4b9d-9e47-98845f30e6d1 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:58.964613 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67145e46-39e7-4b9d-9e47-98845f30e6d1 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:58.998087 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebe771-9ed8-4af5-848d-b0de5ad06a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:58.998743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebe771-9ed8-4af5-848d-b0de5ad06a8a None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:58.999026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebe771-9ed8-4af5-848d-b0de5ad06a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:58.999324 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebe771-9ed8-4af5-848d-b0de5ad06a8a None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:59.000033 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebe771-9ed8-4af5-848d-b0de5ad06a8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:59.000338 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebe771-9ed8-4af5-848d-b0de5ad06a8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:59.001692 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebe771-9ed8-4af5-848d-b0de5ad06a8a None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:59.013147 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 629/1270] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:28:59.018708 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dba073-8143-42c6-bb7f-35c609d4856f None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:59.049858 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:59.118358 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dba073-8143-42c6-bb7f-35c609d4856f None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:59.151105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4400c-c32d-4878-b8be-2c7cf27d41d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:59.151917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4400c-c32d-4878-b8be-2c7cf27d41d1 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:59.152207 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4400c-c32d-4878-b8be-2c7cf27d41d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:59.152487 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4400c-c32d-4878-b8be-2c7cf27d41d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:59.159603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4400c-c32d-4878-b8be-2c7cf27d41d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:59.161049 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4400c-c32d-4878-b8be-2c7cf27d41d1 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:59.174975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-84b4400c-c32d-4878-b8be-2c7cf27d41d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:28:59.174975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:28:59.174975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:28:59.174975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:28:59.174975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:28:59.174975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:28:59.174975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:28:59.174975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:28:59.174975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:28:59.174975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:28:59.174975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:28:59.174975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:28:59.174975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:28:59.174975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:28:59.174975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:28:59.176027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:28:59.176027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:28:59.176027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:28:59.176027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:28:59.176027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:28:59.176027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:28:59.176027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:28:59.176027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:28:59.176027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:28:59.176027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:28:59.176027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:28:59.176027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:28:59.176027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:28:59.176027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:28:59.176027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:28:59.176027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:28:59.176027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:28:59.176917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:28:59.176917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:28:59.176917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:28:59.176917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:28:59.176917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:28:59.176917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:28:59.176917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:28:59.176917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:28:59.176917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 642/1271] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:28:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:28:59.181999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebe771-9ed8-4af5-848d-b0de5ad06a8a None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:59.240820 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:59.283054 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebe771-9ed8-4af5-848d-b0de5ad06a8a None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:59.314846 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35364ea0-84af-4c7e-8e84-b3bb828d1b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:59.315464 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35364ea0-84af-4c7e-8e84-b3bb828d1b24 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:59.315748 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35364ea0-84af-4c7e-8e84-b3bb828d1b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:59.316023 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35364ea0-84af-4c7e-8e84-b3bb828d1b24 None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:59.316797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35364ea0-84af-4c7e-8e84-b3bb828d1b24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:28:59.317108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35364ea0-84af-4c7e-8e84-b3bb828d1b24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:59.318531 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35364ea0-84af-4c7e-8e84-b3bb828d1b24 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:59.330774 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 630/1272] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:28:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:28:59.336741 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4400c-c32d-4878-b8be-2c7cf27d41d1 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:28:59.425866 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:59.435221 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4400c-c32d-4878-b8be-2c7cf27d41d1 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:28:59.467821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7978836-fda6-496b-8f3a-be59e76a83da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:28:59.468693 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7978836-fda6-496b-8f3a-be59e76a83da None admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:28:59.468972 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7978836-fda6-496b-8f3a-be59e76a83da None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:28:59.469246 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7978836-fda6-496b-8f3a-be59e76a83da None admin] PATH_INFO: `/v3/projects/b1d802dc0211467fa4e709cd01d411dc/users/746fd8ed517446fe89c53df873abb2ec/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:28:59.471145 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7978836-fda6-496b-8f3a-be59e76a83da None admin] RBAC: Authorizing `identity:create_grant(project_id=b1d802dc0211467fa4e709cd01d411dc, user_id=746fd8ed517446fe89c53df873abb2ec, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:28:59.472687 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7978836-fda6-496b-8f3a-be59e76a83da None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:28:59.485548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 643/1273] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 09:28:59 2022] PUT /identity/v3/projects/b1d802dc0211467fa4e709cd01d411dc/users/746fd8ed517446fe89c53df873abb2ec/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:29:01.705893 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c79ab8-797e-44a8-9d06-c1d8c806149a None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:01.706443 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c79ab8-797e-44a8-9d06-c1d8c806149a None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:01.706443 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c79ab8-797e-44a8-9d06-c1d8c806149a None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:01.707867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 631/1274] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:01.712920 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07193b1e-044d-4a70-bed9-6477839c5c3c None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:01.713339 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07193b1e-044d-4a70-bed9-6477839c5c3c None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:01.713474 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07193b1e-044d-4a70-bed9-6477839c5c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:01.731856 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-07193b1e-044d-4a70-bed9-6477839c5c3c None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:01.733042 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-07193b1e-044d-4a70-bed9-6477839c5c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:01.804807 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 644/1275] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:29:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:29:01.830325 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c79ab8-797e-44a8-9d06-c1d8c806149a None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:01.961768 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c79ab8-797e-44a8-9d06-c1d8c806149a None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:01.988717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:02.013402 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbcd7f-3e0f-4cfd-8743-78964730de83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:02.014660 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbcd7f-3e0f-4cfd-8743-78964730de83 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:02.015204 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbcd7f-3e0f-4cfd-8743-78964730de83 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:02.015811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbcd7f-3e0f-4cfd-8743-78964730de83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:02.032997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbcd7f-3e0f-4cfd-8743-78964730de83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 09:29:02.048018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-4bbbcd7f-3e0f-4cfd-8743-78964730de83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:29:02.048018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:29:02.048018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:29:02.048018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:29:02.048018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:29:02.048018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:29:02.048018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:29:02.048018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:29:02.048018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:29:02.048018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:29:02.048018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:29:02.048018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:29:02.048018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 09:29:02.048018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 09:29:02.048018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 09:29:02.048018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 09:29:02.049357 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 09:29:02.049357 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 09:29:02.049357 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 09:29:02.049357 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 09:29:02.049357 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:29:02.049357 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:29:02.049357 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:29:02.049357 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:29:02.049357 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:29:02.049357 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:29:02.049357 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:29:02.049357 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:29:02.049357 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:29:02.049357 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:29:02.049357 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:29:02.049357 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:29:02.050535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:29:02.050535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:29:02.050535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:29:02.050535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:29:02.050535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 09:29:02.050535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 09:29:02.050535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 09:29:02.050535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 09:29:02.050535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 09:29:02.050535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 09:29:02.050535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 09:29:02.050535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:29:02.050535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 632/1276] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 09:29:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:29:02.056611 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07193b1e-044d-4a70-bed9-6477839c5c3c None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:02.136911 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:02.156442 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07193b1e-044d-4a70-bed9-6477839c5c3c None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:02.188402 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a79130-0c68-455f-93c1-de91f8bd4245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:02.189064 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a79130-0c68-455f-93c1-de91f8bd4245 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:02.189348 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a79130-0c68-455f-93c1-de91f8bd4245 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:02.189623 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a79130-0c68-455f-93c1-de91f8bd4245 None admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:02.190362 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a79130-0c68-455f-93c1-de91f8bd4245 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:29:02.190673 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a79130-0c68-455f-93c1-de91f8bd4245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:02.192077 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a79130-0c68-455f-93c1-de91f8bd4245 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:02.200370 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 645/1277] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 09:29:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:29:02.206021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbcd7f-3e0f-4cfd-8743-78964730de83 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:02.303514 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbcd7f-3e0f-4cfd-8743-78964730de83 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:02.335963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86660773-a8e0-41f6-8b8a-6bc4c18083d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:02.336739 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86660773-a8e0-41f6-8b8a-6bc4c18083d5 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:02.337027 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86660773-a8e0-41f6-8b8a-6bc4c18083d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:02.337305 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86660773-a8e0-41f6-8b8a-6bc4c18083d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:02.348173 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86660773-a8e0-41f6-8b8a-6bc4c18083d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:02.349603 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86660773-a8e0-41f6-8b8a-6bc4c18083d5 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:02.366675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-86660773-a8e0-41f6-8b8a-6bc4c18083d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:29:02.366675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:29:02.366675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:29:02.366675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:29:02.366675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:29:02.366675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:29:02.366675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:29:02.366675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:29:02.366675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:29:02.366675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:29:02.366675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:29:02.366675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:29:02.366675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:29:02.366675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:29:02.366675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:29:02.367758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:29:02.367758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:29:02.367758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:29:02.367758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:29:02.367758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:29:02.367758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:29:02.367758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:29:02.367758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:29:02.367758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:29:02.367758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:29:02.367758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:29:02.367758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:29:02.367758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:29:02.367758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:29:02.367758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:29:02.367758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:29:02.367758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:29:02.368738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:29:02.368738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:29:02.368738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:29:02.368738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:29:02.368738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 633/1278] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:29:02.374080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a79130-0c68-455f-93c1-de91f8bd4245 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:02.481296 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a79130-0c68-455f-93c1-de91f8bd4245 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:02.514808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc5d36-019c-40ff-af14-5e014bdb42cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:02.515493 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5d36-019c-40ff-af14-5e014bdb42cb None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:02.515779 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5d36-019c-40ff-af14-5e014bdb42cb None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:02.516055 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5d36-019c-40ff-af14-5e014bdb42cb None admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:02.516776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc5d36-019c-40ff-af14-5e014bdb42cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:29:02.517086 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc5d36-019c-40ff-af14-5e014bdb42cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:02.518460 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc5d36-019c-40ff-af14-5e014bdb42cb None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:02.529875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 646/1279] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:29:02.535534 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86660773-a8e0-41f6-8b8a-6bc4c18083d5 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:02.566049 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:02.633474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86660773-a8e0-41f6-8b8a-6bc4c18083d5 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:02.665637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6215f-b52c-49ca-b2a4-1ab7383cc90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:02.666436 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6215f-b52c-49ca-b2a4-1ab7383cc90c None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:02.666716 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6215f-b52c-49ca-b2a4-1ab7383cc90c None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:02.666993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6215f-b52c-49ca-b2a4-1ab7383cc90c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:02.674260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6215f-b52c-49ca-b2a4-1ab7383cc90c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:02.675725 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6215f-b52c-49ca-b2a4-1ab7383cc90c None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:02.690219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-28c6215f-b52c-49ca-b2a4-1ab7383cc90c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 09:29:02.690219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:29:02.690219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:29:02.690219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:29:02.690219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:29:02.690219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:29:02.690219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:29:02.690219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:29:02.690219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:29:02.690219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:29:02.690219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:29:02.690219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:29:02.690219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 09:29:02.690219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 09:29:02.690219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 09:29:02.690219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 09:29:02.691339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:29:02.691339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:29:02.691339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 09:29:02.691339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:29:02.691339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 09:29:02.691339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 09:29:02.691339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:29:02.691339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:29:02.691339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:29:02.691339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:29:02.691339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:29:02.691339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:29:02.691339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:29:02.691339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:29:02.691339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:29:02.691339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:29:02.691339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:29:02.691339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:29:02.692366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:29:02.692366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:29:02.692366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 09:29:02.692366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 09:29:02.692366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 09:29:02.692366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 09:29:02.692366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 09:29:02.692366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 09:29:02.692366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 09:29:02.692366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:29:02.692366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 634/1280] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:29:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:29:02.697181 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc5d36-019c-40ff-af14-5e014bdb42cb None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:02.701134 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:02.803656 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc5d36-019c-40ff-af14-5e014bdb42cb None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:02.836842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e73d95-035f-41ef-af33-abb2a5679b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:02.837441 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e73d95-035f-41ef-af33-abb2a5679b74 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:02.837725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e73d95-035f-41ef-af33-abb2a5679b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:02.838001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e73d95-035f-41ef-af33-abb2a5679b74 None admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:02.838829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e73d95-035f-41ef-af33-abb2a5679b74 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:29:02.839142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e73d95-035f-41ef-af33-abb2a5679b74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:02.841277 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e73d95-035f-41ef-af33-abb2a5679b74 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:02.858056 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 647/1281] 10.222.0.41 () {56 vars in 1143 bytes} [Fri May 27 09:29:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:29:02.863890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6215f-b52c-49ca-b2a4-1ab7383cc90c None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:02.952213 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:02.962082 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6215f-b52c-49ca-b2a4-1ab7383cc90c None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:02.995152 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496405cb-8dba-4543-ad59-d7bc678e766a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:02.995828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496405cb-8dba-4543-ad59-d7bc678e766a None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:02.996113 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496405cb-8dba-4543-ad59-d7bc678e766a None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:02.996466 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496405cb-8dba-4543-ad59-d7bc678e766a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:03.067351 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496405cb-8dba-4543-ad59-d7bc678e766a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:03.068864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496405cb-8dba-4543-ad59-d7bc678e766a None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:03.158508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:03.168753 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 635/1282] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 09:29:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 09:29:03.174680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e73d95-035f-41ef-af33-abb2a5679b74 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:03.242116 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:03.280135 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e73d95-035f-41ef-af33-abb2a5679b74 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:03.312723 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a2765-628b-49a5-96e5-8b232280ae30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:03.313510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a2765-628b-49a5-96e5-8b232280ae30 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:03.313790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a2765-628b-49a5-96e5-8b232280ae30 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:03.314063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a2765-628b-49a5-96e5-8b232280ae30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:03.323852 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a2765-628b-49a5-96e5-8b232280ae30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:03.326208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a2765-628b-49a5-96e5-8b232280ae30 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:03.344772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-0a0a2765-628b-49a5-96e5-8b232280ae30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:29:03.344772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:29:03.344772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:29:03.344772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:29:03.344772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:29:03.344772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:29:03.344772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:29:03.344772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:29:03.344772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:29:03.344772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:29:03.344772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:29:03.344772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:29:03.344772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 09:29:03.344772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 09:29:03.344772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 09:29:03.345851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 09:29:03.345851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:29:03.345851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:29:03.345851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:29:03.345851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:29:03.345851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:29:03.345851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:29:03.345851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:29:03.345851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:29:03.345851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:29:03.345851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:29:03.345851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:29:03.345851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:29:03.345851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:29:03.345851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:29:03.345851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:29:03.345851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:29:03.346754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 09:29:03.346754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 09:29:03.346754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 09:29:03.346754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:29:03.346754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 648/1283] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:29:03.351690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496405cb-8dba-4543-ad59-d7bc678e766a None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:03.449204 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496405cb-8dba-4543-ad59-d7bc678e766a None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:03.482829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd7282-ad9c-4c24-8989-63823449cc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:03.483513 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd7282-ad9c-4c24-8989-63823449cc79 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:03.483800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd7282-ad9c-4c24-8989-63823449cc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:03.484076 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd7282-ad9c-4c24-8989-63823449cc79 None admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:03.484787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd7282-ad9c-4c24-8989-63823449cc79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:29:03.485095 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd7282-ad9c-4c24-8989-63823449cc79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:03.486445 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd7282-ad9c-4c24-8989-63823449cc79 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:03.497924 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 636/1284] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 09:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:29:03.503610 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a2765-628b-49a5-96e5-8b232280ae30 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:03.598837 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a2765-628b-49a5-96e5-8b232280ae30 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:03.613078 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:03.633413 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316ec01-1ac9-433c-9e9c-7f184e1e3c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:03.634279 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316ec01-1ac9-433c-9e9c-7f184e1e3c28 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:03.634560 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316ec01-1ac9-433c-9e9c-7f184e1e3c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:03.634848 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316ec01-1ac9-433c-9e9c-7f184e1e3c28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:03.641755 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316ec01-1ac9-433c-9e9c-7f184e1e3c28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:03.643202 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316ec01-1ac9-433c-9e9c-7f184e1e3c28 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:03.656702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application [None req-f316ec01-1ac9-433c-9e9c-7f184e1e3c28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:29:03.656702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:29:03.656702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:29:03.656702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:29:03.656702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:29:03.656702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:29:03.656702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:29:03.656702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:29:03.656702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:29:03.656702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:29:03.656702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:29:03.656702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:29:03.656702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 09:29:03.656702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 09:29:03.656702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 09:29:03.657721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 09:29:03.657721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:29:03.657721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:29:03.657721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:29:03.657721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:29:03.657721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:29:03.657721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:29:03.657721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:29:03.657721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application with Lock( May 27 09:29:03.657721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:29:03.657721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._enter() May 27 09:29:03.657721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:29:03.657721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:29:03.657721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:29:03.657721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.creator() May 27 09:29:03.657721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:29:03.657721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application created_value = creator( May 27 09:29:03.658913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 09:29:03.658913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 09:29:03.658913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 09:29:03.658913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 09:29:03.658913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 09:29:03.658913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 09:29:03.658913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 09:29:03.658913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: ERROR keystone.server.flask.application May 27 09:29:03.658913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 649/1285] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 09:29:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:29:03.663836 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd7282-ad9c-4c24-8989-63823449cc79 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:03.712683 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:03.761367 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd7282-ad9c-4c24-8989-63823449cc79 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:03.796069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa39aba-1957-4ef8-8254-06e1347218fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:03.796721 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa39aba-1957-4ef8-8254-06e1347218fb None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:03.797001 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa39aba-1957-4ef8-8254-06e1347218fb None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:03.797274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa39aba-1957-4ef8-8254-06e1347218fb None admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:03.798041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa39aba-1957-4ef8-8254-06e1347218fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:29:03.798347 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa39aba-1957-4ef8-8254-06e1347218fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:03.799792 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa39aba-1957-4ef8-8254-06e1347218fb None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:03.811991 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 637/1286] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 09:29:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:29:03.818185 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316ec01-1ac9-433c-9e9c-7f184e1e3c28 None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:03.917247 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316ec01-1ac9-433c-9e9c-7f184e1e3c28 None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:03.949929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def0fe2-f9a7-435e-b027-edd4124de432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:03.950575 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def0fe2-f9a7-435e-b027-edd4124de432 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:03.950855 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def0fe2-f9a7-435e-b027-edd4124de432 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:03.951132 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def0fe2-f9a7-435e-b027-edd4124de432 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:03.951987 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def0fe2-f9a7-435e-b027-edd4124de432 None admin] RBAC: Adding query filter params (role.id=bb6c5483d9be4a16ac64750536c5e2e2, scope.project.id=b1d802dc0211467fa4e709cd01d411dc, user.id=746fd8ed517446fe89c53df873abb2ec) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:29:03.952304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def0fe2-f9a7-435e-b027-edd4124de432 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:03.953739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def0fe2-f9a7-435e-b027-edd4124de432 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:03.959444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 650/1287] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 09:29:03 2022] GET /identity/v3/role_assignments?user.id=746fd8ed517446fe89c53df873abb2ec&scope.project.id=b1d802dc0211467fa4e709cd01d411dc&role.id=bb6c5483d9be4a16ac64750536c5e2e2 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:29:06.129562 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d28445-f093-46eb-b14d-6da3c77830fb None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:06.130082 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d28445-f093-46eb-b14d-6da3c77830fb None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:06.130082 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d28445-f093-46eb-b14d-6da3c77830fb None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:06.131509 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 638/1288] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:06.136716 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d0d6a-2bcd-41f1-b312-6236fdd5ca6b None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:06.137693 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d0d6a-2bcd-41f1-b312-6236fdd5ca6b None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:06.137814 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d0d6a-2bcd-41f1-b312-6236fdd5ca6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:06.154210 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-6f8d0d6a-2bcd-41f1-b312-6236fdd5ca6b None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:06.155423 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-6f8d0d6a-2bcd-41f1-b312-6236fdd5ca6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:06.184188 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:06.220964 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 651/1289] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:29:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:29:06.242704 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d28445-f093-46eb-b14d-6da3c77830fb None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:06.341317 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d28445-f093-46eb-b14d-6da3c77830fb None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:06.351481 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:06.374978 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d193deb-9f18-4da3-8455-bc19edb72b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:06.375802 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d193deb-9f18-4da3-8455-bc19edb72b71 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:06.376089 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d193deb-9f18-4da3-8455-bc19edb72b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:06.376367 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d193deb-9f18-4da3-8455-bc19edb72b71 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:06.377008 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d193deb-9f18-4da3-8455-bc19edb72b71 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:06.378359 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d193deb-9f18-4da3-8455-bc19edb72b71 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:06.390081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-8d193deb-9f18-4da3-8455-bc19edb72b71 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:29:06.390081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:29:06.390081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:29:06.390081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:29:06.390081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:29:06.390081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:29:06.390081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:29:06.390081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:29:06.390081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:29:06.390081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:29:06.390081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:29:06.390081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:29:06.390081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:29:06.390081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:29:06.390081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:29:06.390081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:29:06.390081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:29:06.391309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:29:06.391309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:29:06.391309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:29:06.391309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:29:06.391309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:29:06.391309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:29:06.391309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:29:06.391309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:29:06.391309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:29:06.391309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:29:06.391309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:29:06.391309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:29:06.391309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:29:06.391309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:29:06.391309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:29:06.391309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:29:06.392339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:29:06.392339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:29:06.392339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:29:06.392339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:29:06.392339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:29:06.392339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:29:06.392339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:29:06.392339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:29:06.392339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:29:06.392339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:29:06.392339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:29:06.392339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:29:06.392339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:29:06.392339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:29:06.392339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 639/1290] 10.222.0.41 () {56 vars in 1117 bytes} [Fri May 27 09:29:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:29:06.397130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d0d6a-2bcd-41f1-b312-6236fdd5ca6b None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:06.492918 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d0d6a-2bcd-41f1-b312-6236fdd5ca6b None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:06.525472 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b65ad1-5c62-4333-91ff-d6d7ccef99a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:06.526124 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b65ad1-5c62-4333-91ff-d6d7ccef99a3 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:06.526408 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b65ad1-5c62-4333-91ff-d6d7ccef99a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:06.526681 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b65ad1-5c62-4333-91ff-d6d7ccef99a3 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:06.527404 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b65ad1-5c62-4333-91ff-d6d7ccef99a3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:29:06.528247 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b65ad1-5c62-4333-91ff-d6d7ccef99a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:06.529611 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b65ad1-5c62-4333-91ff-d6d7ccef99a3 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:06.534287 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 652/1291] 10.222.0.41 () {56 vars in 1116 bytes} [Fri May 27 09:29:06 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:29:06.539909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d193deb-9f18-4da3-8455-bc19edb72b71 None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:06.636142 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d193deb-9f18-4da3-8455-bc19edb72b71 None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:06.668846 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7929321-1b0d-43b7-9a42-cb0adf136300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:06.669501 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7929321-1b0d-43b7-9a42-cb0adf136300 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:06.669786 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7929321-1b0d-43b7-9a42-cb0adf136300 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:06.670061 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7929321-1b0d-43b7-9a42-cb0adf136300 None admin] PATH_INFO: `/v3/services` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:06.670752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7929321-1b0d-43b7-9a42-cb0adf136300 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:29:06.671057 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7929321-1b0d-43b7-9a42-cb0adf136300 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:06.672463 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7929321-1b0d-43b7-9a42-cb0adf136300 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:06.676979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 640/1292] 10.222.0.41 () {56 vars in 1116 bytes} [Fri May 27 09:29:06 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:29:08.846585 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce41227-d368-4a58-b5f3-0e93096d33dc None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:08.847189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce41227-d368-4a58-b5f3-0e93096d33dc None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:08.847189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce41227-d368-4a58-b5f3-0e93096d33dc None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:08.848534 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 653/1293] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:08.853717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4e4ee-6e5b-4111-8491-90b7a247c961 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:08.854102 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4e4ee-6e5b-4111-8491-90b7a247c961 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:08.854287 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4e4ee-6e5b-4111-8491-90b7a247c961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:08.871770 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-dcb4e4ee-6e5b-4111-8491-90b7a247c961 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:08.872969 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-dcb4e4ee-6e5b-4111-8491-90b7a247c961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:08.904855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:08.940761 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 641/1294] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:29:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:29:08.963522 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce41227-d368-4a58-b5f3-0e93096d33dc None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:08.994462 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:09.064806 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce41227-d368-4a58-b5f3-0e93096d33dc None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:09.097158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376c270-88ad-492b-bb2a-8fb938f0cc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:09.097749 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376c270-88ad-492b-bb2a-8fb938f0cc58 None admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:09.098030 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376c270-88ad-492b-bb2a-8fb938f0cc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:09.098303 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376c270-88ad-492b-bb2a-8fb938f0cc58 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:09.099008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376c270-88ad-492b-bb2a-8fb938f0cc58 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:09.100398 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376c270-88ad-492b-bb2a-8fb938f0cc58 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:09.113757 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 654/1295] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 09:29:08 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:29:11.281284 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901b66e-77f9-48b8-acb6-f135b874d43e None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:11.281796 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901b66e-77f9-48b8-acb6-f135b874d43e None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:11.281881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901b66e-77f9-48b8-acb6-f135b874d43e None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:11.283204 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 642/1296] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:11.288361 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e7081-09cd-49d3-83d6-25e31a81af7e None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:11.288757 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e7081-09cd-49d3-83d6-25e31a81af7e None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:11.288933 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e7081-09cd-49d3-83d6-25e31a81af7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:11.305200 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-6c7e7081-09cd-49d3-83d6-25e31a81af7e None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:11.306374 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-6c7e7081-09cd-49d3-83d6-25e31a81af7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:11.377226 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 655/1297] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:29:11 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:29:11.399417 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901b66e-77f9-48b8-acb6-f135b874d43e None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:11.495241 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901b66e-77f9-48b8-acb6-f135b874d43e None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:11.528014 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48571bd-cb33-40b6-bab7-eacf264d2b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:11.528788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48571bd-cb33-40b6-bab7-eacf264d2b1a None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:11.529065 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48571bd-cb33-40b6-bab7-eacf264d2b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:11.529335 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48571bd-cb33-40b6-bab7-eacf264d2b1a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:11.529970 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48571bd-cb33-40b6-bab7-eacf264d2b1a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:11.531347 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48571bd-cb33-40b6-bab7-eacf264d2b1a None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:11.542829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-e48571bd-cb33-40b6-bab7-eacf264d2b1a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:29:11.542829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:29:11.542829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:29:11.542829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:29:11.542829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:29:11.542829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:29:11.542829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:29:11.542829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:29:11.542829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:29:11.542829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:29:11.542829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:29:11.542829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:29:11.542829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:29:11.542829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:29:11.542829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:29:11.542829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:29:11.542829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:29:11.543821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:29:11.543821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:29:11.543821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:29:11.543821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:29:11.543821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:29:11.543821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:29:11.543821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:29:11.543821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:29:11.543821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:29:11.543821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:29:11.543821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:29:11.543821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:29:11.543821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:29:11.543821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:29:11.543821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:29:11.543821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:29:11.544686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:29:11.544686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:29:11.544686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:29:11.544686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:29:11.544686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:29:11.544686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:29:11.544686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:29:11.544686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:29:11.544686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:29:11.544686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:29:11.544686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:29:11.544686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:29:11.544686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:29:11.544686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:29:11.544686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 643/1298] 10.222.0.41 () {56 vars in 1117 bytes} [Fri May 27 09:29:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:29:11.549877 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e7081-09cd-49d3-83d6-25e31a81af7e None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:11.567989 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:11.646715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e7081-09cd-49d3-83d6-25e31a81af7e None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:11.678375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90adc15-ab08-4868-856f-caa754e8415e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:11.679025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90adc15-ab08-4868-856f-caa754e8415e None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:11.679326 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90adc15-ab08-4868-856f-caa754e8415e None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:11.679603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90adc15-ab08-4868-856f-caa754e8415e None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:11.680294 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90adc15-ab08-4868-856f-caa754e8415e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:29:11.680598 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90adc15-ab08-4868-856f-caa754e8415e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:11.681973 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90adc15-ab08-4868-856f-caa754e8415e None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:11.687425 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 656/1299] 10.222.0.41 () {56 vars in 1116 bytes} [Fri May 27 09:29:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:29:11.693154 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48571bd-cb33-40b6-bab7-eacf264d2b1a None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:11.723635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:11.791961 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48571bd-cb33-40b6-bab7-eacf264d2b1a None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:11.824467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec366dab-9953-4494-8d49-189ce6e4ce26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:11.825118 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec366dab-9953-4494-8d49-189ce6e4ce26 None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:11.825397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec366dab-9953-4494-8d49-189ce6e4ce26 None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:11.825666 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec366dab-9953-4494-8d49-189ce6e4ce26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:11.826433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec366dab-9953-4494-8d49-189ce6e4ce26 None admin] RBAC: Adding query filter params (interface=public, service_id=b5dba7d6b3ff4462a041ac25beca1a6b, region_id=RegionOne) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:29:11.826740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec366dab-9953-4494-8d49-189ce6e4ce26 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:11.828111 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec366dab-9953-4494-8d49-189ce6e4ce26 None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:11.832932 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 644/1300] 10.222.0.41 () {56 vars in 1251 bytes} [Fri May 27 09:29:11 2022] GET /identity/v3/endpoints?service_id=b5dba7d6b3ff4462a041ac25beca1a6b&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:29:11.838599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90adc15-ab08-4868-856f-caa754e8415e None admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:11.916736 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:11.935527 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90adc15-ab08-4868-856f-caa754e8415e None admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:11.967202 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6a9be-920c-47e6-84f3-1ddac2e15661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:11.967875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6a9be-920c-47e6-84f3-1ddac2e15661 None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:11.968155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6a9be-920c-47e6-84f3-1ddac2e15661 None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:11.968430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6a9be-920c-47e6-84f3-1ddac2e15661 None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:11.969094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6a9be-920c-47e6-84f3-1ddac2e15661 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:11.970457 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6a9be-920c-47e6-84f3-1ddac2e15661 None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:11.976979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 657/1301] 10.222.0.41 () {56 vars in 1087 bytes} [Fri May 27 09:29:11 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:29:14.123497 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73f0db-e154-4774-a49a-79eac7ad95f9 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:14.123996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73f0db-e154-4774-a49a-79eac7ad95f9 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:14.124091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73f0db-e154-4774-a49a-79eac7ad95f9 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:14.125455 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 645/1302] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:29:14.130580 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533a32a-6c74-411c-b434-bed581125812 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:14.131083 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533a32a-6c74-411c-b434-bed581125812 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:14.131187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533a32a-6c74-411c-b434-bed581125812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:14.151814 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-f533a32a-6c74-411c-b434-bed581125812 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:29:14.153246 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f533a32a-6c74-411c-b434-bed581125812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:29:14.217618 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 658/1303] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:29:14 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 09:29:14.239912 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73f0db-e154-4774-a49a-79eac7ad95f9 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:14.331359 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:14.338306 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73f0db-e154-4774-a49a-79eac7ad95f9 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:14.370575 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabacb22-1ded-44ba-933d-fbe0d4771c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:14.371879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabacb22-1ded-44ba-933d-fbe0d4771c7f None admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:14.372161 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabacb22-1ded-44ba-933d-fbe0d4771c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:14.372432 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabacb22-1ded-44ba-933d-fbe0d4771c7f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:14.373064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabacb22-1ded-44ba-933d-fbe0d4771c7f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:14.374412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabacb22-1ded-44ba-933d-fbe0d4771c7f None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:14.386053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application [None req-fabacb22-1ded-44ba-933d-fbe0d4771c7f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:29:14.386053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:29:14.386053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 09:29:14.386053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 09:29:14.386053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 09:29:14.386053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 09:29:14.386053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 09:29:14.386053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:29:14.386053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:29:14.386053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:29:14.386053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 09:29:14.386053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:29:14.386053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 09:29:14.386053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 09:29:14.386053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 09:29:14.386053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 09:29:14.386053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 09:29:14.387730 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 09:29:14.387730 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 09:29:14.387730 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 09:29:14.387730 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 09:29:14.387730 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 09:29:14.387730 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 09:29:14.387730 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 09:29:14.387730 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 09:29:14.387730 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 09:29:14.387730 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 09:29:14.387730 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 09:29:14.387730 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 09:29:14.387730 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 09:29:14.387730 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 09:29:14.387730 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 09:29:14.387730 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.get_or_create( May 27 09:29:14.388773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 09:29:14.388773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application with Lock( May 27 09:29:14.388773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 09:29:14.388773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self._enter() May 27 09:29:14.388773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 09:29:14.388773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 09:29:14.388773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 09:29:14.388773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application return self.creator() May 27 09:29:14.388773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 09:29:14.388773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application created_value = creator( May 27 09:29:14.388773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 09:29:14.388773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 09:29:14.388773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 09:29:14.388773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: ERROR keystone.server.flask.application May 27 09:29:14.388773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 646/1304] 10.222.0.41 () {56 vars in 1117 bytes} [Fri May 27 09:29:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 09:29:14.393853 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533a32a-6c74-411c-b434-bed581125812 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:14.466193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:14.488589 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533a32a-6c74-411c-b434-bed581125812 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:14.521573 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369cfd7-f2ae-41aa-9018-2a8931ee8b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:14.522223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369cfd7-f2ae-41aa-9018-2a8931ee8b8f None admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:14.522508 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369cfd7-f2ae-41aa-9018-2a8931ee8b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:14.522781 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369cfd7-f2ae-41aa-9018-2a8931ee8b8f None admin] PATH_INFO: `/v3/services` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:14.523497 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369cfd7-f2ae-41aa-9018-2a8931ee8b8f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:29:14.523806 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369cfd7-f2ae-41aa-9018-2a8931ee8b8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:14.525162 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369cfd7-f2ae-41aa-9018-2a8931ee8b8f None admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:14.530157 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 659/1305] 10.222.0.41 () {56 vars in 1116 bytes} [Fri May 27 09:29:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:29:14.535703 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabacb22-1ded-44ba-933d-fbe0d4771c7f None admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:29:14.631305 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabacb22-1ded-44ba-933d-fbe0d4771c7f None admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:29:14.663693 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb66dd-57ec-4796-9285-c046b6bcb42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:29:14.664324 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb66dd-57ec-4796-9285-c046b6bcb42d None admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:29:14.664605 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb66dd-57ec-4796-9285-c046b6bcb42d None admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:29:14.664878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb66dd-57ec-4796-9285-c046b6bcb42d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:29:14.665606 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb66dd-57ec-4796-9285-c046b6bcb42d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:29:14.666939 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb66dd-57ec-4796-9285-c046b6bcb42d None admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:29:14.684588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 647/1306] 10.222.0.41 () {60 vars in 1144 bytes} [Fri May 27 09:29:14 2022] POST /identity/v3/endpoints => generated 331 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:29:24.528176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=30 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:24.680882 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:18.195318 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80f30f-5161-451c-b3d8-aefa6228864b None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:18.195790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80f30f-5161-451c-b3d8-aefa6228864b None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:18.196062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80f30f-5161-451c-b3d8-aefa6228864b None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:18.200201 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 660/1307] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:30:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:18.203472 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1caaa-f2f6-40ad-a339-877169a36eb4 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:18.203920 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1caaa-f2f6-40ad-a339-877169a36eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:18.204017 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1caaa-f2f6-40ad-a339-877169a36eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:18.302918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-06e1caaa-f2f6-40ad-a339-877169a36eb4 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:18.304216 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-06e1caaa-f2f6-40ad-a339-877169a36eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:18.424897 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 648/1308] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:18.479238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc8ed2-76bf-4f91-aa92-6670c7463d93 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:18.479702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc8ed2-76bf-4f91-aa92-6670c7463d93 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:18.480073 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc8ed2-76bf-4f91-aa92-6670c7463d93 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:18.481804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 661/1309] 10.222.0.41 () {54 vars in 964 bytes} [Fri May 27 09:30:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:18.488235 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44796f-92c3-419b-98f9-4ddcfb22b5c4 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:18.488654 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44796f-92c3-419b-98f9-4ddcfb22b5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:18.489037 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44796f-92c3-419b-98f9-4ddcfb22b5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:18.581628 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-7a44796f-92c3-419b-98f9-4ddcfb22b5c4 None None] MFA Rules not processed for user `c1103a08484048da82c5e4627552253e`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:18.583240 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-7a44796f-92c3-419b-98f9-4ddcfb22b5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:18.613480 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:18.699909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 649/1310] 10.222.0.41 () {58 vars in 1061 bytes} [Fri May 27 09:30:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:18.701357 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc8ed2-76bf-4f91-aa92-6670c7463d93 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:18.703979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-18cc8ed2-76bf-4f91-aa92-6670c7463d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:18.881619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc8ed2-76bf-4f91-aa92-6670c7463d93 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:18.959866 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfe615-7e81-4065-af63-46812bf4084f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:18.960594 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfe615-7e81-4065-af63-46812bf4084f service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:18.960986 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfe615-7e81-4065-af63-46812bf4084f service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:18.961366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfe615-7e81-4065-af63-46812bf4084f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:18.963192 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-11bfe615-7e81-4065-af63-46812bf4084f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:19.019575 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:19.080249 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfe615-7e81-4065-af63-46812bf4084f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:19.081697 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfe615-7e81-4065-af63-46812bf4084f service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:19.101342 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 662/1311] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:30:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:21.624413 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e87a6-f4e3-4364-a7fd-8fa337fb7f20 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:21.624859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e87a6-f4e3-4364-a7fd-8fa337fb7f20 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:21.625097 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e87a6-f4e3-4364-a7fd-8fa337fb7f20 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:21.627015 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 650/1312] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:30:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:21.632228 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95c602-10a0-4cc1-a4fc-389da1a1039e None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:21.632661 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95c602-10a0-4cc1-a4fc-389da1a1039e None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:21.632979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95c602-10a0-4cc1-a4fc-389da1a1039e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:21.709997 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-ff95c602-10a0-4cc1-a4fc-389da1a1039e None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:21.711827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-ff95c602-10a0-4cc1-a4fc-389da1a1039e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:21.814567 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 663/1313] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:21.851984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e87a6-f4e3-4364-a7fd-8fa337fb7f20 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:21.854366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-a06e87a6-f4e3-4364-a7fd-8fa337fb7f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:21.958757 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e87a6-f4e3-4364-a7fd-8fa337fb7f20 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:22.034232 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:22.036571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbc6fc-922c-4513-8fe7-2feadceb0da0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:22.037252 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbc6fc-922c-4513-8fe7-2feadceb0da0 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:22.037522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbc6fc-922c-4513-8fe7-2feadceb0da0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:22.038044 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbc6fc-922c-4513-8fe7-2feadceb0da0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:22.040221 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-05cbc6fc-922c-4513-8fe7-2feadceb0da0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:22.150076 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cbc6fc-922c-4513-8fe7-2feadceb0da0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:22.151467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cbc6fc-922c-4513-8fe7-2feadceb0da0 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:22.169943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 651/1314] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:30:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:24.717998 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57c7a8-58aa-4f96-8024-50837f16cebc None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:24.718561 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57c7a8-58aa-4f96-8024-50837f16cebc None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:24.718561 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57c7a8-58aa-4f96-8024-50837f16cebc None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:24.720497 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 664/1315] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:24.726585 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f23c1-3634-4b2e-8b09-fa86077e03f3 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:24.727121 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f23c1-3634-4b2e-8b09-fa86077e03f3 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:24.727121 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f23c1-3634-4b2e-8b09-fa86077e03f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:24.800549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-4c7f23c1-3634-4b2e-8b09-fa86077e03f3 None None] MFA Rules not processed for user `8f51d7d2041048b4af85b1c48e527498`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:24.801784 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-4c7f23c1-3634-4b2e-8b09-fa86077e03f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:24.858085 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:24.908668 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 652/1316] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:30:24 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:24.965224 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522ccc1-22c2-4439-8133-fb798dcaad03 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:24.965224 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522ccc1-22c2-4439-8133-fb798dcaad03 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:24.965419 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522ccc1-22c2-4439-8133-fb798dcaad03 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:24.966647 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 665/1317] 10.222.0.41 () {54 vars in 964 bytes} [Fri May 27 09:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:24.972604 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cd3af-a865-46ee-acaf-12059e7eff6a None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:24.972891 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cd3af-a865-46ee-acaf-12059e7eff6a None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:24.973170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cd3af-a865-46ee-acaf-12059e7eff6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:25.047944 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-449cd3af-a865-46ee-acaf-12059e7eff6a None None] MFA Rules not processed for user `c1103a08484048da82c5e4627552253e`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:25.049153 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-449cd3af-a865-46ee-acaf-12059e7eff6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:25.127523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 653/1318] 10.222.0.41 () {58 vars in 1061 bytes} [Fri May 27 09:30:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:25.136964 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522ccc1-22c2-4439-8133-fb798dcaad03 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:25.138577 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-2522ccc1-22c2-4439-8133-fb798dcaad03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:25.148918 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:25.246415 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522ccc1-22c2-4439-8133-fb798dcaad03 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:25.318797 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a20b1-3e3f-415a-82ba-bdfffc5e86e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:25.319484 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a20b1-3e3f-415a-82ba-bdfffc5e86e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:25.319766 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a20b1-3e3f-415a-82ba-bdfffc5e86e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:25.320041 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a20b1-3e3f-415a-82ba-bdfffc5e86e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:25.322214 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-e88a20b1-3e3f-415a-82ba-bdfffc5e86e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:25.388443 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:25.439472 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a20b1-3e3f-415a-82ba-bdfffc5e86e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:25.440923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a20b1-3e3f-415a-82ba-bdfffc5e86e9 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:25.458506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 666/1319] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:30:25 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:28.564020 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777850a2-a097-4cd2-b70c-673c49d2aac7 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:28.564531 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777850a2-a097-4cd2-b70c-673c49d2aac7 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:28.564631 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777850a2-a097-4cd2-b70c-673c49d2aac7 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:28.565991 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 654/1320] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:28.571169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36020b-d876-42bb-9e68-29d482f405b1 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:28.571615 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36020b-d876-42bb-9e68-29d482f405b1 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:28.571772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36020b-d876-42bb-9e68-29d482f405b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:28.636861 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-0c36020b-d876-42bb-9e68-29d482f405b1 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:28.638064 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-0c36020b-d876-42bb-9e68-29d482f405b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:28.738123 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 667/1321] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:30:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:28.777099 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777850a2-a097-4cd2-b70c-673c49d2aac7 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:28.779076 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-777850a2-a097-4cd2-b70c-673c49d2aac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:28.841442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:28.897317 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777850a2-a097-4cd2-b70c-673c49d2aac7 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:28.973198 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7e1ae-5d2d-4b02-b6fa-6127888eed45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:28.973853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7e1ae-5d2d-4b02-b6fa-6127888eed45 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:28.974134 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7e1ae-5d2d-4b02-b6fa-6127888eed45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:28.974413 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7e1ae-5d2d-4b02-b6fa-6127888eed45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:28.976105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-bda7e1ae-5d2d-4b02-b6fa-6127888eed45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:29.087436 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:29.101070 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7e1ae-5d2d-4b02-b6fa-6127888eed45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:29.102476 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7e1ae-5d2d-4b02-b6fa-6127888eed45 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:29.121044 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 655/1322] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:30:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:32.044097 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c384b31-aeae-4c2b-8825-7efad82c5469 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:32.044648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c384b31-aeae-4c2b-8825-7efad82c5469 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:32.044648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c384b31-aeae-4c2b-8825-7efad82c5469 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:32.046300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 668/1323] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:32.051316 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93aeb8-932c-4ea8-acba-79d9b5b65a15 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:32.051757 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93aeb8-932c-4ea8-acba-79d9b5b65a15 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:32.051853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93aeb8-932c-4ea8-acba-79d9b5b65a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:32.124540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-ee93aeb8-932c-4ea8-acba-79d9b5b65a15 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:32.125765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-ee93aeb8-932c-4ea8-acba-79d9b5b65a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:32.234632 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 656/1324] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:32.269800 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c384b31-aeae-4c2b-8825-7efad82c5469 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:32.271343 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-7c384b31-aeae-4c2b-8825-7efad82c5469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:32.294347 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:32.388798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c384b31-aeae-4c2b-8825-7efad82c5469 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:32.479957 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec309367-4625-496b-99a6-918dad287c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:32.481092 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec309367-4625-496b-99a6-918dad287c85 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:32.481491 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec309367-4625-496b-99a6-918dad287c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:32.481869 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec309367-4625-496b-99a6-918dad287c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:32.483724 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-ec309367-4625-496b-99a6-918dad287c85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:32.567874 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:32.611957 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec309367-4625-496b-99a6-918dad287c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:32.613491 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec309367-4625-496b-99a6-918dad287c85 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:32.634634 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 669/1325] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:30:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:34.930775 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49972734-4bc7-46a6-ae0c-85fc206aab12 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:34.931341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49972734-4bc7-46a6-ae0c-85fc206aab12 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:34.931434 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49972734-4bc7-46a6-ae0c-85fc206aab12 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:34.932738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 657/1326] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:34.938017 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957e4a2-7c6f-4041-803b-d8714315fe02 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:34.938437 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957e4a2-7c6f-4041-803b-d8714315fe02 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:34.938583 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957e4a2-7c6f-4041-803b-d8714315fe02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:35.004229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-3957e4a2-7c6f-4041-803b-d8714315fe02 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:35.005445 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-3957e4a2-7c6f-4041-803b-d8714315fe02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:35.105899 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 670/1327] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:35.141340 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49972734-4bc7-46a6-ae0c-85fc206aab12 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:35.144295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-49972734-4bc7-46a6-ae0c-85fc206aab12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:35.206962 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:35.249992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49972734-4bc7-46a6-ae0c-85fc206aab12 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:35.322379 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42817616-fd10-4b44-95f9-83ce08e95dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:35.323016 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42817616-fd10-4b44-95f9-83ce08e95dcf service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:35.323320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42817616-fd10-4b44-95f9-83ce08e95dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:35.323595 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42817616-fd10-4b44-95f9-83ce08e95dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:35.325208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-42817616-fd10-4b44-95f9-83ce08e95dcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:35.434781 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:35.437050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42817616-fd10-4b44-95f9-83ce08e95dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:35.438488 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42817616-fd10-4b44-95f9-83ce08e95dcf service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:35.457055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 658/1328] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:37.715783 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9d2b1-64e9-4873-bf31-f4b2ae898662 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:37.716345 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9d2b1-64e9-4873-bf31-f4b2ae898662 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:37.716345 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9d2b1-64e9-4873-bf31-f4b2ae898662 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:37.717764 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 671/1329] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:37.723061 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9902c1-2256-469c-a83f-98867e52d5b3 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:37.723518 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9902c1-2256-469c-a83f-98867e52d5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:37.723654 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9902c1-2256-469c-a83f-98867e52d5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:37.788415 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-6c9902c1-2256-469c-a83f-98867e52d5b3 None None] MFA Rules not processed for user `8f51d7d2041048b4af85b1c48e527498`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:37.789659 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-6c9902c1-2256-469c-a83f-98867e52d5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:37.884523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 659/1330] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:30:37 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:37.921576 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9d2b1-64e9-4873-bf31-f4b2ae898662 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:37.923174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-3eb9d2b1-64e9-4873-bf31-f4b2ae898662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:37.953029 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:38.029748 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9d2b1-64e9-4873-bf31-f4b2ae898662 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:38.107103 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215d80b-86e8-4494-9e01-87c23dac746c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:38.107786 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215d80b-86e8-4494-9e01-87c23dac746c service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:38.108069 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215d80b-86e8-4494-9e01-87c23dac746c service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:38.108349 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215d80b-86e8-4494-9e01-87c23dac746c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:38.109978 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-9215d80b-86e8-4494-9e01-87c23dac746c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:38.186389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:38.220076 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215d80b-86e8-4494-9e01-87c23dac746c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:38.221524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215d80b-86e8-4494-9e01-87c23dac746c service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:38.240443 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 672/1331] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:30:37 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:40.655433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13895d-e133-4d66-b2e4-647cb0fa4cda None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:40.655957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13895d-e133-4d66-b2e4-647cb0fa4cda None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:40.656071 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13895d-e133-4d66-b2e4-647cb0fa4cda None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:40.657364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 660/1332] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:40.662709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a6293-667f-4616-a805-629fa0cf1a72 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:40.663143 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a6293-667f-4616-a805-629fa0cf1a72 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:40.663251 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a6293-667f-4616-a805-629fa0cf1a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:40.732826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-b03a6293-667f-4616-a805-629fa0cf1a72 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:40.734027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-b03a6293-667f-4616-a805-629fa0cf1a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:40.828543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 673/1333] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:40.864426 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13895d-e133-4d66-b2e4-647cb0fa4cda None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:40.865946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-8a13895d-e133-4d66-b2e4-647cb0fa4cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:40.936683 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:40.971369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13895d-e133-4d66-b2e4-647cb0fa4cda None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:41.046366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716de1f-a0c3-4738-9324-793d82c972c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:41.047023 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716de1f-a0c3-4738-9324-793d82c972c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:41.047341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716de1f-a0c3-4738-9324-793d82c972c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:41.047623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716de1f-a0c3-4738-9324-793d82c972c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:41.049268 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-d716de1f-a0c3-4738-9324-793d82c972c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:41.159765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716de1f-a0c3-4738-9324-793d82c972c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:41.161124 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716de1f-a0c3-4738-9324-793d82c972c6 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:41.170964 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:41.179230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 661/1334] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:30:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:43.455999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b905c20-1fe0-4544-bc35-0039f830b507 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:43.456492 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b905c20-1fe0-4544-bc35-0039f830b507 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:43.456582 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b905c20-1fe0-4544-bc35-0039f830b507 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:43.458004 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 674/1335] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:43.463332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cab525-ef2e-4200-ba2e-2a29461f3c04 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:43.463756 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cab525-ef2e-4200-ba2e-2a29461f3c04 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:43.463903 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cab525-ef2e-4200-ba2e-2a29461f3c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:43.531648 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-71cab525-ef2e-4200-ba2e-2a29461f3c04 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:43.532864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-71cab525-ef2e-4200-ba2e-2a29461f3c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:43.627996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 662/1336] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:43.672838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b905c20-1fe0-4544-bc35-0039f830b507 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:43.674362 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-4b905c20-1fe0-4544-bc35-0039f830b507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:43.714527 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:43.777954 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b905c20-1fe0-4544-bc35-0039f830b507 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:43.849534 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28556759-a600-4ab7-a3c3-8fb9385be7e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:43.850179 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28556759-a600-4ab7-a3c3-8fb9385be7e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:43.850465 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28556759-a600-4ab7-a3c3-8fb9385be7e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:43.850745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28556759-a600-4ab7-a3c3-8fb9385be7e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:43.852473 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-28556759-a600-4ab7-a3c3-8fb9385be7e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:43.933979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:43.960124 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28556759-a600-4ab7-a3c3-8fb9385be7e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:43.961554 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28556759-a600-4ab7-a3c3-8fb9385be7e0 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:43.979816 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 675/1337] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:30:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:46.608005 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84dda0-bccd-4704-8386-8b1e8e8107fc None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:46.608563 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84dda0-bccd-4704-8386-8b1e8e8107fc None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:46.608563 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84dda0-bccd-4704-8386-8b1e8e8107fc None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:46.609921 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 663/1338] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:46.615011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc64279-1e53-4667-b74d-ed67402a47f9 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:46.615595 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc64279-1e53-4667-b74d-ed67402a47f9 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:46.615595 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc64279-1e53-4667-b74d-ed67402a47f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:46.679852 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-2bc64279-1e53-4667-b74d-ed67402a47f9 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:46.681075 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-2bc64279-1e53-4667-b74d-ed67402a47f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:46.780217 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 676/1339] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:30:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:46.816023 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84dda0-bccd-4704-8386-8b1e8e8107fc None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:46.817562 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-da84dda0-bccd-4704-8386-8b1e8e8107fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:46.893112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:46.920686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84dda0-bccd-4704-8386-8b1e8e8107fc None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:46.993753 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3cc08-0b03-498d-a885-2ed0c60892ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:46.994399 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3cc08-0b03-498d-a885-2ed0c60892ad service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:46.994680 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3cc08-0b03-498d-a885-2ed0c60892ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:46.994953 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3cc08-0b03-498d-a885-2ed0c60892ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:46.996606 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-c9a3cc08-0b03-498d-a885-2ed0c60892ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:47.102690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3cc08-0b03-498d-a885-2ed0c60892ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:47.104390 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3cc08-0b03-498d-a885-2ed0c60892ad service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:47.122318 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 664/1340] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:30:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:51.543500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2863261-6dec-4dcc-a41b-1eda49a1ea67 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:51.544119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2863261-6dec-4dcc-a41b-1eda49a1ea67 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:51.544119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2863261-6dec-4dcc-a41b-1eda49a1ea67 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:51.545425 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 677/1341] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:51.550627 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47162545-adae-4f5a-9e72-96f18b1a376c None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:51.551030 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47162545-adae-4f5a-9e72-96f18b1a376c None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:51.551199 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47162545-adae-4f5a-9e72-96f18b1a376c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:51.558181 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:51.629722 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-47162545-adae-4f5a-9e72-96f18b1a376c None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:51.631181 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-47162545-adae-4f5a-9e72-96f18b1a376c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:51.749487 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 665/1342] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:51.788398 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2863261-6dec-4dcc-a41b-1eda49a1ea67 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:51.792291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-e2863261-6dec-4dcc-a41b-1eda49a1ea67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:51.843040 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:51.890226 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2863261-6dec-4dcc-a41b-1eda49a1ea67 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:51.893725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9752cb8-db0e-4cff-b8b3-c91cf1cd9e29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:51.894375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9752cb8-db0e-4cff-b8b3-c91cf1cd9e29 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:51.894660 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9752cb8-db0e-4cff-b8b3-c91cf1cd9e29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:51.894937 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9752cb8-db0e-4cff-b8b3-c91cf1cd9e29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:51.905014 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9752cb8-db0e-4cff-b8b3-c91cf1cd9e29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:51.906458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9752cb8-db0e-4cff-b8b3-c91cf1cd9e29 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:51.916707 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 678/1343] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:30:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:54.722884 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f349d-bb1f-4646-bd98-70f12a7ac3bf None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:54.723487 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f349d-bb1f-4646-bd98-70f12a7ac3bf None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:54.723487 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f349d-bb1f-4646-bd98-70f12a7ac3bf None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:54.724727 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 666/1344] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:54.730686 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d1809-2e77-4ab3-ac4d-c33899ec46ec None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:54.731102 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d1809-2e77-4ab3-ac4d-c33899ec46ec None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:54.731402 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d1809-2e77-4ab3-ac4d-c33899ec46ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:54.759826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-3b4d1809-2e77-4ab3-ac4d-c33899ec46ec None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:54.761016 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-3b4d1809-2e77-4ab3-ac4d-c33899ec46ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:54.846583 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 679/1345] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:30:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:54.883090 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f349d-bb1f-4646-bd98-70f12a7ac3bf None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:54.893618 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f349d-bb1f-4646-bd98-70f12a7ac3bf None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:54.897119 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa1f46-24af-4ff9-b83e-13dc44bf0848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:54.897755 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa1f46-24af-4ff9-b83e-13dc44bf0848 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:54.898037 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa1f46-24af-4ff9-b83e-13dc44bf0848 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:54.898849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa1f46-24af-4ff9-b83e-13dc44bf0848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:54.908186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa1f46-24af-4ff9-b83e-13dc44bf0848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:54.909620 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa1f46-24af-4ff9-b83e-13dc44bf0848 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:54.920274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 667/1346] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:30:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:30:59.020587 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dec1af-7509-41f5-b75c-3874cc3bf877 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:59.021104 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dec1af-7509-41f5-b75c-3874cc3bf877 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:59.021225 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dec1af-7509-41f5-b75c-3874cc3bf877 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:59.022503 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 680/1347] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:30:59.028172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084a6b0-7aaa-4772-bb15-7d06d08823ee None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:59.028604 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084a6b0-7aaa-4772-bb15-7d06d08823ee None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:59.028736 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084a6b0-7aaa-4772-bb15-7d06d08823ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:59.046619 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-f084a6b0-7aaa-4772-bb15-7d06d08823ee None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:30:59.047905 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f084a6b0-7aaa-4772-bb15-7d06d08823ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:30:59.055998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 668/1348] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:30:59.093435 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dec1af-7509-41f5-b75c-3874cc3bf877 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:30:59.107053 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dec1af-7509-41f5-b75c-3874cc3bf877 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:30:59.111195 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd35ad0-54db-4f8a-b60f-0ed0d5a5097a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:30:59.112134 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd35ad0-54db-4f8a-b60f-0ed0d5a5097a service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:30:59.112420 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd35ad0-54db-4f8a-b60f-0ed0d5a5097a service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:30:59.112699 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd35ad0-54db-4f8a-b60f-0ed0d5a5097a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:30:59.122696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd35ad0-54db-4f8a-b60f-0ed0d5a5097a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:30:59.124168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd35ad0-54db-4f8a-b60f-0ed0d5a5097a service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:30:59.134193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 681/1349] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:30:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:31:04.644638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be18ee4-7d6e-49b6-be95-c2bfeccc31ea None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:04.645764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be18ee4-7d6e-49b6-be95-c2bfeccc31ea None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:04.646262 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be18ee4-7d6e-49b6-be95-c2bfeccc31ea None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:04.648087 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 669/1350] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 09:31:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:31:04.653165 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad008951-db9e-4df3-bc31-8c82b1723bbc None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:04.653583 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad008951-db9e-4df3-bc31-8c82b1723bbc None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:04.653733 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad008951-db9e-4df3-bc31-8c82b1723bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:04.779302 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-ad008951-db9e-4df3-bc31-8c82b1723bbc None None] MFA Rules not processed for user `746fd8ed517446fe89c53df873abb2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:31:04.780450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-ad008951-db9e-4df3-bc31-8c82b1723bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:31:04.837341 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:31:04.893527 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 682/1351] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 09:31:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:31:08.983614 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258021b-1ce8-410f-ad02-ace2448b2b40 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:08.984129 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258021b-1ce8-410f-ad02-ace2448b2b40 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:08.984335 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258021b-1ce8-410f-ad02-ace2448b2b40 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:08.985942 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 670/1352] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 09:31:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:31:08.991187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f8b0e-7b72-4a3d-98a9-e8c88b22d518 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:08.992632 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f8b0e-7b72-4a3d-98a9-e8c88b22d518 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:08.992991 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f8b0e-7b72-4a3d-98a9-e8c88b22d518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:09.012321 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-589f8b0e-7b72-4a3d-98a9-e8c88b22d518 None None] MFA Rules not processed for user `746fd8ed517446fe89c53df873abb2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:31:09.013602 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-589f8b0e-7b72-4a3d-98a9-e8c88b22d518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:31:09.022552 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 683/1353] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 09:31:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:31:09.041178 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=72 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:31:10.591610 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef25dd1-a380-4771-99e3-e6feb2bf498a None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:10.592228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef25dd1-a380-4771-99e3-e6feb2bf498a None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:10.592228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef25dd1-a380-4771-99e3-e6feb2bf498a None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:10.593515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 671/1354] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 09:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:31:10.598501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3ff5e-a7a4-47cc-8f15-bbde35eca7df None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:10.598922 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3ff5e-a7a4-47cc-8f15-bbde35eca7df None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:10.599154 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3ff5e-a7a4-47cc-8f15-bbde35eca7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:10.618407 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-a1a3ff5e-a7a4-47cc-8f15-bbde35eca7df None None] MFA Rules not processed for user `746fd8ed517446fe89c53df873abb2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:31:10.619740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-a1a3ff5e-a7a4-47cc-8f15-bbde35eca7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:31:10.628114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 684/1355] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 09:31:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:31:14.509183 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ab0d9-b63f-4362-a523-567572f7755c None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:14.509729 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ab0d9-b63f-4362-a523-567572f7755c None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:14.509729 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ab0d9-b63f-4362-a523-567572f7755c None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:14.511006 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 672/1356] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:31:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:31:14.516439 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd43a67-e1a4-4214-b00c-bfffde48849d None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:14.516854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd43a67-e1a4-4214-b00c-bfffde48849d None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:14.516996 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd43a67-e1a4-4214-b00c-bfffde48849d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:14.534744 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-ccd43a67-e1a4-4214-b00c-bfffde48849d None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:31:14.535950 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-ccd43a67-e1a4-4214-b00c-bfffde48849d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:31:14.543859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 685/1357] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:31:14.598166 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc24348-6160-40b3-8540-dea97e854b91 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:14.598464 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc24348-6160-40b3-8540-dea97e854b91 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:14.598751 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc24348-6160-40b3-8540-dea97e854b91 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:14.600154 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 673/1358] 10.222.0.41 () {54 vars in 961 bytes} [Fri May 27 09:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:31:14.609131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cafd3-edee-43ae-b99e-47a0795517db None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:14.609822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cafd3-edee-43ae-b99e-47a0795517db None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:14.610254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cafd3-edee-43ae-b99e-47a0795517db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:14.671962 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-5b0cafd3-edee-43ae-b99e-47a0795517db None None] MFA Rules not processed for user `d2b1c12e88c549208894fc0dd0c60b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:31:14.673995 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-5b0cafd3-edee-43ae-b99e-47a0795517db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:31:14.767321 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 686/1359] 10.222.0.41 () {58 vars in 1058 bytes} [Fri May 27 09:31:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:31:14.775863 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc24348-6160-40b3-8540-dea97e854b91 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:31:14.792221 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc24348-6160-40b3-8540-dea97e854b91 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:31:14.797614 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a70d1-de56-4be6-9b74-77272564ab22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:31:14.798259 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a70d1-de56-4be6-9b74-77272564ab22 service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:14.798545 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a70d1-de56-4be6-9b74-77272564ab22 service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:14.799004 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a70d1-de56-4be6-9b74-77272564ab22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:14.808442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a70d1-de56-4be6-9b74-77272564ab22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:31:14.810035 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a70d1-de56-4be6-9b74-77272564ab22 service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:31:14.819723 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 674/1360] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:31:17.242840 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea901b-152c-4970-879f-588d29d95a8a None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:17.243363 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea901b-152c-4970-879f-588d29d95a8a None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:17.243363 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea901b-152c-4970-879f-588d29d95a8a None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:17.244859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 687/1361] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:31:17.250017 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b1d09-2268-42b6-b458-725210f30a8c None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:17.250811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b1d09-2268-42b6-b458-725210f30a8c None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:17.251093 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b1d09-2268-42b6-b458-725210f30a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:17.269270 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-890b1d09-2268-42b6-b458-725210f30a8c None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:31:17.270703 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-890b1d09-2268-42b6-b458-725210f30a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:31:17.281579 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 675/1362] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:31:17.326464 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea901b-152c-4970-879f-588d29d95a8a None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:31:17.341446 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea901b-152c-4970-879f-588d29d95a8a None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:31:17.347019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a63631-69c1-424f-860d-a5ca55e3a6c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:31:17.347687 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a63631-69c1-424f-860d-a5ca55e3a6c0 service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:17.347974 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a63631-69c1-424f-860d-a5ca55e3a6c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:17.348255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a63631-69c1-424f-860d-a5ca55e3a6c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:17.357328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a63631-69c1-424f-860d-a5ca55e3a6c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:31:17.358925 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a63631-69c1-424f-860d-a5ca55e3a6c0 service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:31:17.369460 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 688/1363] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:31:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:31:19.897571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa9d59-2c36-4542-b833-9d188dc251a4 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:19.898058 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa9d59-2c36-4542-b833-9d188dc251a4 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:19.898163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa9d59-2c36-4542-b833-9d188dc251a4 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:19.900368 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 676/1364] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:31:19.905227 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48826c89-3d14-48c3-b275-f40ca4a43bcf None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:19.906173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48826c89-3d14-48c3-b275-f40ca4a43bcf None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:19.906652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48826c89-3d14-48c3-b275-f40ca4a43bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:19.929188 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-48826c89-3d14-48c3-b275-f40ca4a43bcf None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:31:19.930961 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-48826c89-3d14-48c3-b275-f40ca4a43bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:31:19.941329 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 689/1365] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:31:19.992872 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123b65b-20a0-4664-8850-472644a91e57 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:19.993107 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123b65b-20a0-4664-8850-472644a91e57 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:19.993344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123b65b-20a0-4664-8850-472644a91e57 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:19.995486 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 677/1366] 10.222.0.41 () {54 vars in 961 bytes} [Fri May 27 09:31:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:31:20.000966 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efff96b-98fb-47b8-8839-705134bd840a None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:20.001325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efff96b-98fb-47b8-8839-705134bd840a None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:20.001818 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efff96b-98fb-47b8-8839-705134bd840a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:20.021980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-7efff96b-98fb-47b8-8839-705134bd840a None None] MFA Rules not processed for user `d2b1c12e88c549208894fc0dd0c60b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:31:20.025139 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-7efff96b-98fb-47b8-8839-705134bd840a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:31:20.037816 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 690/1367] 10.222.0.41 () {58 vars in 1058 bytes} [Fri May 27 09:31:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:31:20.046320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123b65b-20a0-4664-8850-472644a91e57 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:31:20.060997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123b65b-20a0-4664-8850-472644a91e57 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:31:20.067021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149acfd9-61af-49f8-b0d8-32c60634c40f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:31:20.067687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149acfd9-61af-49f8-b0d8-32c60634c40f service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:20.067970 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149acfd9-61af-49f8-b0d8-32c60634c40f service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:20.068239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149acfd9-61af-49f8-b0d8-32c60634c40f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:20.076970 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149acfd9-61af-49f8-b0d8-32c60634c40f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:31:20.078527 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149acfd9-61af-49f8-b0d8-32c60634c40f service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:31:20.088166 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 678/1368] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:31:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:31:22.438125 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa496eb-f1d8-488b-a907-460e84b96716 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:22.439077 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa496eb-f1d8-488b-a907-460e84b96716 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:22.439532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa496eb-f1d8-488b-a907-460e84b96716 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:22.441427 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 691/1369] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:31:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:31:22.446719 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e065e29-ebca-465b-9972-65c9bc6d8b35 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:22.447208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e065e29-ebca-465b-9972-65c9bc6d8b35 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:22.447323 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e065e29-ebca-465b-9972-65c9bc6d8b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:22.466578 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-7e065e29-ebca-465b-9972-65c9bc6d8b35 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:31:22.468884 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-7e065e29-ebca-465b-9972-65c9bc6d8b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:31:22.482142 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 679/1370] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:31:22.532533 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa496eb-f1d8-488b-a907-460e84b96716 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:31:22.549615 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa496eb-f1d8-488b-a907-460e84b96716 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:31:22.556346 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8ce9b-b9fd-482d-805e-983c6799c8a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:31:22.557117 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8ce9b-b9fd-482d-805e-983c6799c8a3 service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:22.557497 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8ce9b-b9fd-482d-805e-983c6799c8a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:22.557851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8ce9b-b9fd-482d-805e-983c6799c8a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:22.568327 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8ce9b-b9fd-482d-805e-983c6799c8a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:31:22.570001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8ce9b-b9fd-482d-805e-983c6799c8a3 service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:31:22.580750 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 692/1371] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:31:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:31:22.747345 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb2999-0b8b-4e69-96a9-444ec2d61369 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:22.747570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb2999-0b8b-4e69-96a9-444ec2d61369 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:22.747831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb2999-0b8b-4e69-96a9-444ec2d61369 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:22.749503 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 680/1372] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:31:22.755763 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294f614-d440-4177-b2dd-15726f68185d None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:22.756387 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294f614-d440-4177-b2dd-15726f68185d None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:22.756736 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294f614-d440-4177-b2dd-15726f68185d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:22.778904 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-d294f614-d440-4177-b2dd-15726f68185d None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:31:22.780286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d294f614-d440-4177-b2dd-15726f68185d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:31:22.791323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 693/1373] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:31:23.071447 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e969f-5c4b-4e9c-ac15-e0a247a307c5 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:23.071748 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e969f-5c4b-4e9c-ac15-e0a247a307c5 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:23.072031 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e969f-5c4b-4e9c-ac15-e0a247a307c5 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:23.073675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 681/1374] 10.222.0.41 () {54 vars in 963 bytes} [Fri May 27 09:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:31:23.079082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfcc1f-a8fb-476b-ac6c-06e5efd4df05 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:23.079517 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfcc1f-a8fb-476b-ac6c-06e5efd4df05 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:23.079898 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfcc1f-a8fb-476b-ac6c-06e5efd4df05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:23.086715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:31:23.132743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-c1dfcc1f-a8fb-476b-ac6c-06e5efd4df05 None None] MFA Rules not processed for user `192c3d179fdb43c9885f637446c83a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:31:23.135449 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-c1dfcc1f-a8fb-476b-ac6c-06e5efd4df05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:31:23.202134 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 694/1375] 10.222.0.41 () {58 vars in 1060 bytes} [Fri May 27 09:31:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:31:23.209592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e969f-5c4b-4e9c-ac15-e0a247a307c5 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:31:23.220343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e969f-5c4b-4e9c-ac15-e0a247a307c5 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:31:23.223919 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f12a8-279c-418a-b7ac-b2f6e8cbd30b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:31:23.224658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f12a8-279c-418a-b7ac-b2f6e8cbd30b service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:23.225177 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f12a8-279c-418a-b7ac-b2f6e8cbd30b service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:23.225677 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f12a8-279c-418a-b7ac-b2f6e8cbd30b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:23.236090 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f12a8-279c-418a-b7ac-b2f6e8cbd30b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:31:23.237593 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f12a8-279c-418a-b7ac-b2f6e8cbd30b service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:31:23.248154 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 682/1376] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:31:24.864528 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fd263-f7a8-4528-8e28-4417e1d511f0 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:24.865088 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fd263-f7a8-4528-8e28-4417e1d511f0 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:24.865088 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fd263-f7a8-4528-8e28-4417e1d511f0 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:24.866487 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 695/1377] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:31:24.872911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48568b6-9af9-4b14-8dcc-7223a847f8e1 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:24.873439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48568b6-9af9-4b14-8dcc-7223a847f8e1 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:24.873550 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48568b6-9af9-4b14-8dcc-7223a847f8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:24.892652 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-e48568b6-9af9-4b14-8dcc-7223a847f8e1 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:31:24.893799 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e48568b6-9af9-4b14-8dcc-7223a847f8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:31:24.901857 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 683/1378] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:31:24.947601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fd263-f7a8-4528-8e28-4417e1d511f0 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:31:24.962199 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fd263-f7a8-4528-8e28-4417e1d511f0 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:31:24.967684 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad21da-e951-4498-9f86-8c1d692cd24a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:31:24.968338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad21da-e951-4498-9f86-8c1d692cd24a service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:24.968625 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad21da-e951-4498-9f86-8c1d692cd24a service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:24.968903 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad21da-e951-4498-9f86-8c1d692cd24a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:24.978787 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad21da-e951-4498-9f86-8c1d692cd24a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:31:24.980408 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad21da-e951-4498-9f86-8c1d692cd24a service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:31:24.990403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 696/1379] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:31:27.237634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65c2a6-0b90-44bb-bcb6-6b6af60cefda None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:27.238528 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65c2a6-0b90-44bb-bcb6-6b6af60cefda None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:27.238813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65c2a6-0b90-44bb-bcb6-6b6af60cefda None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:27.240219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 684/1380] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:31:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:31:27.245962 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bec41-6d6a-425d-ab26-6deb98a46fe8 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:27.246368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bec41-6d6a-425d-ab26-6deb98a46fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:27.246524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bec41-6d6a-425d-ab26-6deb98a46fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:27.265157 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-7b7bec41-6d6a-425d-ab26-6deb98a46fe8 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:31:27.266340 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-7b7bec41-6d6a-425d-ab26-6deb98a46fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:31:27.274333 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 697/1381] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:31:27.318402 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65c2a6-0b90-44bb-bcb6-6b6af60cefda None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:31:27.333685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65c2a6-0b90-44bb-bcb6-6b6af60cefda None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:31:27.339456 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf486b3-1dee-4ef8-80a1-a961fddeed64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:31:27.340104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf486b3-1dee-4ef8-80a1-a961fddeed64 service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:27.340387 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf486b3-1dee-4ef8-80a1-a961fddeed64 service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:27.340672 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf486b3-1dee-4ef8-80a1-a961fddeed64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:27.349375 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf486b3-1dee-4ef8-80a1-a961fddeed64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:31:27.350939 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf486b3-1dee-4ef8-80a1-a961fddeed64 service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:31:27.361020 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 685/1382] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:31:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:31:29.672404 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce2fb7-50f9-489d-8057-f3cfd11f46ba None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:29.672924 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce2fb7-50f9-489d-8057-f3cfd11f46ba None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:29.672924 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce2fb7-50f9-489d-8057-f3cfd11f46ba None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:29.674238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 698/1383] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:31:29.679871 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7fac2-d62d-4384-bb10-23ebb98e530b None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:29.680292 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7fac2-d62d-4384-bb10-23ebb98e530b None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:29.680418 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7fac2-d62d-4384-bb10-23ebb98e530b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:29.698205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-56f7fac2-d62d-4384-bb10-23ebb98e530b None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:31:29.699427 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-56f7fac2-d62d-4384-bb10-23ebb98e530b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:31:29.707223 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 686/1384] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:31:29.748956 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce2fb7-50f9-489d-8057-f3cfd11f46ba None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:31:29.765024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce2fb7-50f9-489d-8057-f3cfd11f46ba None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:31:29.770584 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ceafb-70d1-4570-9cf4-6798931fabdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:31:29.771226 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ceafb-70d1-4570-9cf4-6798931fabdb service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:29.771541 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ceafb-70d1-4570-9cf4-6798931fabdb service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:29.771821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ceafb-70d1-4570-9cf4-6798931fabdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:29.781191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ceafb-70d1-4570-9cf4-6798931fabdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:31:29.782787 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ceafb-70d1-4570-9cf4-6798931fabdb service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:31:29.794122 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 699/1385] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:31:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:31:32.052008 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda71959-68ef-4bee-9ed7-d667a648ba5a None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:32.052688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda71959-68ef-4bee-9ed7-d667a648ba5a None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:32.052688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda71959-68ef-4bee-9ed7-d667a648ba5a None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:32.054002 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 687/1386] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:31:32.059486 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94d034-8c4b-43c7-bc22-fe868c044a29 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:32.059931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94d034-8c4b-43c7-bc22-fe868c044a29 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:32.060231 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94d034-8c4b-43c7-bc22-fe868c044a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:32.079059 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-8c94d034-8c4b-43c7-bc22-fe868c044a29 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:31:32.080349 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-8c94d034-8c4b-43c7-bc22-fe868c044a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:31:32.089401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 700/1387] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:31:32.142835 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda71959-68ef-4bee-9ed7-d667a648ba5a None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:31:32.159300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda71959-68ef-4bee-9ed7-d667a648ba5a None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:31:32.165041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e9b43-0284-4652-a900-ba4c10942dd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:31:32.165674 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e9b43-0284-4652-a900-ba4c10942dd2 service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:32.166012 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e9b43-0284-4652-a900-ba4c10942dd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:32.166264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e9b43-0284-4652-a900-ba4c10942dd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:32.174957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e9b43-0284-4652-a900-ba4c10942dd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:31:32.176617 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e9b43-0284-4652-a900-ba4c10942dd2 service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:31:32.186513 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 688/1388] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:31:34.417290 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c094c4-8cda-4471-b9f5-4c88d5f1b740 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:34.418001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c094c4-8cda-4471-b9f5-4c88d5f1b740 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:34.418001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c094c4-8cda-4471-b9f5-4c88d5f1b740 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:34.419330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 701/1389] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:31:34.424714 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d81574-500b-43e4-b88a-a95d49cdbed0 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:34.425264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d81574-500b-43e4-b88a-a95d49cdbed0 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:34.425264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d81574-500b-43e4-b88a-a95d49cdbed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:34.443431 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-a0d81574-500b-43e4-b88a-a95d49cdbed0 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:31:34.444599 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-a0d81574-500b-43e4-b88a-a95d49cdbed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:31:34.452669 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 689/1390] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:31:34.497532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c094c4-8cda-4471-b9f5-4c88d5f1b740 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:31:34.515127 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c094c4-8cda-4471-b9f5-4c88d5f1b740 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:31:34.521846 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf49755-d74e-492d-852b-f8b2b11e4374 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:31:34.522711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf49755-d74e-492d-852b-f8b2b11e4374 service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:34.523067 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf49755-d74e-492d-852b-f8b2b11e4374 service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:34.523447 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf49755-d74e-492d-852b-f8b2b11e4374 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:34.533617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf49755-d74e-492d-852b-f8b2b11e4374 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:31:34.535692 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf49755-d74e-492d-852b-f8b2b11e4374 service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:31:34.548284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 702/1391] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:31:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:31:36.829119 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81976b-eb40-40e6-aebb-06d5b6ebf660 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:36.829783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81976b-eb40-40e6-aebb-06d5b6ebf660 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:36.829783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81976b-eb40-40e6-aebb-06d5b6ebf660 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:36.831031 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 690/1392] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:31:36.837095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e543f8-0ec9-48a9-9395-6401fa2de0ee None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:36.837539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e543f8-0ec9-48a9-9395-6401fa2de0ee None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:36.837914 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e543f8-0ec9-48a9-9395-6401fa2de0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:36.856522 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-e9e543f8-0ec9-48a9-9395-6401fa2de0ee None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:31:36.857716 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-e9e543f8-0ec9-48a9-9395-6401fa2de0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:31:36.865500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 703/1393] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:31:36.913304 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81976b-eb40-40e6-aebb-06d5b6ebf660 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:31:36.929156 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81976b-eb40-40e6-aebb-06d5b6ebf660 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:31:36.938772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc84c0-f71d-4954-bc49-cd378dbb558b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:31:36.939453 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc84c0-f71d-4954-bc49-cd378dbb558b service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:36.939738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc84c0-f71d-4954-bc49-cd378dbb558b service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:36.940016 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc84c0-f71d-4954-bc49-cd378dbb558b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:36.951678 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc84c0-f71d-4954-bc49-cd378dbb558b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:31:36.953262 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc84c0-f71d-4954-bc49-cd378dbb558b service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:31:36.963303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 691/1394] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:31:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:31:38.846715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48132d-214c-4c9e-a383-44251a9d3aa7 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:38.847320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48132d-214c-4c9e-a383-44251a9d3aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:38.847320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48132d-214c-4c9e-a383-44251a9d3aa7 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:38.848661 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 704/1395] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:31:38.854577 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3c714-c54b-4f8f-9c93-86b650ec9f3c None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:38.855006 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3c714-c54b-4f8f-9c93-86b650ec9f3c None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:38.855166 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3c714-c54b-4f8f-9c93-86b650ec9f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:38.873395 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-88e3c714-c54b-4f8f-9c93-86b650ec9f3c None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:31:38.874586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-88e3c714-c54b-4f8f-9c93-86b650ec9f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:31:38.882328 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 692/1396] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:31:38.936603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dcf2c-20c2-40fc-a82c-0dbb3aeff9b9 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:38.936900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dcf2c-20c2-40fc-a82c-0dbb3aeff9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:38.937184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dcf2c-20c2-40fc-a82c-0dbb3aeff9b9 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:38.938660 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 705/1397] 10.222.0.41 () {54 vars in 962 bytes} [Fri May 27 09:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:31:38.943807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf44efe-5a96-4d86-a103-47c90deb9082 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:38.944095 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf44efe-5a96-4d86-a103-47c90deb9082 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:38.944401 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf44efe-5a96-4d86-a103-47c90deb9082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:38.995647 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-fbf44efe-5a96-4d86-a103-47c90deb9082 None None] MFA Rules not processed for user `38e04575437341df8127860a5e5abc50`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:31:38.996892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-fbf44efe-5a96-4d86-a103-47c90deb9082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:31:39.045648 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=87 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:31:39.063224 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 693/1398] 10.222.0.41 () {58 vars in 1059 bytes} [Fri May 27 09:31:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:31:39.071077 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484dcf2c-20c2-40fc-a82c-0dbb3aeff9b9 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:31:39.081533 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484dcf2c-20c2-40fc-a82c-0dbb3aeff9b9 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:31:39.084957 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de9d3f-1b5f-4a0b-ab4c-7f556437d26d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e04575437341df8127860a5e5abc50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:31:39.086120 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de9d3f-1b5f-4a0b-ab4c-7f556437d26d service glance] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:39.086399 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de9d3f-1b5f-4a0b-ab4c-7f556437d26d service glance] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:39.086673 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de9d3f-1b5f-4a0b-ab4c-7f556437d26d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:39.095574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de9d3f-1b5f-4a0b-ab4c-7f556437d26d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:31:39.097053 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de9d3f-1b5f-4a0b-ab4c-7f556437d26d service glance] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:31:39.107300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 706/1399] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:31:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:31:39.196199 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df439a-eb20-433f-8225-879c6173fd42 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:39.196515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df439a-eb20-433f-8225-879c6173fd42 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:39.196759 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df439a-eb20-433f-8225-879c6173fd42 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:39.198128 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 694/1400] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:31:39.203347 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a1fc1-0f57-4bae-a7e8-c719bfb05146 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:39.203667 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a1fc1-0f57-4bae-a7e8-c719bfb05146 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:39.203945 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a1fc1-0f57-4bae-a7e8-c719bfb05146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:39.222738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-a06a1fc1-0f57-4bae-a7e8-c719bfb05146 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:31:39.223935 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-a06a1fc1-0f57-4bae-a7e8-c719bfb05146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:31:39.232477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 707/1401] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:31:39.275692 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df439a-eb20-433f-8225-879c6173fd42 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:31:39.290196 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df439a-eb20-433f-8225-879c6173fd42 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:31:39.295759 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a6e7d-8635-4dd5-bbdd-e83b2106c088 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:31:39.297937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a6e7d-8635-4dd5-bbdd-e83b2106c088 service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:39.297937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a6e7d-8635-4dd5-bbdd-e83b2106c088 service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:39.297937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a6e7d-8635-4dd5-bbdd-e83b2106c088 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:39.306115 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a6e7d-8635-4dd5-bbdd-e83b2106c088 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:31:39.307722 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a6e7d-8635-4dd5-bbdd-e83b2106c088 service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:31:39.317030 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 695/1402] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:31:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:31:39.631851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0025cf0-d47a-4770-b7b2-5db177e8fa5e None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:39.632660 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0025cf0-d47a-4770-b7b2-5db177e8fa5e None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:39.632941 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0025cf0-d47a-4770-b7b2-5db177e8fa5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:39.680585 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-a0025cf0-d47a-4770-b7b2-5db177e8fa5e None None] MFA Rules not processed for user `f52f0a03cc0f494d82a091bd885478e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:31:39.681794 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-a0025cf0-d47a-4770-b7b2-5db177e8fa5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:31:39.714740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:31:39.746207 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 708/1403] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 09:31:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:31:39.786692 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316458e1-5e50-4b1e-ad0c-d47aca6ca8cd None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:39.787011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316458e1-5e50-4b1e-ad0c-d47aca6ca8cd None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:39.787480 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316458e1-5e50-4b1e-ad0c-d47aca6ca8cd None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:39.788736 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 696/1404] 10.222.0.41 () {54 vars in 942 bytes} [Fri May 27 09:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:31:39.795665 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52281eca-610e-4ca8-a4fe-0c0305c9dda2 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:39.795990 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52281eca-610e-4ca8-a4fe-0c0305c9dda2 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:39.796238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52281eca-610e-4ca8-a4fe-0c0305c9dda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:39.845641 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-52281eca-610e-4ca8-a4fe-0c0305c9dda2 None None] MFA Rules not processed for user `351f74222d394f39bda0663e0e4ebde6`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:31:39.846937 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-52281eca-610e-4ca8-a4fe-0c0305c9dda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:31:39.920344 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 709/1405] 10.222.0.41 () {58 vars in 1039 bytes} [Fri May 27 09:31:39 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:31:39.930242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316458e1-5e50-4b1e-ad0c-d47aca6ca8cd None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:31:39.943601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316458e1-5e50-4b1e-ad0c-d47aca6ca8cd None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:31:39.949072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a31493-23ec-4d2b-8ef4-65ea0e33395e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '351f74222d394f39bda0663e0e4ebde6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:31:39.949742 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a31493-23ec-4d2b-8ef4-65ea0e33395e service swift] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:39.950024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a31493-23ec-4d2b-8ef4-65ea0e33395e service swift] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:39.950296 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a31493-23ec-4d2b-8ef4-65ea0e33395e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:39.958217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a31493-23ec-4d2b-8ef4-65ea0e33395e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:31:39.959826 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a31493-23ec-4d2b-8ef4-65ea0e33395e service swift] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:31:39.971552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 697/1406] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 09:31:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:31:41.563543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2982c55-44fa-45ab-a5bf-c42e387422bb None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:41.564100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2982c55-44fa-45ab-a5bf-c42e387422bb None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:41.564100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2982c55-44fa-45ab-a5bf-c42e387422bb None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:41.565482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 710/1407] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:31:41.570941 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06811abf-8a78-4f87-8f05-a17f9d2a8ba4 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:41.571821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06811abf-8a78-4f87-8f05-a17f9d2a8ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:41.572207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06811abf-8a78-4f87-8f05-a17f9d2a8ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:41.592684 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-06811abf-8a78-4f87-8f05-a17f9d2a8ba4 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:31:41.594001 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-06811abf-8a78-4f87-8f05-a17f9d2a8ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:31:41.602551 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 698/1408] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:31:41.666970 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2982c55-44fa-45ab-a5bf-c42e387422bb None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:31:41.689425 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2982c55-44fa-45ab-a5bf-c42e387422bb None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:31:41.706160 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06825a1d-32e1-4f47-be41-150a0b29449c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:31:41.707221 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06825a1d-32e1-4f47-be41-150a0b29449c service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:31:41.707768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06825a1d-32e1-4f47-be41-150a0b29449c service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:31:41.708272 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06825a1d-32e1-4f47-be41-150a0b29449c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:31:41.719018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06825a1d-32e1-4f47-be41-150a0b29449c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:31:41.722143 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06825a1d-32e1-4f47-be41-150a0b29449c service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:31:41.734703 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 711/1409] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:31:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:31:51.586733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=20 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:31:51.730158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=62 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:32:03.282603 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eef916-00dd-4560-b792-1c52e573c689 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:03.283234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eef916-00dd-4560-b792-1c52e573c689 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:03.283234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eef916-00dd-4560-b792-1c52e573c689 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:03.284547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 699/1410] 10.222.0.41 () {54 vars in 918 bytes} [Fri May 27 09:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:03.289694 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37db9da-55d3-4602-a91f-a407c442f1ce None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:03.290132 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37db9da-55d3-4602-a91f-a407c442f1ce None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:03.290242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37db9da-55d3-4602-a91f-a407c442f1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:03.308559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-a37db9da-55d3-4602-a91f-a407c442f1ce None None] MFA Rules not processed for user `746fd8ed517446fe89c53df873abb2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:03.309757 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-a37db9da-55d3-4602-a91f-a407c442f1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:03.318198 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 712/1411] 10.222.0.41 () {58 vars in 1015 bytes} [Fri May 27 09:32:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:03.332610 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82245508-c268-4351-a05a-551c68360786 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:03.332902 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82245508-c268-4351-a05a-551c68360786 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:03.333185 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82245508-c268-4351-a05a-551c68360786 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:03.334548 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 700/1412] 10.222.0.41 () {54 vars in 918 bytes} [Fri May 27 09:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:03.339172 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f9ade-bf1e-4866-a44d-596f8b6a095d None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:03.339496 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f9ade-bf1e-4866-a44d-596f8b6a095d None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:03.339776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f9ade-bf1e-4866-a44d-596f8b6a095d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:03.357246 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-e37f9ade-bf1e-4866-a44d-596f8b6a095d None None] MFA Rules not processed for user `d2b1c12e88c549208894fc0dd0c60b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:03.358406 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-e37f9ade-bf1e-4866-a44d-596f8b6a095d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:03.367754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 713/1413] 10.222.0.41 () {58 vars in 1015 bytes} [Fri May 27 09:32:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:06.005000 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c3821-5275-47ea-a0da-2eca71548ba9 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:06.005576 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c3821-5275-47ea-a0da-2eca71548ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:06.005576 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c3821-5275-47ea-a0da-2eca71548ba9 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:06.006915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:06.012129 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f1e52-9eb8-403c-9172-fe06bf8f9bef None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:06.012571 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f1e52-9eb8-403c-9172-fe06bf8f9bef None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:06.012675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f1e52-9eb8-403c-9172-fe06bf8f9bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:06.030280 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-5d2f1e52-9eb8-403c-9172-fe06bf8f9bef None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:06.031487 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-5d2f1e52-9eb8-403c-9172-fe06bf8f9bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:06.039675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:06.088352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c3821-5275-47ea-a0da-2eca71548ba9 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:06.105614 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c3821-5275-47ea-a0da-2eca71548ba9 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:06.111037 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a353a5c-82bf-4528-a544-9477b4851805 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:06.111715 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a353a5c-82bf-4528-a544-9477b4851805 service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:06.111998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a353a5c-82bf-4528-a544-9477b4851805 service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:06.112273 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a353a5c-82bf-4528-a544-9477b4851805 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:06.120888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a353a5c-82bf-4528-a544-9477b4851805 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:06.122457 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a353a5c-82bf-4528-a544-9477b4851805 service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:06.131804 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 702/1416] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:32:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:32:07.101438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309718a-40fc-43fb-85f0-c520a51419b7 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:07.102008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309718a-40fc-43fb-85f0-c520a51419b7 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:07.102008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309718a-40fc-43fb-85f0-c520a51419b7 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:07.103657 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:07.110478 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdf13c-efdf-424b-acac-437adcdfecdf None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:07.111069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdf13c-efdf-424b-acac-437adcdfecdf None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:07.111069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdf13c-efdf-424b-acac-437adcdfecdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:07.140106 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-5dbdf13c-efdf-424b-acac-437adcdfecdf None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:07.141169 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-5dbdf13c-efdf-424b-acac-437adcdfecdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:07.148935 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:07.316645 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309718a-40fc-43fb-85f0-c520a51419b7 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:07.331944 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309718a-40fc-43fb-85f0-c520a51419b7 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:07.338014 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c57b2-7f9c-4a90-9453-ff9b847fc605 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:07.338652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c57b2-7f9c-4a90-9453-ff9b847fc605 service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:07.338932 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c57b2-7f9c-4a90-9453-ff9b847fc605 service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:07.339209 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c57b2-7f9c-4a90-9453-ff9b847fc605 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:07.347555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c57b2-7f9c-4a90-9453-ff9b847fc605 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:07.349146 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c57b2-7f9c-4a90-9453-ff9b847fc605 service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:07.358865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 716/1419] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:32:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:32:08.347745 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7987b-a699-49ad-925d-01a1f7963a5f None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:08.348262 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7987b-a699-49ad-925d-01a1f7963a5f None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:08.348262 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7987b-a699-49ad-925d-01a1f7963a5f None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:08.349598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:08.354914 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a018c-7e70-46dc-8d17-9784b2f4a368 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:08.355382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a018c-7e70-46dc-8d17-9784b2f4a368 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:08.355497 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a018c-7e70-46dc-8d17-9784b2f4a368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:08.375431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-233a018c-7e70-46dc-8d17-9784b2f4a368 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:08.376631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-233a018c-7e70-46dc-8d17-9784b2f4a368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:08.385424 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:08.551371 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7987b-a699-49ad-925d-01a1f7963a5f None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:08.568634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7987b-a699-49ad-925d-01a1f7963a5f None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:08.575041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3f101-3811-4126-b56f-44b4ae8c98ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:08.575763 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3f101-3811-4126-b56f-44b4ae8c98ca service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:08.576052 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3f101-3811-4126-b56f-44b4ae8c98ca service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:08.576333 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3f101-3811-4126-b56f-44b4ae8c98ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:08.585129 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3f101-3811-4126-b56f-44b4ae8c98ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:08.586734 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3f101-3811-4126-b56f-44b4ae8c98ca service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:08.596333 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 705/1422] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:32:09.524054 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47e24a-fe24-4aa7-89c1-7eb7c553cf48 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:09.524641 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47e24a-fe24-4aa7-89c1-7eb7c553cf48 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:09.524641 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47e24a-fe24-4aa7-89c1-7eb7c553cf48 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:09.525991 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:09.530927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7335c53-0e79-4f6a-874c-ce12f3bc3ee8 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:09.531569 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7335c53-0e79-4f6a-874c-ce12f3bc3ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:09.531569 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7335c53-0e79-4f6a-874c-ce12f3bc3ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:09.550571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-d7335c53-0e79-4f6a-874c-ce12f3bc3ee8 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:09.551825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-d7335c53-0e79-4f6a-874c-ce12f3bc3ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:09.560575 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:32:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:09.712881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47e24a-fe24-4aa7-89c1-7eb7c553cf48 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:09.728227 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47e24a-fe24-4aa7-89c1-7eb7c553cf48 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:09.734407 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f436916-7325-45e9-9aa8-24e2849afdaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:09.735067 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f436916-7325-45e9-9aa8-24e2849afdaa service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:09.735379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f436916-7325-45e9-9aa8-24e2849afdaa service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:09.735656 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f436916-7325-45e9-9aa8-24e2849afdaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:09.745029 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f436916-7325-45e9-9aa8-24e2849afdaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:09.746620 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f436916-7325-45e9-9aa8-24e2849afdaa service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:09.756349 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 719/1425] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:32:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:32:10.669219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0282d-b520-48e6-bfbb-613dde60a4ac None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:10.669748 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0282d-b520-48e6-bfbb-613dde60a4ac None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:10.669748 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0282d-b520-48e6-bfbb-613dde60a4ac None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:10.671140 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:10.676365 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac95f0f-ca25-4ea6-8fed-9d39bee9c9b1 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:10.676802 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac95f0f-ca25-4ea6-8fed-9d39bee9c9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:10.676911 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac95f0f-ca25-4ea6-8fed-9d39bee9c9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:10.696999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-bac95f0f-ca25-4ea6-8fed-9d39bee9c9b1 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:10.698299 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-bac95f0f-ca25-4ea6-8fed-9d39bee9c9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:10.706431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:10.854690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0282d-b520-48e6-bfbb-613dde60a4ac None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:10.869657 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0282d-b520-48e6-bfbb-613dde60a4ac None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:10.875110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ef459-c1cd-4061-bb87-54ae8c070f0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:10.875837 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ef459-c1cd-4061-bb87-54ae8c070f0d service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:10.876126 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ef459-c1cd-4061-bb87-54ae8c070f0d service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:10.876408 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ef459-c1cd-4061-bb87-54ae8c070f0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:10.885738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ef459-c1cd-4061-bb87-54ae8c070f0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:10.887388 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ef459-c1cd-4061-bb87-54ae8c070f0d service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:10.897364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 708/1428] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:32:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:32:11.747077 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e783ac-e9df-45d3-9ccd-1f8f3eed7967 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:11.747649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e783ac-e9df-45d3-9ccd-1f8f3eed7967 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:11.747649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e783ac-e9df-45d3-9ccd-1f8f3eed7967 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:11.749010 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:11.754071 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50274112-9623-45bd-ab40-e7db4fc25122 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:11.754518 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50274112-9623-45bd-ab40-e7db4fc25122 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:11.754626 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50274112-9623-45bd-ab40-e7db4fc25122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:11.773873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-50274112-9623-45bd-ab40-e7db4fc25122 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:11.775064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-50274112-9623-45bd-ab40-e7db4fc25122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:11.782982 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:11.933794 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e783ac-e9df-45d3-9ccd-1f8f3eed7967 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:11.948624 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e783ac-e9df-45d3-9ccd-1f8f3eed7967 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:11.954300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7881596-4705-4fa3-bffc-f26b2329485a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:11.955061 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7881596-4705-4fa3-bffc-f26b2329485a service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:11.955379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7881596-4705-4fa3-bffc-f26b2329485a service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:11.955651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7881596-4705-4fa3-bffc-f26b2329485a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:11.965714 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7881596-4705-4fa3-bffc-f26b2329485a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:11.967349 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7881596-4705-4fa3-bffc-f26b2329485a service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:11.978020 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 722/1431] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:32:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:32:12.836291 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6196183-b65c-45a4-afcd-0216122c7633 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:12.836815 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6196183-b65c-45a4-afcd-0216122c7633 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:12.836909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6196183-b65c-45a4-afcd-0216122c7633 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:12.838251 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:32:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:12.843440 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348bb43-ec89-4255-84bd-1810bcae043d None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:12.843851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348bb43-ec89-4255-84bd-1810bcae043d None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:12.844063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348bb43-ec89-4255-84bd-1810bcae043d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:12.863700 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-6348bb43-ec89-4255-84bd-1810bcae043d None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:12.864922 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-6348bb43-ec89-4255-84bd-1810bcae043d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:12.873405 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:13.022199 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6196183-b65c-45a4-afcd-0216122c7633 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:13.036683 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6196183-b65c-45a4-afcd-0216122c7633 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:13.042352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfc16a-6827-4985-b7d7-dc1d72d4e15e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:13.042994 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfc16a-6827-4985-b7d7-dc1d72d4e15e service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:13.043305 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfc16a-6827-4985-b7d7-dc1d72d4e15e service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:13.043582 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfc16a-6827-4985-b7d7-dc1d72d4e15e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:13.051982 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfc16a-6827-4985-b7d7-dc1d72d4e15e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:13.053575 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfc16a-6827-4985-b7d7-dc1d72d4e15e service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:13.063919 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 711/1434] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:32:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:32:13.969016 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060f5e-3270-4d2d-9527-ce7e6d7a51b1 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:13.969561 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060f5e-3270-4d2d-9527-ce7e6d7a51b1 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:13.969561 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060f5e-3270-4d2d-9527-ce7e6d7a51b1 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:13.971064 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:13.976529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7510b-ffcd-45b8-b2fc-eaf671ce9476 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:13.976962 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7510b-ffcd-45b8-b2fc-eaf671ce9476 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:13.977144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7510b-ffcd-45b8-b2fc-eaf671ce9476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:13.995696 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-35b7510b-ffcd-45b8-b2fc-eaf671ce9476 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:13.996870 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-35b7510b-ffcd-45b8-b2fc-eaf671ce9476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:14.004989 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:14.156900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1060f5e-3270-4d2d-9527-ce7e6d7a51b1 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:14.171219 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1060f5e-3270-4d2d-9527-ce7e6d7a51b1 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:14.176660 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac6941-be3b-4436-b7ff-908307aae5bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:14.177325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac6941-be3b-4436-b7ff-908307aae5bd service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:14.177601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac6941-be3b-4436-b7ff-908307aae5bd service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:14.177873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac6941-be3b-4436-b7ff-908307aae5bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:14.186022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac6941-be3b-4436-b7ff-908307aae5bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:14.187647 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac6941-be3b-4436-b7ff-908307aae5bd service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:14.197560 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 725/1437] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:32:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:32:15.081642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228ccc3-a403-47c7-a4c5-a06a38249f90 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:15.082058 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228ccc3-a403-47c7-a4c5-a06a38249f90 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:15.082234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228ccc3-a403-47c7-a4c5-a06a38249f90 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:15.083663 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:15.089010 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee61bf-bac2-48bd-889a-024d6ff27009 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:15.089411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee61bf-bac2-48bd-889a-024d6ff27009 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:15.089571 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee61bf-bac2-48bd-889a-024d6ff27009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:15.107884 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-66ee61bf-bac2-48bd-889a-024d6ff27009 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:15.109074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-66ee61bf-bac2-48bd-889a-024d6ff27009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:15.116666 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:15.263440 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228ccc3-a403-47c7-a4c5-a06a38249f90 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:15.278050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228ccc3-a403-47c7-a4c5-a06a38249f90 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:15.283199 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521d2bb-645a-43b0-80db-d7ee5c475e8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:15.283855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521d2bb-645a-43b0-80db-d7ee5c475e8a service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:15.284137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521d2bb-645a-43b0-80db-d7ee5c475e8a service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:15.284409 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521d2bb-645a-43b0-80db-d7ee5c475e8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:15.292872 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521d2bb-645a-43b0-80db-d7ee5c475e8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:15.294431 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521d2bb-645a-43b0-80db-d7ee5c475e8a service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:15.303631 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 714/1440] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:32:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:32:17.378824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa3802-acab-4e0a-bb48-e0d33040bfc8 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:17.379376 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa3802-acab-4e0a-bb48-e0d33040bfc8 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:17.379497 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa3802-acab-4e0a-bb48-e0d33040bfc8 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:17.380759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:17.385967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5944f-99ae-4f34-a365-45a1cc0ee993 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:17.386416 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5944f-99ae-4f34-a365-45a1cc0ee993 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:17.386556 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5944f-99ae-4f34-a365-45a1cc0ee993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:17.404567 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-65a5944f-99ae-4f34-a365-45a1cc0ee993 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:17.405754 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-65a5944f-99ae-4f34-a365-45a1cc0ee993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:17.414054 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:17.451328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa3802-acab-4e0a-bb48-e0d33040bfc8 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:17.462394 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa3802-acab-4e0a-bb48-e0d33040bfc8 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:17.465851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00431d39-edc5-4af4-9f06-d8301d765a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:17.466486 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00431d39-edc5-4af4-9f06-d8301d765a8a service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:17.466772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00431d39-edc5-4af4-9f06-d8301d765a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:17.467050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00431d39-edc5-4af4-9f06-d8301d765a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:17.476427 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00431d39-edc5-4af4-9f06-d8301d765a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:17.477856 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00431d39-edc5-4af4-9f06-d8301d765a8a service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:17.487405 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 728/1443] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:32:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:32:19.826530 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3d767-e50a-425b-8dfe-eb2cc1724317 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:19.827100 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3d767-e50a-425b-8dfe-eb2cc1724317 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:19.827100 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3d767-e50a-425b-8dfe-eb2cc1724317 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:19.828474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:19.833698 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e48d32-281a-4c78-9cd2-508b081f2edc None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:19.834143 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e48d32-281a-4c78-9cd2-508b081f2edc None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:19.834258 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e48d32-281a-4c78-9cd2-508b081f2edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:19.851750 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-d6e48d32-281a-4c78-9cd2-508b081f2edc None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:19.852952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d6e48d32-281a-4c78-9cd2-508b081f2edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:19.860942 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:19.898560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3d767-e50a-425b-8dfe-eb2cc1724317 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:19.909121 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3d767-e50a-425b-8dfe-eb2cc1724317 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:19.912658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990413f7-10f2-422b-8214-038b657114c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:19.913292 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990413f7-10f2-422b-8214-038b657114c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:19.913574 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990413f7-10f2-422b-8214-038b657114c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:19.913847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990413f7-10f2-422b-8214-038b657114c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:19.923612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990413f7-10f2-422b-8214-038b657114c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:19.925029 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990413f7-10f2-422b-8214-038b657114c8 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:19.935992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 717/1446] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:32:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:32:22.438431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330908f2-21d8-4c3f-961e-a42ddff36c64 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:22.438957 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330908f2-21d8-4c3f-961e-a42ddff36c64 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:22.438957 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330908f2-21d8-4c3f-961e-a42ddff36c64 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:22.440329 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:22.445472 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48687c6e-d5df-457a-b809-0571203e2f71 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:22.445914 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48687c6e-d5df-457a-b809-0571203e2f71 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:22.446011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48687c6e-d5df-457a-b809-0571203e2f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:22.463348 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-48687c6e-d5df-457a-b809-0571203e2f71 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:22.464523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-48687c6e-d5df-457a-b809-0571203e2f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:22.472085 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:22.510720 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330908f2-21d8-4c3f-961e-a42ddff36c64 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:22.512432 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-330908f2-21d8-4c3f-961e-a42ddff36c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:22.525217 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330908f2-21d8-4c3f-961e-a42ddff36c64 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:22.528723 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374d342-797e-44cc-ab22-b2f141835352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:22.529364 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374d342-797e-44cc-ab22-b2f141835352 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:22.529650 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374d342-797e-44cc-ab22-b2f141835352 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:22.529936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374d342-797e-44cc-ab22-b2f141835352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:22.539397 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374d342-797e-44cc-ab22-b2f141835352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:22.540834 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374d342-797e-44cc-ab22-b2f141835352 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:22.550071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 731/1449] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:32:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:32:25.000752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8a75d-0963-4211-afa8-9f7bbd559cf8 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:25.001319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8a75d-0963-4211-afa8-9f7bbd559cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:25.001319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8a75d-0963-4211-afa8-9f7bbd559cf8 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:25.002618 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:25.008068 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21df5c-f077-44e1-97e7-603b0e4abdf6 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:25.008533 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21df5c-f077-44e1-97e7-603b0e4abdf6 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:25.008638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21df5c-f077-44e1-97e7-603b0e4abdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:25.026633 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-4d21df5c-f077-44e1-97e7-603b0e4abdf6 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:25.027836 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-4d21df5c-f077-44e1-97e7-603b0e4abdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:25.035444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:25.073033 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8a75d-0963-4211-afa8-9f7bbd559cf8 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:25.083497 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8a75d-0963-4211-afa8-9f7bbd559cf8 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:25.087453 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4283a6c-d2c5-44bc-bc70-06bc5edcb8a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:25.088081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4283a6c-d2c5-44bc-bc70-06bc5edcb8a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:25.088360 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4283a6c-d2c5-44bc-bc70-06bc5edcb8a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:25.088631 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4283a6c-d2c5-44bc-bc70-06bc5edcb8a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:25.097160 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4283a6c-d2c5-44bc-bc70-06bc5edcb8a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:25.098568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4283a6c-d2c5-44bc-bc70-06bc5edcb8a9 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:25.108827 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 720/1452] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:32:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:32:27.354116 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317da0c-54ae-49cc-99db-b20a90c93c4f None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:27.354656 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317da0c-54ae-49cc-99db-b20a90c93c4f None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:27.354656 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317da0c-54ae-49cc-99db-b20a90c93c4f None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:27.356077 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:27.361269 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ae57d-e04b-478b-b227-84188a832868 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:27.361671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ae57d-e04b-478b-b227-84188a832868 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:27.361842 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ae57d-e04b-478b-b227-84188a832868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:27.379763 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-fc2ae57d-e04b-478b-b227-84188a832868 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:27.380957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-fc2ae57d-e04b-478b-b227-84188a832868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:27.389138 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:27.425801 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317da0c-54ae-49cc-99db-b20a90c93c4f None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:27.436792 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317da0c-54ae-49cc-99db-b20a90c93c4f None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:27.440253 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959ba7f-c8bb-4b0b-9565-67eca4dce823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:27.440885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959ba7f-c8bb-4b0b-9565-67eca4dce823 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:27.441168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959ba7f-c8bb-4b0b-9565-67eca4dce823 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:27.441442 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959ba7f-c8bb-4b0b-9565-67eca4dce823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:27.450771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959ba7f-c8bb-4b0b-9565-67eca4dce823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:27.452236 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959ba7f-c8bb-4b0b-9565-67eca4dce823 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:27.461474 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 734/1455] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:32:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:32:29.715211 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdb10f-7cd1-4ad3-a114-14da120dbc51 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:29.715770 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdb10f-7cd1-4ad3-a114-14da120dbc51 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:29.715891 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdb10f-7cd1-4ad3-a114-14da120dbc51 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:29.717228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:29.722458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95a617-c5cf-4ee8-937d-b971f3b8e596 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:29.722916 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95a617-c5cf-4ee8-937d-b971f3b8e596 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:29.723018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95a617-c5cf-4ee8-937d-b971f3b8e596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:29.741752 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-3c95a617-c5cf-4ee8-937d-b971f3b8e596 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:29.742938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-3c95a617-c5cf-4ee8-937d-b971f3b8e596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:29.750530 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:29.786838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdb10f-7cd1-4ad3-a114-14da120dbc51 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:29.798707 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdb10f-7cd1-4ad3-a114-14da120dbc51 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:29.802117 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b7ad8-5e63-4b63-88a6-38c9df81cbf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:29.802749 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b7ad8-5e63-4b63-88a6-38c9df81cbf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:29.803027 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b7ad8-5e63-4b63-88a6-38c9df81cbf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:29.803320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b7ad8-5e63-4b63-88a6-38c9df81cbf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:29.812511 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b7ad8-5e63-4b63-88a6-38c9df81cbf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:29.813927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b7ad8-5e63-4b63-88a6-38c9df81cbf2 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:29.823097 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 723/1458] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:32:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:32:32.068571 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b341d89-54f5-4e42-a164-75922ac46e29 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:32.068968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b341d89-54f5-4e42-a164-75922ac46e29 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:32.069169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b341d89-54f5-4e42-a164-75922ac46e29 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:32.070543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:32.075822 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fe212-1f46-4258-8df0-0bec66083a8e None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:32.076267 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fe212-1f46-4258-8df0-0bec66083a8e None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:32.076389 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fe212-1f46-4258-8df0-0bec66083a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:32.082358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=70 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:32:32.094684 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-524fe212-1f46-4258-8df0-0bec66083a8e None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:32.095893 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-524fe212-1f46-4258-8df0-0bec66083a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:32.104334 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:32.142105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b341d89-54f5-4e42-a164-75922ac46e29 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:32.147471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=73 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:32:32.153994 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b341d89-54f5-4e42-a164-75922ac46e29 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:32.157513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf8298-902c-48c1-b5fe-719b6ea3a276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:32.158181 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf8298-902c-48c1-b5fe-719b6ea3a276 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:32.158473 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf8298-902c-48c1-b5fe-719b6ea3a276 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:32.158754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf8298-902c-48c1-b5fe-719b6ea3a276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:32.168040 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf8298-902c-48c1-b5fe-719b6ea3a276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:32.169488 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf8298-902c-48c1-b5fe-719b6ea3a276 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:32.179334 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 737/1461] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:32:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:32:34.399454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7ee28-ab25-48f7-875c-cb9cae8ec2f5 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:34.399989 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7ee28-ab25-48f7-875c-cb9cae8ec2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:34.399989 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7ee28-ab25-48f7-875c-cb9cae8ec2f5 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:34.401287 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:34.406578 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb2279-a760-4ca6-8399-0a714cd78c04 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:34.407031 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb2279-a760-4ca6-8399-0a714cd78c04 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:34.407176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb2279-a760-4ca6-8399-0a714cd78c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:34.425220 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-dcbb2279-a760-4ca6-8399-0a714cd78c04 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:34.426444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-dcbb2279-a760-4ca6-8399-0a714cd78c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:34.434639 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:32:34.470505 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7ee28-ab25-48f7-875c-cb9cae8ec2f5 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:34.481810 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7ee28-ab25-48f7-875c-cb9cae8ec2f5 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:34.485306 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6ad0d-50ad-4fed-b866-112470b10cc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:34.485935 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6ad0d-50ad-4fed-b866-112470b10cc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:34.486231 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6ad0d-50ad-4fed-b866-112470b10cc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:34.486500 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6ad0d-50ad-4fed-b866-112470b10cc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:34.495821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6ad0d-50ad-4fed-b866-112470b10cc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:34.497237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6ad0d-50ad-4fed-b866-112470b10cc4 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:34.506348 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 726/1464] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:32:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:32:36.714713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800810d7-f9b1-452b-8691-78c91a587527 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:36.715296 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800810d7-f9b1-452b-8691-78c91a587527 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:36.715296 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800810d7-f9b1-452b-8691-78c91a587527 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:36.716672 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:36.721831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec4d34-03d7-47bb-889f-12d608604c9f None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:36.722235 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec4d34-03d7-47bb-889f-12d608604c9f None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:36.722389 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec4d34-03d7-47bb-889f-12d608604c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:36.740280 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-4dec4d34-03d7-47bb-889f-12d608604c9f None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:36.741761 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-4dec4d34-03d7-47bb-889f-12d608604c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:36.749494 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:36.786061 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800810d7-f9b1-452b-8691-78c91a587527 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:36.797847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800810d7-f9b1-452b-8691-78c91a587527 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:36.801395 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e847ac-1e4b-4887-a194-269d08c464ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:36.802031 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e847ac-1e4b-4887-a194-269d08c464ba service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:36.802319 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e847ac-1e4b-4887-a194-269d08c464ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:36.802599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e847ac-1e4b-4887-a194-269d08c464ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:36.811434 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e847ac-1e4b-4887-a194-269d08c464ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:36.812866 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e847ac-1e4b-4887-a194-269d08c464ba service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:36.823728 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 740/1467] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:32:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:32:39.052677 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595c808-ed0a-4555-b401-8b9b7f072540 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:39.053240 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595c808-ed0a-4555-b401-8b9b7f072540 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:39.053240 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595c808-ed0a-4555-b401-8b9b7f072540 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:39.054647 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:32:39.060080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22440fd-3721-49e8-9a1e-1b92c1f0a444 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:39.060500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22440fd-3721-49e8-9a1e-1b92c1f0a444 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:39.060652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22440fd-3721-49e8-9a1e-1b92c1f0a444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:39.078883 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-c22440fd-3721-49e8-9a1e-1b92c1f0a444 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:32:39.080123 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-c22440fd-3721-49e8-9a1e-1b92c1f0a444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:32:39.088532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:32:39.124312 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595c808-ed0a-4555-b401-8b9b7f072540 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:32:39.135763 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595c808-ed0a-4555-b401-8b9b7f072540 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:32:39.139459 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568bd3f4-637a-4186-b952-73df6ece9704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:32:39.140099 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bd3f4-637a-4186-b952-73df6ece9704 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:32:39.140386 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bd3f4-637a-4186-b952-73df6ece9704 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:32:39.140668 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bd3f4-637a-4186-b952-73df6ece9704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:32:39.149445 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568bd3f4-637a-4186-b952-73df6ece9704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:32:39.150865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568bd3f4-637a-4186-b952-73df6ece9704 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:32:39.160064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 729/1470] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:32:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:32:49.073667 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=17 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:32:49.156053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=17 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:33:12.079321 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1a8cf-79bd-46f1-8604-bad5a025b63a None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:33:12.079847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1a8cf-79bd-46f1-8604-bad5a025b63a None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:33:12.079960 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1a8cf-79bd-46f1-8604-bad5a025b63a None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:33:12.081267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 742/1471] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:33:12.086916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edc8dd-7b99-4447-b8d7-a7e0c3106c71 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:33:12.087364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edc8dd-7b99-4447-b8d7-a7e0c3106c71 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:33:12.087517 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edc8dd-7b99-4447-b8d7-a7e0c3106c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:33:12.105737 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-e4edc8dd-7b99-4447-b8d7-a7e0c3106c71 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:33:12.106935 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e4edc8dd-7b99-4447-b8d7-a7e0c3106c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:33:12.114769 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 730/1472] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:33:12.161442 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756814c-f28e-482f-8586-cb352683a4d2 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:33:12.161730 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756814c-f28e-482f-8586-cb352683a4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:33:12.162011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756814c-f28e-482f-8586-cb352683a4d2 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:33:12.163385 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 743/1473] 10.222.0.41 () {54 vars in 962 bytes} [Fri May 27 09:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:33:12.167948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461defa-dbba-4ba6-8dd0-69ee8d453f5f None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:33:12.168241 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461defa-dbba-4ba6-8dd0-69ee8d453f5f None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:33:12.168525 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461defa-dbba-4ba6-8dd0-69ee8d453f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:33:12.186509 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-f461defa-dbba-4ba6-8dd0-69ee8d453f5f None None] MFA Rules not processed for user `38e04575437341df8127860a5e5abc50`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:33:12.187725 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f461defa-dbba-4ba6-8dd0-69ee8d453f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:33:12.194699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 731/1474] 10.222.0.41 () {58 vars in 1059 bytes} [Fri May 27 09:33:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:33:12.201845 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756814c-f28e-482f-8586-cb352683a4d2 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:33:12.213381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756814c-f28e-482f-8586-cb352683a4d2 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:33:12.217194 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba8c22-5756-46e3-8444-39cbce34fb6b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e04575437341df8127860a5e5abc50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:33:12.217945 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba8c22-5756-46e3-8444-39cbce34fb6b service glance] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:33:12.218267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba8c22-5756-46e3-8444-39cbce34fb6b service glance] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:33:12.218583 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba8c22-5756-46e3-8444-39cbce34fb6b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:33:12.227766 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba8c22-5756-46e3-8444-39cbce34fb6b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:33:12.229451 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba8c22-5756-46e3-8444-39cbce34fb6b service glance] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:33:12.238567 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 744/1475] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:33:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:33:14.519939 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980b90f-ed42-4944-a87e-d4e2363e4b00 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:33:14.520489 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980b90f-ed42-4944-a87e-d4e2363e4b00 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:33:14.520489 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980b90f-ed42-4944-a87e-d4e2363e4b00 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:33:14.521926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 732/1476] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:33:14.527427 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f42f0-5df7-4223-b6e6-8c571798dd42 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:33:14.527888 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f42f0-5df7-4223-b6e6-8c571798dd42 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:33:14.527993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f42f0-5df7-4223-b6e6-8c571798dd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:33:14.545337 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-bd5f42f0-5df7-4223-b6e6-8c571798dd42 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:33:14.546526 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-bd5f42f0-5df7-4223-b6e6-8c571798dd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:33:14.554834 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 745/1477] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:33:14.577902 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980b90f-ed42-4944-a87e-d4e2363e4b00 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:33:14.590034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980b90f-ed42-4944-a87e-d4e2363e4b00 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:33:14.594359 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdcdc0-d16e-4417-ab50-1addb98f3dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:33:14.595000 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdcdc0-d16e-4417-ab50-1addb98f3dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:33:14.595293 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdcdc0-d16e-4417-ab50-1addb98f3dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:33:14.595586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdcdc0-d16e-4417-ab50-1addb98f3dc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:33:14.596301 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdcdc0-d16e-4417-ab50-1addb98f3dc8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:33:14.598031 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: WARNING py.warnings [None req-4ccdcdc0-d16e-4417-ab50-1addb98f3dc8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:33:14.598031 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: warnings.warn(msg) May 27 09:33:14.598031 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: May 27 09:33:14.599171 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdcdc0-d16e-4417-ab50-1addb98f3dc8 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:33:14.618773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 733/1478] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 09:33:14 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:33:16.837152 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644726ce-3b45-4c85-a837-2a25c4a1f44a None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:33:16.837720 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644726ce-3b45-4c85-a837-2a25c4a1f44a None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:33:16.837720 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644726ce-3b45-4c85-a837-2a25c4a1f44a None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:33:16.839130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 746/1479] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:33:16.844506 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2077a6-ebab-4021-88fa-ac012364f6ce None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:33:16.844904 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2077a6-ebab-4021-88fa-ac012364f6ce None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:33:16.845072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2077a6-ebab-4021-88fa-ac012364f6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:33:16.864693 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-7f2077a6-ebab-4021-88fa-ac012364f6ce None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:33:16.865998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-7f2077a6-ebab-4021-88fa-ac012364f6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:33:16.875698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 734/1480] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:33:16.919535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644726ce-3b45-4c85-a837-2a25c4a1f44a None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:33:16.933793 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644726ce-3b45-4c85-a837-2a25c4a1f44a None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:33:16.939112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8aeb9b-66ba-4041-8e4e-030c8c94bdf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:33:16.939765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aeb9b-66ba-4041-8e4e-030c8c94bdf5 service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:33:16.940048 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aeb9b-66ba-4041-8e4e-030c8c94bdf5 service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:33:16.940324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aeb9b-66ba-4041-8e4e-030c8c94bdf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:33:16.948795 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8aeb9b-66ba-4041-8e4e-030c8c94bdf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:33:16.950357 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8aeb9b-66ba-4041-8e4e-030c8c94bdf5 service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:33:16.960098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 747/1481] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:33:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:33:19.333220 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ace6e-39c0-45ec-b6fb-2d8f27356f24 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:33:19.333729 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ace6e-39c0-45ec-b6fb-2d8f27356f24 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:33:19.333729 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ace6e-39c0-45ec-b6fb-2d8f27356f24 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:33:19.335137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 735/1482] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:33:19.340477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f015dc-bff5-4360-9efb-5a952a643c1d None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:33:19.340917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f015dc-bff5-4360-9efb-5a952a643c1d None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:33:19.341137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f015dc-bff5-4360-9efb-5a952a643c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:33:19.359165 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-c6f015dc-bff5-4360-9efb-5a952a643c1d None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:33:19.360370 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-c6f015dc-bff5-4360-9efb-5a952a643c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:33:19.368595 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 748/1483] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:33:19.402947 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ace6e-39c0-45ec-b6fb-2d8f27356f24 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:33:19.413919 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ace6e-39c0-45ec-b6fb-2d8f27356f24 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:33:19.417425 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392e432-ff9e-4009-ba26-b9637e1f3ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:33:19.418053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392e432-ff9e-4009-ba26-b9637e1f3ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:33:19.418337 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392e432-ff9e-4009-ba26-b9637e1f3ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:33:19.418612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392e432-ff9e-4009-ba26-b9637e1f3ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:33:19.427295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392e432-ff9e-4009-ba26-b9637e1f3ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:33:19.429351 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392e432-ff9e-4009-ba26-b9637e1f3ae7 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:33:19.438487 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 736/1484] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:33:21.667792 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f3ac7-d906-4a23-b3d3-1fbd3c9293a3 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:33:21.668329 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f3ac7-d906-4a23-b3d3-1fbd3c9293a3 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:33:21.668445 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f3ac7-d906-4a23-b3d3-1fbd3c9293a3 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:33:21.669750 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 749/1485] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:33:21.675162 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac9a1e-7628-4c5e-be4e-e7a6207a3e86 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:33:21.675590 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac9a1e-7628-4c5e-be4e-e7a6207a3e86 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:33:21.675749 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac9a1e-7628-4c5e-be4e-e7a6207a3e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:33:21.693879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-79ac9a1e-7628-4c5e-be4e-e7a6207a3e86 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:33:21.695074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-79ac9a1e-7628-4c5e-be4e-e7a6207a3e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:33:21.702777 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 737/1486] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:33:21.739912 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f3ac7-d906-4a23-b3d3-1fbd3c9293a3 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:33:21.750652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f3ac7-d906-4a23-b3d3-1fbd3c9293a3 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:33:21.754198 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4548385-7b44-435a-b90c-6a426b6744d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:33:21.754833 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4548385-7b44-435a-b90c-6a426b6744d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:33:21.755121 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4548385-7b44-435a-b90c-6a426b6744d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:33:21.755436 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4548385-7b44-435a-b90c-6a426b6744d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:33:21.764826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4548385-7b44-435a-b90c-6a426b6744d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:33:21.766262 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4548385-7b44-435a-b90c-6a426b6744d7 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:33:21.776233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 750/1487] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:33:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:33:24.065054 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b1202-7e58-453d-9b55-2e856f03669d None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:33:24.065502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b1202-7e58-453d-9b55-2e856f03669d None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:33:24.065618 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b1202-7e58-453d-9b55-2e856f03669d None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:33:24.066991 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 738/1488] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:33:24.072295 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39641854-2d37-415c-8642-7a4ea4afa6ec None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:33:24.072705 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39641854-2d37-415c-8642-7a4ea4afa6ec None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:33:24.072870 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39641854-2d37-415c-8642-7a4ea4afa6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:33:24.091106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-39641854-2d37-415c-8642-7a4ea4afa6ec None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:33:24.092343 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-39641854-2d37-415c-8642-7a4ea4afa6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:33:24.100510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 751/1489] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:33:24.140144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b1202-7e58-453d-9b55-2e856f03669d None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:33:24.150650 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b1202-7e58-453d-9b55-2e856f03669d None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:33:24.154107 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4450c-1bd5-4cc1-b611-c8701eda5fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:33:24.154738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4450c-1bd5-4cc1-b611-c8701eda5fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:33:24.155027 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4450c-1bd5-4cc1-b611-c8701eda5fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:33:24.155326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4450c-1bd5-4cc1-b611-c8701eda5fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:33:24.164136 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4450c-1bd5-4cc1-b611-c8701eda5fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:33:24.165595 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4450c-1bd5-4cc1-b611-c8701eda5fc4 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:33:24.175261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 739/1490] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:33:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:33:26.612497 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478e836-df38-4a8d-9c9d-fda734d03d0c None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:33:26.613118 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478e836-df38-4a8d-9c9d-fda734d03d0c None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:33:26.613118 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478e836-df38-4a8d-9c9d-fda734d03d0c None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:33:26.614524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 752/1491] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 09:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:33:26.620321 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a528f-97fb-4241-a277-f54c620f6117 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:33:26.620773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a528f-97fb-4241-a277-f54c620f6117 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:33:26.620913 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a528f-97fb-4241-a277-f54c620f6117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:33:26.639136 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-f24a528f-97fb-4241-a277-f54c620f6117 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:33:26.640377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f24a528f-97fb-4241-a277-f54c620f6117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:33:26.648267 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 740/1492] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 09:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:33:26.686503 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478e836-df38-4a8d-9c9d-fda734d03d0c None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:33:26.697677 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478e836-df38-4a8d-9c9d-fda734d03d0c None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:33:26.701610 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8a7f6-10de-46a3-b70a-c61faaa51487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:33:26.702240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8a7f6-10de-46a3-b70a-c61faaa51487 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:33:26.702523 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8a7f6-10de-46a3-b70a-c61faaa51487 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:33:26.702800 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8a7f6-10de-46a3-b70a-c61faaa51487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:33:26.711953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8a7f6-10de-46a3-b70a-c61faaa51487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:33:26.713448 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8a7f6-10de-46a3-b70a-c61faaa51487 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:33:26.722703 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 753/1493] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:33:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:33:36.633900 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=33 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:33:36.718583 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=33 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:35:06.478525 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f05bd9-5faf-4b45-afe5-7203ce10a56e None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:06.479110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f05bd9-5faf-4b45-afe5-7203ce10a56e None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:06.479110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f05bd9-5faf-4b45-afe5-7203ce10a56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:06.496501 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-23f05bd9-5faf-4b45-afe5-7203ce10a56e None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:35:06.497670 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-23f05bd9-5faf-4b45-afe5-7203ce10a56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:35:06.505789 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 741/1494] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:35:06.514639 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a4622-68f4-48ad-ad6b-0ee153c1466b None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:06.515127 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a4622-68f4-48ad-ad6b-0ee153c1466b None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:06.515231 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a4622-68f4-48ad-ad6b-0ee153c1466b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:06.533170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-f91a4622-68f4-48ad-ad6b-0ee153c1466b None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:35:06.534383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f91a4622-68f4-48ad-ad6b-0ee153c1466b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:35:06.542270 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 754/1495] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:35:06.546461 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f05bd9-5faf-4b45-afe5-7203ce10a56e None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:35:06.555860 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f05bd9-5faf-4b45-afe5-7203ce10a56e None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:35:06.560285 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13153d-1d07-4f64-9d56-7d6b20f7b4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:35:06.560921 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13153d-1d07-4f64-9d56-7d6b20f7b4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:06.561203 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13153d-1d07-4f64-9d56-7d6b20f7b4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:06.561475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13153d-1d07-4f64-9d56-7d6b20f7b4a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:06.562183 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13153d-1d07-4f64-9d56-7d6b20f7b4a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:35:06.562488 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13153d-1d07-4f64-9d56-7d6b20f7b4a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:35:06.563542 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: WARNING py.warnings [None req-2f13153d-1d07-4f64-9d56-7d6b20f7b4a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:35:06.563542 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: warnings.warn(msg) May 27 09:35:06.563542 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: May 27 09:35:06.564418 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13153d-1d07-4f64-9d56-7d6b20f7b4a7 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:35:06.576132 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 742/1496] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:35:06.584568 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a4622-68f4-48ad-ad6b-0ee153c1466b None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:35:06.593451 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a4622-68f4-48ad-ad6b-0ee153c1466b None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:35:06.597976 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11284c48-1b0a-48a7-b2f3-5d4288ff97e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:35:06.598560 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11284c48-1b0a-48a7-b2f3-5d4288ff97e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:06.598838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11284c48-1b0a-48a7-b2f3-5d4288ff97e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:06.599108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11284c48-1b0a-48a7-b2f3-5d4288ff97e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:06.599829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11284c48-1b0a-48a7-b2f3-5d4288ff97e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:35:06.601604 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: WARNING py.warnings [None req-11284c48-1b0a-48a7-b2f3-5d4288ff97e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:35:06.601604 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: warnings.warn(msg) May 27 09:35:06.601604 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: May 27 09:35:06.603491 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11284c48-1b0a-48a7-b2f3-5d4288ff97e9 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:35:06.639324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 755/1497] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:35:06 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:35:06.643575 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13153d-1d07-4f64-9d56-7d6b20f7b4a7 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:35:06.653818 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13153d-1d07-4f64-9d56-7d6b20f7b4a7 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:35:06.709061 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8886c-ef1e-47fd-9c70-616f8b9776b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:35:06.709728 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8886c-ef1e-47fd-9c70-616f8b9776b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:06.710349 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8886c-ef1e-47fd-9c70-616f8b9776b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:06.710631 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8886c-ef1e-47fd-9c70-616f8b9776b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:06.711396 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8886c-ef1e-47fd-9c70-616f8b9776b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:35:06.712395 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: WARNING py.warnings [None req-97c8886c-ef1e-47fd-9c70-616f8b9776b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:35:06.712395 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: warnings.warn(msg) May 27 09:35:06.712395 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: May 27 09:35:06.713608 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8886c-ef1e-47fd-9c70-616f8b9776b2 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:35:06.732976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 743/1498] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:35:06 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:35:06.737117 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11284c48-1b0a-48a7-b2f3-5d4288ff97e9 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:35:06.747374 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11284c48-1b0a-48a7-b2f3-5d4288ff97e9 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:35:06.751874 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255118a-7d31-498f-99e7-5f4f82e17918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:35:06.752535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255118a-7d31-498f-99e7-5f4f82e17918 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:06.752822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255118a-7d31-498f-99e7-5f4f82e17918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:06.753600 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255118a-7d31-498f-99e7-5f4f82e17918 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:06.754319 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e255118a-7d31-498f-99e7-5f4f82e17918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:35:06.755362 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: WARNING py.warnings [None req-e255118a-7d31-498f-99e7-5f4f82e17918 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:35:06.755362 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: warnings.warn(msg) May 27 09:35:06.755362 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: May 27 09:35:06.756285 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e255118a-7d31-498f-99e7-5f4f82e17918 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:35:06.769427 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 756/1499] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:35:06.773991 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8886c-ef1e-47fd-9c70-616f8b9776b2 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:35:06.783800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8886c-ef1e-47fd-9c70-616f8b9776b2 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:35:06.788438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20214ced-5fd7-4e99-b707-eef4d015f146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:35:06.789093 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20214ced-5fd7-4e99-b707-eef4d015f146 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:06.789377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20214ced-5fd7-4e99-b707-eef4d015f146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:06.789652 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20214ced-5fd7-4e99-b707-eef4d015f146 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:06.790370 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20214ced-5fd7-4e99-b707-eef4d015f146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:35:06.791393 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: WARNING py.warnings [None req-20214ced-5fd7-4e99-b707-eef4d015f146 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:35:06.791393 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: warnings.warn(msg) May 27 09:35:06.791393 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: May 27 09:35:06.792293 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20214ced-5fd7-4e99-b707-eef4d015f146 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:35:06.805809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 744/1500] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:35:06.809954 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255118a-7d31-498f-99e7-5f4f82e17918 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:35:06.821291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255118a-7d31-498f-99e7-5f4f82e17918 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:35:06.825839 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b8e95-8f66-4a25-b899-58ba38f3827a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:35:06.826720 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b8e95-8f66-4a25-b899-58ba38f3827a admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:06.827005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b8e95-8f66-4a25-b899-58ba38f3827a admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:06.827297 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b8e95-8f66-4a25-b899-58ba38f3827a admin admin] PATH_INFO: `/v3/projects/76a1b7bc9fac47c2a300a424b6734bb5/users/f7693f6c35c64c67840d64a4e5bd3961/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:06.843134 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b8e95-8f66-4a25-b899-58ba38f3827a admin admin] RBAC: Authorizing `identity:create_grant(project_id=76a1b7bc9fac47c2a300a424b6734bb5, user_id=f7693f6c35c64c67840d64a4e5bd3961, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:35:06.844199 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: WARNING py.warnings [None req-9a2b8e95-8f66-4a25-b899-58ba38f3827a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:35:06.844199 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: warnings.warn(msg) May 27 09:35:06.844199 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: May 27 09:35:06.846170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b8e95-8f66-4a25-b899-58ba38f3827a admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:35:06.858866 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 757/1501] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:35:06 2022] PUT /identity/v3/projects/76a1b7bc9fac47c2a300a424b6734bb5/users/f7693f6c35c64c67840d64a4e5bd3961/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:35:06.870640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981ca98-a63f-4c56-858f-c086b25b0e05 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:06.870930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981ca98-a63f-4c56-858f-c086b25b0e05 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:06.871228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981ca98-a63f-4c56-858f-c086b25b0e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:06.898451 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-4981ca98-a63f-4c56-858f-c086b25b0e05 None None] MFA Rules not processed for user `f7693f6c35c64c67840d64a4e5bd3961`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:35:06.900325 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-4981ca98-a63f-4c56-858f-c086b25b0e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:35:06.961966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 745/1502] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:35:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:35:06.975659 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03c255-e9a6-404b-adf7-fd601db72739 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:06.975950 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03c255-e9a6-404b-adf7-fd601db72739 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:06.976232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03c255-e9a6-404b-adf7-fd601db72739 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:06.977825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 758/1503] 10.222.0.41 () {54 vars in 963 bytes} [Fri May 27 09:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:35:06.982641 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e181408-89e4-4c8f-9747-7729f274f152 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:06.982937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e181408-89e4-4c8f-9747-7729f274f152 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:06.983222 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e181408-89e4-4c8f-9747-7729f274f152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:07.001135 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-2e181408-89e4-4c8f-9747-7729f274f152 None None] MFA Rules not processed for user `192c3d179fdb43c9885f637446c83a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:35:07.002340 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-2e181408-89e4-4c8f-9747-7729f274f152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:35:07.046404 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:35:07.055227 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 746/1504] 10.222.0.41 () {58 vars in 1060 bytes} [Fri May 27 09:35:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:35:07.165294 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03c255-e9a6-404b-adf7-fd601db72739 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:35:07.176274 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03c255-e9a6-404b-adf7-fd601db72739 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:35:07.179724 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fc680-7a3c-4228-9c65-331c5c6bc1a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:35:07.180346 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fc680-7a3c-4228-9c65-331c5c6bc1a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:07.180627 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fc680-7a3c-4228-9c65-331c5c6bc1a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:07.180900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fc680-7a3c-4228-9c65-331c5c6bc1a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:07.188881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fc680-7a3c-4228-9c65-331c5c6bc1a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:35:07.190327 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fc680-7a3c-4228-9c65-331c5c6bc1a9 service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:35:07.199473 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 759/1505] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:35:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:35:07.241354 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c888dc3-f363-419d-aed3-1c67de152aa3 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:07.241665 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c888dc3-f363-419d-aed3-1c67de152aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:07.241927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c888dc3-f363-419d-aed3-1c67de152aa3 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:07.243223 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 747/1506] 10.222.0.41 () {52 vars in 829 bytes} [Fri May 27 09:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:35:07.246884 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fc680-7a3c-4228-9c65-331c5c6bc1a9 service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:35:07.307076 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fc680-7a3c-4228-9c65-331c5c6bc1a9 service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:35:07.311502 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ac2d1-e9fa-4023-b428-478731f413f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:35:07.312349 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ac2d1-e9fa-4023-b428-478731f413f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:07.312631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ac2d1-e9fa-4023-b428-478731f413f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:07.312904 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ac2d1-e9fa-4023-b428-478731f413f0 admin admin] PATH_INFO: `/v3/users/f7693f6c35c64c67840d64a4e5bd3961` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:07.314093 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ac2d1-e9fa-4023-b428-478731f413f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7693f6c35c64c67840d64a4e5bd3961)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:35:07.315121 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: WARNING py.warnings [None req-538ac2d1-e9fa-4023-b428-478731f413f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:35:07.315121 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: warnings.warn(msg) May 27 09:35:07.315121 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: May 27 09:35:07.316391 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ac2d1-e9fa-4023-b428-478731f413f0 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:35:07.381543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-538ac2d1-e9fa-4023-b428-478731f413f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7693f6c35c64c67840d64a4e5bd3961'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:35:07.382189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-538ac2d1-e9fa-4023-b428-478731f413f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7693f6c35c64c67840d64a4e5bd3961'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:35:07.394530 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-538ac2d1-e9fa-4023-b428-478731f413f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7693f6c35c64c67840d64a4e5bd3961'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:35:07.395320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-538ac2d1-e9fa-4023-b428-478731f413f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7693f6c35c64c67840d64a4e5bd3961'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:35:07.413514 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-538ac2d1-e9fa-4023-b428-478731f413f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7693f6c35c64c67840d64a4e5bd3961'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:35:07.417636 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:35:07.431712 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 760/1507] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:35:07 2022] DELETE /identity/v3/users/f7693f6c35c64c67840d64a4e5bd3961 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:35:07.436608 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496e6ca-3944-433c-9c15-aec66c2a1f87 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:07.436899 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496e6ca-3944-433c-9c15-aec66c2a1f87 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:07.437178 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496e6ca-3944-433c-9c15-aec66c2a1f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:07.454144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-1496e6ca-3944-433c-9c15-aec66c2a1f87 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:35:07.455361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-1496e6ca-3944-433c-9c15-aec66c2a1f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:35:07.512777 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 748/1508] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:35:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:35:07.522046 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ac2d1-e9fa-4023-b428-478731f413f0 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:35:07.523485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-538ac2d1-e9fa-4023-b428-478731f413f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:35:07.579261 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ac2d1-e9fa-4023-b428-478731f413f0 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:35:07.583375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5fc40-fc54-4d22-871c-0ea1e971f484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:35:07.584021 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5fc40-fc54-4d22-871c-0ea1e971f484 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:07.584308 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5fc40-fc54-4d22-871c-0ea1e971f484 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:07.584589 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5fc40-fc54-4d22-871c-0ea1e971f484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:07.593339 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5fc40-fc54-4d22-871c-0ea1e971f484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:35:07.594773 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5fc40-fc54-4d22-871c-0ea1e971f484 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:35:07.604860 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 761/1509] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:35:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:35:07.919470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496e6ca-3944-433c-9c15-aec66c2a1f87 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:35:07.920873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-1496e6ca-3944-433c-9c15-aec66c2a1f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:35:07.933347 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496e6ca-3944-433c-9c15-aec66c2a1f87 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:35:07.937997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1f7db-60e3-478f-98b8-251bd14a7cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:35:07.938881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1f7db-60e3-478f-98b8-251bd14a7cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:35:07.939158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1f7db-60e3-478f-98b8-251bd14a7cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:35:07.939639 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1f7db-60e3-478f-98b8-251bd14a7cbd admin admin] PATH_INFO: `/v3/projects/76a1b7bc9fac47c2a300a424b6734bb5` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:35:07.941454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1f7db-60e3-478f-98b8-251bd14a7cbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=76a1b7bc9fac47c2a300a424b6734bb5)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:35:07.942421 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: WARNING py.warnings [None req-5ba1f7db-60e3-478f-98b8-251bd14a7cbd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:35:07.942421 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: warnings.warn(msg) May 27 09:35:07.942421 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: May 27 09:35:07.943657 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1f7db-60e3-478f-98b8-251bd14a7cbd admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:35:08.004446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-5ba1f7db-60e3-478f-98b8-251bd14a7cbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76a1b7bc9fac47c2a300a424b6734bb5', 'request_id': 'req-5ba1f7db-60e3-478f-98b8-251bd14a7cbd'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:35:08.013550 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-5ba1f7db-60e3-478f-98b8-251bd14a7cbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76a1b7bc9fac47c2a300a424b6734bb5', 'request_id': 'req-5ba1f7db-60e3-478f-98b8-251bd14a7cbd'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:35:08.026650 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-5ba1f7db-60e3-478f-98b8-251bd14a7cbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76a1b7bc9fac47c2a300a424b6734bb5', 'request_id': 'req-5ba1f7db-60e3-478f-98b8-251bd14a7cbd'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:35:08.038159 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-5ba1f7db-60e3-478f-98b8-251bd14a7cbd admin admin] The token cache is being invalidate because project 76a1b7bc9fac47c2a300a424b6734bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:35:08.038440 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-5ba1f7db-60e3-478f-98b8-251bd14a7cbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:35:08.039198 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-5ba1f7db-60e3-478f-98b8-251bd14a7cbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:35:08.040816 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 749/1510] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:35:07 2022] DELETE /identity/v3/projects/76a1b7bc9fac47c2a300a424b6734bb5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:35:17.600652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:35:18.035291 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:46.169700 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff802ab-1d1c-49a7-86bb-799110d3e77c None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.170285 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff802ab-1d1c-49a7-86bb-799110d3e77c None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.170285 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff802ab-1d1c-49a7-86bb-799110d3e77c None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.171657 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:36:46.176972 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d10d6-f589-4ba7-abc4-8092ad4c11d3 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.177417 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d10d6-f589-4ba7-abc4-8092ad4c11d3 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.177550 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d10d6-f589-4ba7-abc4-8092ad4c11d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.196000 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-014d10d6-f589-4ba7-abc4-8092ad4c11d3 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:46.197213 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-014d10d6-f589-4ba7-abc4-8092ad4c11d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:46.254310 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:46.437468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff802ab-1d1c-49a7-86bb-799110d3e77c None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:46.439289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-1ff802ab-1d1c-49a7-86bb-799110d3e77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:46.512176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff802ab-1d1c-49a7-86bb-799110d3e77c None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:46.517543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c55be-1fbe-4db1-965a-554d40a99c8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:46.518169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c55be-1fbe-4db1-965a-554d40a99c8c service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:46.518456 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c55be-1fbe-4db1-965a-554d40a99c8c service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:46.518739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c55be-1fbe-4db1-965a-554d40a99c8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:46.526724 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c55be-1fbe-4db1-965a-554d40a99c8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:46.528355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c55be-1fbe-4db1-965a-554d40a99c8c service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:46.538094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 763/1513] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:36:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:36:47.409571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae90298-31e8-4e94-b421-d537daf358b4 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:47.410116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae90298-31e8-4e94-b421-d537daf358b4 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:47.410116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae90298-31e8-4e94-b421-d537daf358b4 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:47.411477 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:36:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:36:47.416147 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018aa7e4-4e10-496a-836b-e8905a3fc68a None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:47.416535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018aa7e4-4e10-496a-836b-e8905a3fc68a None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:47.416714 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018aa7e4-4e10-496a-836b-e8905a3fc68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:47.434324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-018aa7e4-4e10-496a-836b-e8905a3fc68a None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:47.435550 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-018aa7e4-4e10-496a-836b-e8905a3fc68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:47.443156 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:47.591422 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae90298-31e8-4e94-b421-d537daf358b4 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:47.606291 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae90298-31e8-4e94-b421-d537daf358b4 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:47.612183 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ae2d3-c5c3-47e6-a688-815da35c246b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:47.612813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ae2d3-c5c3-47e6-a688-815da35c246b service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:47.613097 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ae2d3-c5c3-47e6-a688-815da35c246b service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:47.613373 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ae2d3-c5c3-47e6-a688-815da35c246b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:47.621325 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ae2d3-c5c3-47e6-a688-815da35c246b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:47.622912 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ae2d3-c5c3-47e6-a688-815da35c246b service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:47.632684 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 752/1516] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:36:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:36:47.778625 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192fdc7-2806-4739-8d23-f4cd95c57160 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:47.778944 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192fdc7-2806-4739-8d23-f4cd95c57160 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:47.779249 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192fdc7-2806-4739-8d23-f4cd95c57160 None None] PATH_INFO: `/v3` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:47.780583 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 765/1517] 10.222.0.65 () {54 vars in 925 bytes} [Fri May 27 09:36:47 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:36:47.787042 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69066745-0c63-4f98-a0d2-225f93b03415 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:47.787442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69066745-0c63-4f98-a0d2-225f93b03415 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:47.787746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69066745-0c63-4f98-a0d2-225f93b03415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:47.806353 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-69066745-0c63-4f98-a0d2-225f93b03415 None None] MFA Rules not processed for user `746fd8ed517446fe89c53df873abb2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:47.807578 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-69066745-0c63-4f98-a0d2-225f93b03415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:47.869348 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 753/1518] 10.222.0.65 () {58 vars in 1015 bytes} [Fri May 27 09:36:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:57.178940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65fe7b-c026-4f62-946a-f575686107ec None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:57.179506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65fe7b-c026-4f62-946a-f575686107ec None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:57.179506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65fe7b-c026-4f62-946a-f575686107ec None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:57.180825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 766/1519] 10.222.0.41 () {54 vars in 960 bytes} [Fri May 27 09:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:36:57.185678 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffe759-a72c-439d-b1f4-3e9c87c92aa0 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:57.186059 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffe759-a72c-439d-b1f4-3e9c87c92aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:57.186245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffe759-a72c-439d-b1f4-3e9c87c92aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:57.204848 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-87ffe759-a72c-439d-b1f4-3e9c87c92aa0 None None] MFA Rules not processed for user `746fd8ed517446fe89c53df873abb2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:57.206040 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-87ffe759-a72c-439d-b1f4-3e9c87c92aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:57.214398 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 754/1520] 10.222.0.41 () {58 vars in 1057 bytes} [Fri May 27 09:36:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:57.221650 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65fe7b-c026-4f62-946a-f575686107ec None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:57.234941 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65fe7b-c026-4f62-946a-f575686107ec None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:57.240477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bae78a-dc9f-46da-a823-3370744d4411 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746fd8ed517446fe89c53df873abb2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:57.241106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bae78a-dc9f-46da-a823-3370744d4411 service placement] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:57.241389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bae78a-dc9f-46da-a823-3370744d4411 service placement] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:57.241701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bae78a-dc9f-46da-a823-3370744d4411 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:57.249884 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bae78a-dc9f-46da-a823-3370744d4411 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:57.252126 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bae78a-dc9f-46da-a823-3370744d4411 service placement] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:57.261494 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 767/1521] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:36:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:36:58.906998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1f27f-73f7-4ea7-8efd-1f0559c715fe None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:58.907578 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1f27f-73f7-4ea7-8efd-1f0559c715fe None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:58.907578 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1f27f-73f7-4ea7-8efd-1f0559c715fe None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:58.909502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:36:58.914176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94c842-c4ac-4024-aa7f-a0b37e976523 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:58.914618 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94c842-c4ac-4024-aa7f-a0b37e976523 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:58.914724 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94c842-c4ac-4024-aa7f-a0b37e976523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:58.932624 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-8c94c842-c4ac-4024-aa7f-a0b37e976523 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:36:58.933826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-8c94c842-c4ac-4024-aa7f-a0b37e976523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:36:58.942050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:36:59.092424 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1f27f-73f7-4ea7-8efd-1f0559c715fe None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:36:59.106839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1f27f-73f7-4ea7-8efd-1f0559c715fe None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:36:59.112209 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e015a6-d557-4d56-acd1-e5238d28e3b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:36:59.112844 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e015a6-d557-4d56-acd1-e5238d28e3b5 service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:59.113129 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e015a6-d557-4d56-acd1-e5238d28e3b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:59.113410 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e015a6-d557-4d56-acd1-e5238d28e3b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:59.121338 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e015a6-d557-4d56-acd1-e5238d28e3b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:36:59.122926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e015a6-d557-4d56-acd1-e5238d28e3b5 service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:36:59.132653 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 756/1524] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:36:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:36:59.994601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a405279-581f-4bf7-9051-602851f41339 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:36:59.995252 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a405279-581f-4bf7-9051-602851f41339 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:36:59.995252 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a405279-581f-4bf7-9051-602851f41339 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:36:59.996556 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 09:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:37:00.001301 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0925d-6cef-4721-9646-627ccd9b1a64 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:00.001743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0925d-6cef-4721-9646-627ccd9b1a64 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:00.001897 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0925d-6cef-4721-9646-627ccd9b1a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:00.019559 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-e1c0925d-6cef-4721-9646-627ccd9b1a64 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:00.020755 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e1c0925d-6cef-4721-9646-627ccd9b1a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:00.028514 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 09:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:00.179078 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a405279-581f-4bf7-9051-602851f41339 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:00.193119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a405279-581f-4bf7-9051-602851f41339 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:00.198397 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654cfaa-ac90-49d2-8bbd-82cc39ce0937 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:00.199020 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654cfaa-ac90-49d2-8bbd-82cc39ce0937 service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:00.199341 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654cfaa-ac90-49d2-8bbd-82cc39ce0937 service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:00.199623 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654cfaa-ac90-49d2-8bbd-82cc39ce0937 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:00.208114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654cfaa-ac90-49d2-8bbd-82cc39ce0937 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:00.209713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654cfaa-ac90-49d2-8bbd-82cc39ce0937 service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:00.218991 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 770/1527] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:37:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:04.400456 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868c6b1-1a12-4394-81e5-e40839336e14 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:04.401077 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868c6b1-1a12-4394-81e5-e40839336e14 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:04.401077 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868c6b1-1a12-4394-81e5-e40839336e14 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:04.402449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:37:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:37:04.408123 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed9d78-c62c-4a41-bc16-b068ae34bcfd None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:04.408583 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed9d78-c62c-4a41-bc16-b068ae34bcfd None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:04.408684 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed9d78-c62c-4a41-bc16-b068ae34bcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:04.427373 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-45ed9d78-c62c-4a41-bc16-b068ae34bcfd None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:04.428558 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-45ed9d78-c62c-4a41-bc16-b068ae34bcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:04.436426 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:04.472723 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868c6b1-1a12-4394-81e5-e40839336e14 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:04.474386 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-2868c6b1-1a12-4394-81e5-e40839336e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:04.531658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868c6b1-1a12-4394-81e5-e40839336e14 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:04.535990 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827ff96-3206-45cc-a2f8-b06c983d10d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:04.536620 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827ff96-3206-45cc-a2f8-b06c983d10d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:04.536899 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827ff96-3206-45cc-a2f8-b06c983d10d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:04.537171 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827ff96-3206-45cc-a2f8-b06c983d10d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:04.545885 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827ff96-3206-45cc-a2f8-b06c983d10d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:04.547312 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827ff96-3206-45cc-a2f8-b06c983d10d9 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:04.552690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:04.557804 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 759/1530] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:37:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:06.735640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cc44d-4dfc-4931-849b-89f86d2ac75a None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:06.736166 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cc44d-4dfc-4931-849b-89f86d2ac75a None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:06.736166 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cc44d-4dfc-4931-849b-89f86d2ac75a None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:06.737488 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:37:06.743082 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90972cb-23be-41c6-8b41-5edf988199e9 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:06.743555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90972cb-23be-41c6-8b41-5edf988199e9 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:06.743840 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90972cb-23be-41c6-8b41-5edf988199e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:06.770212 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-d90972cb-23be-41c6-8b41-5edf988199e9 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:06.771498 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-d90972cb-23be-41c6-8b41-5edf988199e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:06.784870 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:06.822719 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cc44d-4dfc-4931-849b-89f86d2ac75a None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:06.824965 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-b87cc44d-4dfc-4931-849b-89f86d2ac75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:06.839957 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cc44d-4dfc-4931-849b-89f86d2ac75a None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:06.843500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1259c-f5d5-43ee-bb6d-53a85a410a8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:06.844144 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1259c-f5d5-43ee-bb6d-53a85a410a8d service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:06.844431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1259c-f5d5-43ee-bb6d-53a85a410a8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:06.844709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1259c-f5d5-43ee-bb6d-53a85a410a8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:06.853941 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1259c-f5d5-43ee-bb6d-53a85a410a8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:06.855424 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1259c-f5d5-43ee-bb6d-53a85a410a8d service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:06.864781 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 773/1533] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:10.578459 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a37a6-7254-4751-b1b3-f03e62fc3ee7 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:10.579015 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a37a6-7254-4751-b1b3-f03e62fc3ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:10.579124 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a37a6-7254-4751-b1b3-f03e62fc3ee7 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:10.580487 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:37:10.585671 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa0d4d-9e67-4d12-a241-97d49d287c7f None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:10.586092 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa0d4d-9e67-4d12-a241-97d49d287c7f None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:10.586252 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa0d4d-9e67-4d12-a241-97d49d287c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:10.592548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=62 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:10.607826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-a3fa0d4d-9e67-4d12-a241-97d49d287c7f None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:10.609009 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-a3fa0d4d-9e67-4d12-a241-97d49d287c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:10.617317 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:10.884229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a37a6-7254-4751-b1b3-f03e62fc3ee7 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:10.885882 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-5e0a37a6-7254-4751-b1b3-f03e62fc3ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:10.942793 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a37a6-7254-4751-b1b3-f03e62fc3ee7 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:10.946260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17646044-a857-45b8-810e-5c3abfad4b10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:10.946895 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17646044-a857-45b8-810e-5c3abfad4b10 service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:10.947176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17646044-a857-45b8-810e-5c3abfad4b10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:10.947480 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17646044-a857-45b8-810e-5c3abfad4b10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:10.956755 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17646044-a857-45b8-810e-5c3abfad4b10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:10.958153 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17646044-a857-45b8-810e-5c3abfad4b10 service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:10.967293 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 762/1536] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:37:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:13.185397 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134793b-17a2-4640-b0d5-562517e04171 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:13.185925 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134793b-17a2-4640-b0d5-562517e04171 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:13.186032 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134793b-17a2-4640-b0d5-562517e04171 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:13.187395 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 09:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:37:13.192641 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0e943-0475-439f-a553-4ea34a7f16ed None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:13.193122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0e943-0475-439f-a553-4ea34a7f16ed None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:13.193250 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0e943-0475-439f-a553-4ea34a7f16ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:13.211394 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-0ce0e943-0475-439f-a553-4ea34a7f16ed None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:37:13.212582 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-0ce0e943-0475-439f-a553-4ea34a7f16ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:13.220427 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 09:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:37:13.496764 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134793b-17a2-4640-b0d5-562517e04171 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:37:13.498451 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-6134793b-17a2-4640-b0d5-562517e04171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:37:13.511259 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134793b-17a2-4640-b0d5-562517e04171 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:37:13.514736 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba63cae-2f3a-4908-ae1a-c4a3d47890f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:37:13.515401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba63cae-2f3a-4908-ae1a-c4a3d47890f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:37:13.515687 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba63cae-2f3a-4908-ae1a-c4a3d47890f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:37:13.515961 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba63cae-2f3a-4908-ae1a-c4a3d47890f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:37:13.525228 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba63cae-2f3a-4908-ae1a-c4a3d47890f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:37:13.526655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba63cae-2f3a-4908-ae1a-c4a3d47890f0 service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:37:13.536532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 776/1539] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:37:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:37:23.205673 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=32 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:23.531829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=8 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:45.729911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1a403-7973-487c-8ada-8696056c3fad None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:45.730963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1a403-7973-487c-8ada-8696056c3fad None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:45.731510 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1a403-7973-487c-8ada-8696056c3fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:45.762901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-87a1a403-7973-487c-8ada-8696056c3fad None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:45.764146 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-87a1a403-7973-487c-8ada-8696056c3fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:45.778649 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 764/1540] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:45.784092 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fe439-6d16-4f75-8a9b-252a8b5dddfd None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:45.784662 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fe439-6d16-4f75-8a9b-252a8b5dddfd None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:45.784662 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fe439-6d16-4f75-8a9b-252a8b5dddfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:45.812404 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-f48fe439-6d16-4f75-8a9b-252a8b5dddfd None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:45.813597 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f48fe439-6d16-4f75-8a9b-252a8b5dddfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:45.829612 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 777/1541] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:45.835302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1a403-7973-487c-8ada-8696056c3fad None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:45.845632 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1a403-7973-487c-8ada-8696056c3fad None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:45.854832 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda981f-16f3-41e4-af3a-6ada9e29d4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:45.855540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda981f-16f3-41e4-af3a-6ada9e29d4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:45.855830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda981f-16f3-41e4-af3a-6ada9e29d4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:45.856109 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda981f-16f3-41e4-af3a-6ada9e29d4f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:45.856838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda981f-16f3-41e4-af3a-6ada9e29d4f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:45.857149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda981f-16f3-41e4-af3a-6ada9e29d4f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:45.858784 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda981f-16f3-41e4-af3a-6ada9e29d4f2 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:45.876999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 765/1542] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:38:45.886270 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fe439-6d16-4f75-8a9b-252a8b5dddfd None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:45.900533 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fe439-6d16-4f75-8a9b-252a8b5dddfd None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:45.912148 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee9cca-9f4f-4215-826b-d156c8a00933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:45.912148 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee9cca-9f4f-4215-826b-d156c8a00933 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:45.913392 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee9cca-9f4f-4215-826b-d156c8a00933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:45.914305 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee9cca-9f4f-4215-826b-d156c8a00933 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:45.914305 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee9cca-9f4f-4215-826b-d156c8a00933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:45.916583 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee9cca-9f4f-4215-826b-d156c8a00933 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:45.960148 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 778/1543] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:38:45 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:45.964839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda981f-16f3-41e4-af3a-6ada9e29d4f2 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:45.979206 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda981f-16f3-41e4-af3a-6ada9e29d4f2 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:46.069781 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717d861-c97a-49e9-bae3-057b26713d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:46.070447 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717d861-c97a-49e9-bae3-057b26713d4b admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.070741 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717d861-c97a-49e9-bae3-057b26713d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.071015 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717d861-c97a-49e9-bae3-057b26713d4b admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.074309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717d861-c97a-49e9-bae3-057b26713d4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:46.076300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717d861-c97a-49e9-bae3-057b26713d4b admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:46.110601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 766/1544] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:38:45 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:46.115387 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee9cca-9f4f-4215-826b-d156c8a00933 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:46.132796 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee9cca-9f4f-4215-826b-d156c8a00933 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:46.143980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d1b55-ee44-44ad-91f0-1c3c1ef3aba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:46.144670 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d1b55-ee44-44ad-91f0-1c3c1ef3aba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.144962 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d1b55-ee44-44ad-91f0-1c3c1ef3aba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.148921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d1b55-ee44-44ad-91f0-1c3c1ef3aba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.148921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d1b55-ee44-44ad-91f0-1c3c1ef3aba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:46.151660 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d1b55-ee44-44ad-91f0-1c3c1ef3aba3 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:46.163720 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 779/1545] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:46.168086 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717d861-c97a-49e9-bae3-057b26713d4b admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:46.179540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717d861-c97a-49e9-bae3-057b26713d4b admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:46.191855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfefd5-48d1-45d0-8df0-18d1e506cbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:46.192549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfefd5-48d1-45d0-8df0-18d1e506cbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.192849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfefd5-48d1-45d0-8df0-18d1e506cbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.193120 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfefd5-48d1-45d0-8df0-18d1e506cbf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.193857 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfefd5-48d1-45d0-8df0-18d1e506cbf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:46.199612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfefd5-48d1-45d0-8df0-18d1e506cbf2 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:46.213016 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 767/1546] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:46.217245 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d1b55-ee44-44ad-91f0-1c3c1ef3aba3 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:46.233518 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d1b55-ee44-44ad-91f0-1c3c1ef3aba3 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:46.243931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e416b06-0c43-403b-a258-672c1d02a67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:46.244876 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e416b06-0c43-403b-a258-672c1d02a67d admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.245154 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e416b06-0c43-403b-a258-672c1d02a67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.245429 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e416b06-0c43-403b-a258-672c1d02a67d admin admin] PATH_INFO: `/v3/projects/84ba4973a779495ab471f571b4fe1003/users/5e6748228e704e94a092ec7f6a50a21a/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.267922 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e416b06-0c43-403b-a258-672c1d02a67d admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ba4973a779495ab471f571b4fe1003, user_id=5e6748228e704e94a092ec7f6a50a21a, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:46.270773 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e416b06-0c43-403b-a258-672c1d02a67d admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:46.300503 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 780/1547] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:38:46 2022] PUT /identity/v3/projects/84ba4973a779495ab471f571b4fe1003/users/5e6748228e704e94a092ec7f6a50a21a/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:46.312940 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f4d65-56f8-452a-adb2-05f47a39ff06 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.313240 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f4d65-56f8-452a-adb2-05f47a39ff06 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.313516 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f4d65-56f8-452a-adb2-05f47a39ff06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.353181 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-986f4d65-56f8-452a-adb2-05f47a39ff06 None None] MFA Rules not processed for user `5e6748228e704e94a092ec7f6a50a21a`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:46.354526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-986f4d65-56f8-452a-adb2-05f47a39ff06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:46.461469 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 768/1548] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:38:46.493662 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557f846-5764-407d-a8cf-647b284a0da5 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.494038 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557f846-5764-407d-a8cf-647b284a0da5 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.494226 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557f846-5764-407d-a8cf-647b284a0da5 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.495605 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 781/1549] 10.222.0.41 () {54 vars in 961 bytes} [Fri May 27 09:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:38:46.507790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f612c1-2ba4-4bfc-b46b-c63fd49cae60 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.508156 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f612c1-2ba4-4bfc-b46b-c63fd49cae60 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.508341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f612c1-2ba4-4bfc-b46b-c63fd49cae60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.537971 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-81f612c1-2ba4-4bfc-b46b-c63fd49cae60 None None] MFA Rules not processed for user `d2b1c12e88c549208894fc0dd0c60b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:46.539184 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-81f612c1-2ba4-4bfc-b46b-c63fd49cae60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:46.574866 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ecb3e-eb9d-4267-9da1-c32dee89d40b None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.575230 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ecb3e-eb9d-4267-9da1-c32dee89d40b None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.575468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ecb3e-eb9d-4267-9da1-c32dee89d40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.612227 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:46.619173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-208ecb3e-eb9d-4267-9da1-c32dee89d40b None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:46.622216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-208ecb3e-eb9d-4267-9da1-c32dee89d40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:46.661175 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 769/1550] 10.222.0.41 () {58 vars in 1058 bytes} [Fri May 27 09:38:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:46.662599 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcdad3-520d-4e99-8911-e4cc78754a66 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.662891 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcdad3-520d-4e99-8911-e4cc78754a66 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.667341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcdad3-520d-4e99-8911-e4cc78754a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.698360 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-edfcdad3-520d-4e99-8911-e4cc78754a66 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:46.698712 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-edfcdad3-520d-4e99-8911-e4cc78754a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:46.734130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 782/1551] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:46.735652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ea363-76dd-45d7-830f-348c65facc4c None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.735949 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ea363-76dd-45d7-830f-348c65facc4c None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.736230 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ea363-76dd-45d7-830f-348c65facc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.775677 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-cc6ea363-76dd-45d7-830f-348c65facc4c None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:46.776928 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-cc6ea363-76dd-45d7-830f-348c65facc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:46.785029 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 783/1552] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:46.785825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ea363-76dd-45d7-830f-348c65facc4c None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:46.798717 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ea363-76dd-45d7-830f-348c65facc4c None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:46.804865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d5e4c-ce66-460a-b7d6-021971dc810c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:46.805515 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d5e4c-ce66-460a-b7d6-021971dc810c service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.805802 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d5e4c-ce66-460a-b7d6-021971dc810c service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.806082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d5e4c-ce66-460a-b7d6-021971dc810c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.810050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 770/1553] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:46.812371 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52568f2b-2c5d-4d29-9677-010f8767dfd0 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.812671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52568f2b-2c5d-4d29-9677-010f8767dfd0 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.812953 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52568f2b-2c5d-4d29-9677-010f8767dfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.814205 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d5e4c-ce66-460a-b7d6-021971dc810c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:46.816414 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d5e4c-ce66-460a-b7d6-021971dc810c service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:46.825940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 784/1554] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:38:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:46.827206 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54bad4-30be-4320-9bae-ba3ef105d0b4 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.827531 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54bad4-30be-4320-9bae-ba3ef105d0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.827808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54bad4-30be-4320-9bae-ba3ef105d0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.833503 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-52568f2b-2c5d-4d29-9677-010f8767dfd0 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:46.835711 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-52568f2b-2c5d-4d29-9677-010f8767dfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:46.852201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 771/1555] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:46.852201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032dbfe9-4d5f-4f8d-b016-73c03e839996 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.852201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032dbfe9-4d5f-4f8d-b016-73c03e839996 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.852201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032dbfe9-4d5f-4f8d-b016-73c03e839996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.853567 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-fd54bad4-30be-4320-9bae-ba3ef105d0b4 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:46.855201 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-fd54bad4-30be-4320-9bae-ba3ef105d0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:46.864082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 785/1556] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:46.865403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f317794-7746-4505-aab2-abb5d2dceb0f None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.865403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f317794-7746-4505-aab2-abb5d2dceb0f None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.865735 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f317794-7746-4505-aab2-abb5d2dceb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.874095 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-032dbfe9-4d5f-4f8d-b016-73c03e839996 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:46.875498 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-032dbfe9-4d5f-4f8d-b016-73c03e839996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:46.884587 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-4f317794-7746-4505-aab2-abb5d2dceb0f None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:46.885152 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 772/1557] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:46.893918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb11fc7-7c77-475c-98ff-1eb5318caee7 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.894057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-4f317794-7746-4505-aab2-abb5d2dceb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:46.894163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb11fc7-7c77-475c-98ff-1eb5318caee7 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.894163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb11fc7-7c77-475c-98ff-1eb5318caee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.903963 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 786/1558] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:46.905325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cab095-3ffa-4144-b457-34a6df0b5466 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.905554 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-fcb11fc7-7c77-475c-98ff-1eb5318caee7 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:46.905924 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cab095-3ffa-4144-b457-34a6df0b5466 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.906309 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cab095-3ffa-4144-b457-34a6df0b5466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.906744 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-fcb11fc7-7c77-475c-98ff-1eb5318caee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:46.915130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 773/1559] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:46.921166 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781169e0-15c4-47c8-a144-b4a415ff0320 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.921645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781169e0-15c4-47c8-a144-b4a415ff0320 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.922132 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781169e0-15c4-47c8-a144-b4a415ff0320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.927476 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-91cab095-3ffa-4144-b457-34a6df0b5466 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:46.928756 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-91cab095-3ffa-4144-b457-34a6df0b5466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:46.938314 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 787/1560] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:46.942883 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949fc10-eb14-4c5d-af02-e18469833257 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.942883 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949fc10-eb14-4c5d-af02-e18469833257 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.942883 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949fc10-eb14-4c5d-af02-e18469833257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.943433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-781169e0-15c4-47c8-a144-b4a415ff0320 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:46.944598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-781169e0-15c4-47c8-a144-b4a415ff0320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:46.953658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 774/1561] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:46.954812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781169e0-15c4-47c8-a144-b4a415ff0320 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:46.960872 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-b949fc10-eb14-4c5d-af02-e18469833257 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:46.962472 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-b949fc10-eb14-4c5d-af02-e18469833257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:46.966391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781169e0-15c4-47c8-a144-b4a415ff0320 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:46.970901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ead8eb-cf38-44b5-bae9-de2da25ffeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:46.971565 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ead8eb-cf38-44b5-bae9-de2da25ffeed admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.971873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ead8eb-cf38-44b5-bae9-de2da25ffeed admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.972153 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ead8eb-cf38-44b5-bae9-de2da25ffeed admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.972888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ead8eb-cf38-44b5-bae9-de2da25ffeed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:46.973190 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ead8eb-cf38-44b5-bae9-de2da25ffeed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:46.973331 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 788/1562] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:46.974920 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36e5c4-9fa6-438a-b30c-a6e475f7cef5 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.975047 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ead8eb-cf38-44b5-bae9-de2da25ffeed admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:46.975613 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36e5c4-9fa6-438a-b30c-a6e475f7cef5 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.976047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36e5c4-9fa6-438a-b30c-a6e475f7cef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.989529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 775/1563] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:38:46.992582 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38be9cf-5476-4f7e-bcba-80fb99a70883 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:46.992867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38be9cf-5476-4f7e-bcba-80fb99a70883 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:46.993146 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38be9cf-5476-4f7e-bcba-80fb99a70883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:46.998900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-af36e5c4-9fa6-438a-b30c-a6e475f7cef5 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:47.000344 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-af36e5c4-9fa6-438a-b30c-a6e475f7cef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:47.009210 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 789/1564] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:47.010566 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13bd24-78e5-4868-aba3-bc2801272c8b None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.010964 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13bd24-78e5-4868-aba3-bc2801272c8b None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.011411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13bd24-78e5-4868-aba3-bc2801272c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.017702 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-f38be9cf-5476-4f7e-bcba-80fb99a70883 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:47.019678 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f38be9cf-5476-4f7e-bcba-80fb99a70883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:47.026940 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 776/1565] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:47.027545 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38be9cf-5476-4f7e-bcba-80fb99a70883 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.034399 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-0d13bd24-78e5-4868-aba3-bc2801272c8b None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:47.034399 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-0d13bd24-78e5-4868-aba3-bc2801272c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:47.040427 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38be9cf-5476-4f7e-bcba-80fb99a70883 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.044492 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 790/1566] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:47.044492 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13bd24-78e5-4868-aba3-bc2801272c8b None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.050430 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7de58-360f-42d0-9fda-07ffa3ba7da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.051061 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7de58-360f-42d0-9fda-07ffa3ba7da3 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.051369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7de58-360f-42d0-9fda-07ffa3ba7da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.051643 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7de58-360f-42d0-9fda-07ffa3ba7da3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.052363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7de58-360f-42d0-9fda-07ffa3ba7da3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:47.052669 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7de58-360f-42d0-9fda-07ffa3ba7da3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.053281 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13bd24-78e5-4868-aba3-bc2801272c8b None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.054263 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7de58-360f-42d0-9fda-07ffa3ba7da3 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.058055 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bd5bc-5905-4a01-8cc7-5008b1300424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.058816 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bd5bc-5905-4a01-8cc7-5008b1300424 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.059221 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bd5bc-5905-4a01-8cc7-5008b1300424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.059639 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bd5bc-5905-4a01-8cc7-5008b1300424 admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.063627 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bd5bc-5905-4a01-8cc7-5008b1300424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:47.063627 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bd5bc-5905-4a01-8cc7-5008b1300424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.063627 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: WARNING py.warnings [None req-766bd5bc-5905-4a01-8cc7-5008b1300424 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:38:47.063627 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: warnings.warn(msg) May 27 09:38:47.063627 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: May 27 09:38:47.063627 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bd5bc-5905-4a01-8cc7-5008b1300424 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.070632 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 777/1567] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:38:47.075338 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7de58-360f-42d0-9fda-07ffa3ba7da3 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.081278 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 791/1568] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:38:47.082294 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bd5bc-5905-4a01-8cc7-5008b1300424 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.091832 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bd5bc-5905-4a01-8cc7-5008b1300424 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.092209 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7de58-360f-42d0-9fda-07ffa3ba7da3 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.096677 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b08ad-e015-4d45-821b-4e7e2137a583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.097257 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c195c-458e-4160-9764-826b043105e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.097572 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b08ad-e015-4d45-821b-4e7e2137a583 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.097928 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b08ad-e015-4d45-821b-4e7e2137a583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.098039 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c195c-458e-4160-9764-826b043105e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.098207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c195c-458e-4160-9764-826b043105e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.098338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b08ad-e015-4d45-821b-4e7e2137a583 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.098478 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c195c-458e-4160-9764-826b043105e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.099034 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b08ad-e015-4d45-821b-4e7e2137a583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.099482 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c195c-458e-4160-9764-826b043105e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:47.099849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c195c-458e-4160-9764-826b043105e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.101300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b08ad-e015-4d45-821b-4e7e2137a583 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.101406 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c195c-458e-4160-9764-826b043105e8 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.114386 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 778/1569] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:38:47.115120 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c195c-458e-4160-9764-826b043105e8 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.126252 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c195c-458e-4160-9764-826b043105e8 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.131976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba6e71-fd34-487a-bb41-b7f114fa50fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.133150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba6e71-fd34-487a-bb41-b7f114fa50fa admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.133622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba6e71-fd34-487a-bb41-b7f114fa50fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.133763 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 792/1570] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:38:47 2022] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:47.133899 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba6e71-fd34-487a-bb41-b7f114fa50fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.134638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba6e71-fd34-487a-bb41-b7f114fa50fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:47.134943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba6e71-fd34-487a-bb41-b7f114fa50fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.136203 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b08ad-e015-4d45-821b-4e7e2137a583 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.136550 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba6e71-fd34-487a-bb41-b7f114fa50fa admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.140814 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:47.149012 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 779/1571] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:38:47.149816 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba6e71-fd34-487a-bb41-b7f114fa50fa admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.159544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba6e71-fd34-487a-bb41-b7f114fa50fa admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.204356 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b08ad-e015-4d45-821b-4e7e2137a583 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.208921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe75bcf-f323-4470-b61f-811bf9ac821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.209574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe75bcf-f323-4470-b61f-811bf9ac821f admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.209853 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe75bcf-f323-4470-b61f-811bf9ac821f admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.210126 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe75bcf-f323-4470-b61f-811bf9ac821f admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.210580 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:47.210843 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe75bcf-f323-4470-b61f-811bf9ac821f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:47.211149 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe75bcf-f323-4470-b61f-811bf9ac821f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.213134 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe75bcf-f323-4470-b61f-811bf9ac821f admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.217843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68f05c-86bb-40da-9b6b-b19108a83784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.218505 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68f05c-86bb-40da-9b6b-b19108a83784 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.218788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68f05c-86bb-40da-9b6b-b19108a83784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.219063 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68f05c-86bb-40da-9b6b-b19108a83784 admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.219810 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68f05c-86bb-40da-9b6b-b19108a83784 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:47.220118 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68f05c-86bb-40da-9b6b-b19108a83784 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.221715 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68f05c-86bb-40da-9b6b-b19108a83784 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.225117 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 793/1572] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:38:47.226363 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed79de-13e6-4f0b-ba91-edc76ad18a5d None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.226651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed79de-13e6-4f0b-ba91-edc76ad18a5d None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.226927 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed79de-13e6-4f0b-ba91-edc76ad18a5d None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.228171 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 794/1573] 10.222.0.41 () {54 vars in 912 bytes} [Fri May 27 09:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:38:47.228845 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed79de-13e6-4f0b-ba91-edc76ad18a5d None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.239571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 780/1574] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:38:47.240725 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68f05c-86bb-40da-9b6b-b19108a83784 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.251588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68f05c-86bb-40da-9b6b-b19108a83784 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.253641 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed79de-13e6-4f0b-ba91-edc76ad18a5d None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.256710 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac2ff7-00ee-4810-8310-9f5b9b162bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.257472 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac2ff7-00ee-4810-8310-9f5b9b162bdd admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.258168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac2ff7-00ee-4810-8310-9f5b9b162bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.258289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e08b3-528b-4f5d-89d3-2c7f526aaf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.258478 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac2ff7-00ee-4810-8310-9f5b9b162bdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.258828 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e08b3-528b-4f5d-89d3-2c7f526aaf7c admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.259113 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e08b3-528b-4f5d-89d3-2c7f526aaf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.259214 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac2ff7-00ee-4810-8310-9f5b9b162bdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.259426 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e08b3-528b-4f5d-89d3-2c7f526aaf7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.260114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e08b3-528b-4f5d-89d3-2c7f526aaf7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.260238 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: WARNING py.warnings [None req-37ac2ff7-00ee-4810-8310-9f5b9b162bdd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:38:47.260238 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: warnings.warn(msg) May 27 09:38:47.260238 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: May 27 09:38:47.261370 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac2ff7-00ee-4810-8310-9f5b9b162bdd admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.262018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e08b3-528b-4f5d-89d3-2c7f526aaf7c admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.288794 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 795/1575] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:38:47 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:47.292212 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 781/1576] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:38:47 2022] POST /identity/v3/projects => generated 357 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:47.292359 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e08b3-528b-4f5d-89d3-2c7f526aaf7c admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.292466 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac2ff7-00ee-4810-8310-9f5b9b162bdd admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.353780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e08b3-528b-4f5d-89d3-2c7f526aaf7c admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.356386 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac2ff7-00ee-4810-8310-9f5b9b162bdd admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.358452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba4619-d1b2-41ff-9c40-176818bf8a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.359143 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba4619-d1b2-41ff-9c40-176818bf8a5c admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.359466 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba4619-d1b2-41ff-9c40-176818bf8a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.359747 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba4619-d1b2-41ff-9c40-176818bf8a5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.360439 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba4619-d1b2-41ff-9c40-176818bf8a5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.361186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4dd7d-2eba-4011-b79f-525c2c099f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.361853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4dd7d-2eba-4011-b79f-525c2c099f5c admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.362142 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4dd7d-2eba-4011-b79f-525c2c099f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.362423 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4dd7d-2eba-4011-b79f-525c2c099f5c admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.363030 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba4619-d1b2-41ff-9c40-176818bf8a5c admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.363745 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4dd7d-2eba-4011-b79f-525c2c099f5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.365865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4dd7d-2eba-4011-b79f-525c2c099f5c admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.385745 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 782/1577] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:38:47 2022] POST /identity/v3/users => generated 282 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:47.386519 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4dd7d-2eba-4011-b79f-525c2c099f5c admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.392984 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 796/1578] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:38:47 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:47.392984 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba4619-d1b2-41ff-9c40-176818bf8a5c admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.396713 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4dd7d-2eba-4011-b79f-525c2c099f5c admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.453376 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba4619-d1b2-41ff-9c40-176818bf8a5c admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.453601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2b53c-d88a-421c-a68b-a1b14cc8999c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.454095 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2b53c-d88a-421c-a68b-a1b14cc8999c admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.454384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2b53c-d88a-421c-a68b-a1b14cc8999c admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.454666 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2b53c-d88a-421c-a68b-a1b14cc8999c admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.455385 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2b53c-d88a-421c-a68b-a1b14cc8999c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.458269 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2b53c-d88a-421c-a68b-a1b14cc8999c admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.458699 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd68868-43ba-4ef4-9c05-9481df6c448e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.459395 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd68868-43ba-4ef4-9c05-9481df6c448e admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.459685 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd68868-43ba-4ef4-9c05-9481df6c448e admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.459967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd68868-43ba-4ef4-9c05-9481df6c448e admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.460657 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd68868-43ba-4ef4-9c05-9481df6c448e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.462584 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd68868-43ba-4ef4-9c05-9481df6c448e admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.465822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:47.485177 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 783/1579] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:38:47 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:47.486549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505ad51-0277-4f34-b59e-78982367c49f None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.486864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505ad51-0277-4f34-b59e-78982367c49f None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.487126 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505ad51-0277-4f34-b59e-78982367c49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.494107 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 797/1580] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:38:47 2022] POST /identity/v3/projects => generated 391 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:47.494107 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd68868-43ba-4ef4-9c05-9481df6c448e admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.505535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-f505ad51-0277-4f34-b59e-78982367c49f None None] MFA Rules not processed for user `d2b1c12e88c549208894fc0dd0c60b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:47.506752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f505ad51-0277-4f34-b59e-78982367c49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:47.546183 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:47.555193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd68868-43ba-4ef4-9c05-9481df6c448e admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.559985 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b89d0-fcc2-4998-ab08-1372da065cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.560567 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b89d0-fcc2-4998-ab08-1372da065cea admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.560850 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b89d0-fcc2-4998-ab08-1372da065cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.561147 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b89d0-fcc2-4998-ab08-1372da065cea admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.561838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b89d0-fcc2-4998-ab08-1372da065cea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.563780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b89d0-fcc2-4998-ab08-1372da065cea admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.575806 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 784/1581] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 09:38:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:47.576796 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505ad51-0277-4f34-b59e-78982367c49f None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.588771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505ad51-0277-4f34-b59e-78982367c49f None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.594357 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 798/1582] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:38:47 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:47.594357 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b89d0-fcc2-4998-ab08-1372da065cea admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.647021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d54c20-0852-40f5-a2f8-8939f7c96ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.647676 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d54c20-0852-40f5-a2f8-8939f7c96ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.647963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d54c20-0852-40f5-a2f8-8939f7c96ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.648243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d54c20-0852-40f5-a2f8-8939f7c96ad8 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.649054 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d54c20-0852-40f5-a2f8-8939f7c96ad8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.651061 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d54c20-0852-40f5-a2f8-8939f7c96ad8 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.656990 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b89d0-fcc2-4998-ab08-1372da065cea admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.661904 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e4981-1a27-4c8d-995b-ff3c41002045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.662678 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e4981-1a27-4c8d-995b-ff3c41002045 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.663010 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e4981-1a27-4c8d-995b-ff3c41002045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.663406 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e4981-1a27-4c8d-995b-ff3c41002045 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.664170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e4981-1a27-4c8d-995b-ff3c41002045 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.665216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: WARNING py.warnings [None req-505e4981-1a27-4c8d-995b-ff3c41002045 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:38:47.665216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: warnings.warn(msg) May 27 09:38:47.665216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: May 27 09:38:47.666523 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e4981-1a27-4c8d-995b-ff3c41002045 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.671847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 785/1583] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:38:47 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:47.672706 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d54c20-0852-40f5-a2f8-8939f7c96ad8 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.686718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d54c20-0852-40f5-a2f8-8939f7c96ad8 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.687243 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 799/1584] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:38:47 2022] POST /identity/v3/users => generated 279 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:47.688065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e4981-1a27-4c8d-995b-ff3c41002045 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.695358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cc179-6ece-4b19-a901-6fb5dfed4160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.696022 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cc179-6ece-4b19-a901-6fb5dfed4160 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.696312 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cc179-6ece-4b19-a901-6fb5dfed4160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.696590 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cc179-6ece-4b19-a901-6fb5dfed4160 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.697315 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cc179-6ece-4b19-a901-6fb5dfed4160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.698195 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e4981-1a27-4c8d-995b-ff3c41002045 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.698989 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cc179-6ece-4b19-a901-6fb5dfed4160 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.702801 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a6def-2427-4a94-983e-47b0f8bacf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.703544 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a6def-2427-4a94-983e-47b0f8bacf97 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.703830 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a6def-2427-4a94-983e-47b0f8bacf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.704107 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a6def-2427-4a94-983e-47b0f8bacf97 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.704782 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a6def-2427-4a94-983e-47b0f8bacf97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.706760 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a6def-2427-4a94-983e-47b0f8bacf97 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.709860 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 786/1585] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:47.710568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cc179-6ece-4b19-a901-6fb5dfed4160 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.721192 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cc179-6ece-4b19-a901-6fb5dfed4160 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.726800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf227108-397e-4604-a9e8-35c8e300883d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.727519 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf227108-397e-4604-a9e8-35c8e300883d admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.727801 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf227108-397e-4604-a9e8-35c8e300883d admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.728077 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf227108-397e-4604-a9e8-35c8e300883d admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.728766 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf227108-397e-4604-a9e8-35c8e300883d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.731135 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf227108-397e-4604-a9e8-35c8e300883d admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.735993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 800/1586] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:38:47 2022] POST /identity/v3/users => generated 290 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:47.735993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a6def-2427-4a94-983e-47b0f8bacf97 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.747834 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a6def-2427-4a94-983e-47b0f8bacf97 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.752174 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 787/1587] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:38:47 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:47.752618 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf8ef6-afc7-4298-bb49-61a5a15bb570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.753855 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf8ef6-afc7-4298-bb49-61a5a15bb570 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.754133 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf8ef6-afc7-4298-bb49-61a5a15bb570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.754403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf8ef6-afc7-4298-bb49-61a5a15bb570 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.755089 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf8ef6-afc7-4298-bb49-61a5a15bb570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.756291 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf227108-397e-4604-a9e8-35c8e300883d admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.757075 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf8ef6-afc7-4298-bb49-61a5a15bb570 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.781127 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 801/1588] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:38:47 2022] POST /identity/v3/users => generated 296 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:47.781127 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf8ef6-afc7-4298-bb49-61a5a15bb570 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.789204 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf8ef6-afc7-4298-bb49-61a5a15bb570 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.794311 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae5605-fefb-44f8-9453-044950156fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.794969 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae5605-fefb-44f8-9453-044950156fed admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.795258 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae5605-fefb-44f8-9453-044950156fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.795574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae5605-fefb-44f8-9453-044950156fed admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.796265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae5605-fefb-44f8-9453-044950156fed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.798522 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae5605-fefb-44f8-9453-044950156fed admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.816433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf227108-397e-4604-a9e8-35c8e300883d admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.820610 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 802/1589] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:38:47 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:47.821078 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6424f7-6e0f-4b26-aeda-312be8929672 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.821436 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae5605-fefb-44f8-9453-044950156fed admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.822064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6424f7-6e0f-4b26-aeda-312be8929672 service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.822492 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6424f7-6e0f-4b26-aeda-312be8929672 service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.822921 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6424f7-6e0f-4b26-aeda-312be8929672 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.831367 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae5605-fefb-44f8-9453-044950156fed admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.836053 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4dbff-47b2-4c25-92f3-e959d9848a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.836700 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4dbff-47b2-4c25-92f3-e959d9848a17 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.836982 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4dbff-47b2-4c25-92f3-e959d9848a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.837260 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4dbff-47b2-4c25-92f3-e959d9848a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.837981 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d4dbff-47b2-4c25-92f3-e959d9848a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.839655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d4dbff-47b2-4c25-92f3-e959d9848a17 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.840915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=86,keystone:INSERT=14 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:47.852226 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 803/1590] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:47.853032 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4dbff-47b2-4c25-92f3-e959d9848a17 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.862309 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4dbff-47b2-4c25-92f3-e959d9848a17 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.867510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c800b1-e770-490a-b2a7-7495f2c924ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.868168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c800b1-e770-490a-b2a7-7495f2c924ba admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.868444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c800b1-e770-490a-b2a7-7495f2c924ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.868723 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c800b1-e770-490a-b2a7-7495f2c924ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.869433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c800b1-e770-490a-b2a7-7495f2c924ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.871067 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c800b1-e770-490a-b2a7-7495f2c924ba admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.876058 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:47.882371 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 804/1591] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:47.882990 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c800b1-e770-490a-b2a7-7495f2c924ba admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.894109 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c800b1-e770-490a-b2a7-7495f2c924ba admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.898877 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c51c80-a0c5-4266-a84f-bfa132aa5928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.899615 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c51c80-a0c5-4266-a84f-bfa132aa5928 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.899900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c51c80-a0c5-4266-a84f-bfa132aa5928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.900053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6424f7-6e0f-4b26-aeda-312be8929672 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.900162 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c51c80-a0c5-4266-a84f-bfa132aa5928 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.900875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c51c80-a0c5-4266-a84f-bfa132aa5928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.901511 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6424f7-6e0f-4b26-aeda-312be8929672 service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.902459 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c51c80-a0c5-4266-a84f-bfa132aa5928 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.912376 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 805/1592] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:47.912524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 788/1593] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:38:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:47.913112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6424f7-6e0f-4b26-aeda-312be8929672 service cinder] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.913221 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c51c80-a0c5-4266-a84f-bfa132aa5928 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.922708 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c51c80-a0c5-4266-a84f-bfa132aa5928 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.923384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6424f7-6e0f-4b26-aeda-312be8929672 service cinder] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.930053 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0b095-ae9c-4b1c-a440-dee9928d81a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.931756 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f8e56-a501-41d1-9fe9-54cd838b7752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.932547 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0b095-ae9c-4b1c-a440-dee9928d81a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.932859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0b095-ae9c-4b1c-a440-dee9928d81a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.933078 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f8e56-a501-41d1-9fe9-54cd838b7752 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.933206 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0b095-ae9c-4b1c-a440-dee9928d81a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.933379 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f8e56-a501-41d1-9fe9-54cd838b7752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.933694 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f8e56-a501-41d1-9fe9-54cd838b7752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.933867 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0b095-ae9c-4b1c-a440-dee9928d81a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.934423 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f8e56-a501-41d1-9fe9-54cd838b7752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.935645 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0b095-ae9c-4b1c-a440-dee9928d81a7 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.936223 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f8e56-a501-41d1-9fe9-54cd838b7752 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.947178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 806/1594] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:47.947865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0b095-ae9c-4b1c-a440-dee9928d81a7 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.951614 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 789/1595] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:47.951614 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f8e56-a501-41d1-9fe9-54cd838b7752 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.960541 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0b095-ae9c-4b1c-a440-dee9928d81a7 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.961554 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f8e56-a501-41d1-9fe9-54cd838b7752 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.965136 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086f1a6-5122-4a7d-90bb-6b1b7602f371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.965795 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086f1a6-5122-4a7d-90bb-6b1b7602f371 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.966078 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086f1a6-5122-4a7d-90bb-6b1b7602f371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.966348 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086f1a6-5122-4a7d-90bb-6b1b7602f371 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.966455 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03215a96-b539-453c-afa8-13cb2b0252ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:47.967038 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03215a96-b539-453c-afa8-13cb2b0252ac admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:47.967144 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086f1a6-5122-4a7d-90bb-6b1b7602f371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.967349 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03215a96-b539-453c-afa8-13cb2b0252ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:47.967627 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03215a96-b539-453c-afa8-13cb2b0252ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:47.968438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03215a96-b539-453c-afa8-13cb2b0252ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:47.968814 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086f1a6-5122-4a7d-90bb-6b1b7602f371 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.970081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03215a96-b539-453c-afa8-13cb2b0252ac admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:47.980381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 807/1596] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:47.983773 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086f1a6-5122-4a7d-90bb-6b1b7602f371 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.983952 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 790/1597] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:47.985346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03215a96-b539-453c-afa8-13cb2b0252ac admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:47.996301 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03215a96-b539-453c-afa8-13cb2b0252ac admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:47.997273 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086f1a6-5122-4a7d-90bb-6b1b7602f371 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:48.002141 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb4b14-ccb6-4f0c-ad02-3c3b737b6c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:48.002394 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb140366-2b56-4eff-a6d5-eb7f6cdedcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:48.002923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb140366-2b56-4eff-a6d5-eb7f6cdedcbc admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:48.003363 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb140366-2b56-4eff-a6d5-eb7f6cdedcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:48.003649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb140366-2b56-4eff-a6d5-eb7f6cdedcbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:48.004439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb4b14-ccb6-4f0c-ad02-3c3b737b6c28 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:48.004565 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb140366-2b56-4eff-a6d5-eb7f6cdedcbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:48.005028 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb4b14-ccb6-4f0c-ad02-3c3b737b6c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:48.005484 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb4b14-ccb6-4f0c-ad02-3c3b737b6c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:48.006278 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb140366-2b56-4eff-a6d5-eb7f6cdedcbc admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:48.006900 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb4b14-ccb6-4f0c-ad02-3c3b737b6c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:48.009195 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb4b14-ccb6-4f0c-ad02-3c3b737b6c28 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:48.017399 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 808/1598] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:48.018262 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb140366-2b56-4eff-a6d5-eb7f6cdedcbc admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:48.027234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 791/1599] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:48.028678 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb4b14-ccb6-4f0c-ad02-3c3b737b6c28 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:48.029278 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb140366-2b56-4eff-a6d5-eb7f6cdedcbc admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:48.038327 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a1476-f436-4bd7-83c7-ab831a623b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:48.039247 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a1476-f436-4bd7-83c7-ab831a623b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:48.039730 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a1476-f436-4bd7-83c7-ab831a623b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:48.040017 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a1476-f436-4bd7-83c7-ab831a623b75 admin admin] PATH_INFO: `/v3/projects/97ea2c06722447ea9af654b260acd724/users/419801de50d14e2f94502d095b9cbbb6/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:48.041151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb4b14-ccb6-4f0c-ad02-3c3b737b6c28 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:48.045980 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378139f-9b40-49b9-a78d-51d3c7ca1cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:48.046667 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378139f-9b40-49b9-a78d-51d3c7ca1cda admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:48.046954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378139f-9b40-49b9-a78d-51d3c7ca1cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:48.047229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378139f-9b40-49b9-a78d-51d3c7ca1cda admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:48.048173 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378139f-9b40-49b9-a78d-51d3c7ca1cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:48.049875 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378139f-9b40-49b9-a78d-51d3c7ca1cda admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:48.065832 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a1476-f436-4bd7-83c7-ab831a623b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97ea2c06722447ea9af654b260acd724, user_id=419801de50d14e2f94502d095b9cbbb6, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:48.065832 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a1476-f436-4bd7-83c7-ab831a623b75 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:48.066162 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 792/1600] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:48.066162 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378139f-9b40-49b9-a78d-51d3c7ca1cda admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:48.078865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378139f-9b40-49b9-a78d-51d3c7ca1cda admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:48.082485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 809/1601] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:38:48 2022] PUT /identity/v3/projects/97ea2c06722447ea9af654b260acd724/users/419801de50d14e2f94502d095b9cbbb6/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:48.083225 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a1476-f436-4bd7-83c7-ab831a623b75 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:48.149386 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae48eb-b260-4fa9-a7fb-ef9afdbe47b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:48.150112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae48eb-b260-4fa9-a7fb-ef9afdbe47b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:48.151235 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae48eb-b260-4fa9-a7fb-ef9afdbe47b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:48.151235 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae48eb-b260-4fa9-a7fb-ef9afdbe47b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:48.151668 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae48eb-b260-4fa9-a7fb-ef9afdbe47b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:48.153340 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae48eb-b260-4fa9-a7fb-ef9afdbe47b2 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:48.154655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a1476-f436-4bd7-83c7-ab831a623b75 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:48.160491 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac314c7-6c4e-4c02-885c-cd62421dd3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:48.161158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac314c7-6c4e-4c02-885c-cd62421dd3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:48.161443 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac314c7-6c4e-4c02-885c-cd62421dd3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:48.161718 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac314c7-6c4e-4c02-885c-cd62421dd3d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:48.163112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac314c7-6c4e-4c02-885c-cd62421dd3d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:48.164742 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac314c7-6c4e-4c02-885c-cd62421dd3d9 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:48.168552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 793/1602] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:48.168552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae48eb-b260-4fa9-a7fb-ef9afdbe47b2 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:48.176590 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae48eb-b260-4fa9-a7fb-ef9afdbe47b2 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:48.180576 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 810/1603] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:48.181310 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f526f-a9fc-4954-9d46-3d153907b381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:48.181716 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac314c7-6c4e-4c02-885c-cd62421dd3d9 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:48.182021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f526f-a9fc-4954-9d46-3d153907b381 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:48.182373 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f526f-a9fc-4954-9d46-3d153907b381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:48.182590 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f526f-a9fc-4954-9d46-3d153907b381 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:48.183587 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f526f-a9fc-4954-9d46-3d153907b381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:48.185091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f526f-a9fc-4954-9d46-3d153907b381 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:48.193245 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac314c7-6c4e-4c02-885c-cd62421dd3d9 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:48.196210 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 794/1604] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:48.196491 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f526f-a9fc-4954-9d46-3d153907b381 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:48.201555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758a1f2-f445-4eb6-97b1-0a1030fc731e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:48.202447 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758a1f2-f445-4eb6-97b1-0a1030fc731e admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:48.202732 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758a1f2-f445-4eb6-97b1-0a1030fc731e admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:48.203008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758a1f2-f445-4eb6-97b1-0a1030fc731e admin admin] PATH_INFO: `/v3/projects/fbb8746f17d6410f9c82d0fde348d1f9/users/5b0d25ff6a664177b463b834124802d5/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:48.206465 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f526f-a9fc-4954-9d46-3d153907b381 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:48.211223 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609a533-34ff-460e-8f95-febc798dd56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:48.212191 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609a533-34ff-460e-8f95-febc798dd56a admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:48.212547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609a533-34ff-460e-8f95-febc798dd56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:48.212900 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609a533-34ff-460e-8f95-febc798dd56a admin admin] PATH_INFO: `/v3/projects/0d75ba3ac12d4760aab4c0778c76d54e/users/9a20dc7b1f67467fa9cac4306bcd882a/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:48.222505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758a1f2-f445-4eb6-97b1-0a1030fc731e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbb8746f17d6410f9c82d0fde348d1f9, user_id=5b0d25ff6a664177b463b834124802d5, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:48.225580 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758a1f2-f445-4eb6-97b1-0a1030fc731e admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:48.228691 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609a533-34ff-460e-8f95-febc798dd56a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d75ba3ac12d4760aab4c0778c76d54e, user_id=9a20dc7b1f67467fa9cac4306bcd882a, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:48.229709 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: WARNING py.warnings [None req-e609a533-34ff-460e-8f95-febc798dd56a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:38:48.229709 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: warnings.warn(msg) May 27 09:38:48.229709 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: May 27 09:38:48.231796 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609a533-34ff-460e-8f95-febc798dd56a admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:48.247430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 811/1605] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:38:48 2022] PUT /identity/v3/projects/fbb8746f17d6410f9c82d0fde348d1f9/users/5b0d25ff6a664177b463b834124802d5/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:48.247430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758a1f2-f445-4eb6-97b1-0a1030fc731e admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:48.253581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 795/1606] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:38:48 2022] PUT /identity/v3/projects/0d75ba3ac12d4760aab4c0778c76d54e/users/9a20dc7b1f67467fa9cac4306bcd882a/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:48.256036 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287f7b8-eb48-4da2-994f-e1aef3a893b7 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:48.256508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287f7b8-eb48-4da2-994f-e1aef3a893b7 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:48.257083 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287f7b8-eb48-4da2-994f-e1aef3a893b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:48.289906 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-e287f7b8-eb48-4da2-994f-e1aef3a893b7 None None] MFA Rules not processed for user `419801de50d14e2f94502d095b9cbbb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:48.291466 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e287f7b8-eb48-4da2-994f-e1aef3a893b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:48.307558 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:48.333261 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758a1f2-f445-4eb6-97b1-0a1030fc731e admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:48.349588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:48.374083 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 796/1607] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:48 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:48.375047 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287f7b8-eb48-4da2-994f-e1aef3a893b7 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:48.402014 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8b96a-37d9-4216-b2b4-53a3f782d777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:48.403241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8b96a-37d9-4216-b2b4-53a3f782d777 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:48.403561 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8b96a-37d9-4216-b2b4-53a3f782d777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:48.403843 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8b96a-37d9-4216-b2b4-53a3f782d777 admin admin] PATH_INFO: `/v3/projects/28f5838929ea4e148c78de44e6f8333f/users/8e175ff5381a4e92a04d2b1bb5cdd5dc/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:48.420600 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8b96a-37d9-4216-b2b4-53a3f782d777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28f5838929ea4e148c78de44e6f8333f, user_id=8e175ff5381a4e92a04d2b1bb5cdd5dc, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:48.423024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8b96a-37d9-4216-b2b4-53a3f782d777 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:48.438809 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 812/1608] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:38:48 2022] PUT /identity/v3/projects/28f5838929ea4e148c78de44e6f8333f/users/8e175ff5381a4e92a04d2b1bb5cdd5dc/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:48.439665 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8b96a-37d9-4216-b2b4-53a3f782d777 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:48.453330 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287f7b8-eb48-4da2-994f-e1aef3a893b7 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:48.536030 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ff872-17e4-4b9a-ad63-fa252a5bad74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:48.537230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ff872-17e4-4b9a-ad63-fa252a5bad74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:48.537844 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ff872-17e4-4b9a-ad63-fa252a5bad74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:48.538198 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ff872-17e4-4b9a-ad63-fa252a5bad74 admin admin] PATH_INFO: `/v3/projects/7479df6fb46a412398b2e1749b0cbd96/users/f31b5e67d2ac4b80bf16a766a7f9f423/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:48.543641 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8b96a-37d9-4216-b2b4-53a3f782d777 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:48.549412 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d1c78-b5e0-4aa3-8fb1-d6c6b1e9da51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:48.550592 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d1c78-b5e0-4aa3-8fb1-d6c6b1e9da51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:48.550874 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d1c78-b5e0-4aa3-8fb1-d6c6b1e9da51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:48.551151 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d1c78-b5e0-4aa3-8fb1-d6c6b1e9da51 admin admin] PATH_INFO: `/v3/projects/0cad683f27d14cf5a90a19525a467a52/users/1331ba69eaec44dd9bd8f8db7d53ba5c/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:48.561443 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ff872-17e4-4b9a-ad63-fa252a5bad74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7479df6fb46a412398b2e1749b0cbd96, user_id=f31b5e67d2ac4b80bf16a766a7f9f423, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:48.565194 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ff872-17e4-4b9a-ad63-fa252a5bad74 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:48.569038 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d1c78-b5e0-4aa3-8fb1-d6c6b1e9da51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cad683f27d14cf5a90a19525a467a52, user_id=1331ba69eaec44dd9bd8f8db7d53ba5c, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:48.572839 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d1c78-b5e0-4aa3-8fb1-d6c6b1e9da51 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:48.584905 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 797/1609] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:38:48 2022] PUT /identity/v3/projects/7479df6fb46a412398b2e1749b0cbd96/users/f31b5e67d2ac4b80bf16a766a7f9f423/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:48.586031 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ff872-17e4-4b9a-ad63-fa252a5bad74 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:48.590350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 813/1610] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:38:48 2022] PUT /identity/v3/projects/0cad683f27d14cf5a90a19525a467a52/users/1331ba69eaec44dd9bd8f8db7d53ba5c/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:48.593187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a53bb-8d7b-4b55-9bce-9a5909b0be67 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:48.593311 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a53bb-8d7b-4b55-9bce-9a5909b0be67 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:48.593707 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a53bb-8d7b-4b55-9bce-9a5909b0be67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:48.637189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-e61a53bb-8d7b-4b55-9bce-9a5909b0be67 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:48.637189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-e61a53bb-8d7b-4b55-9bce-9a5909b0be67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:48.701825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ff872-17e4-4b9a-ad63-fa252a5bad74 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:48.720225 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:48.725598 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 814/1611] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:48.726791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae89ff3-d3ae-4b34-ae90-8aa55fc80eaa None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:48.727148 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae89ff3-d3ae-4b34-ae90-8aa55fc80eaa None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:48.727651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae89ff3-d3ae-4b34-ae90-8aa55fc80eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:48.734878 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:48.761815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-4ae89ff3-d3ae-4b34-ae90-8aa55fc80eaa None None] MFA Rules not processed for user `9a20dc7b1f67467fa9cac4306bcd882a`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:48.763206 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-4ae89ff3-d3ae-4b34-ae90-8aa55fc80eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:48.770779 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd37ce3-4416-4c40-8985-02acdc304fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:48.771713 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd37ce3-4416-4c40-8985-02acdc304fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:48.772000 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd37ce3-4416-4c40-8985-02acdc304fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:48.772443 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd37ce3-4416-4c40-8985-02acdc304fe9 admin admin] PATH_INFO: `/v3/projects/06332dc6f29b4d01b047104d93bbef0f/users/2463c2327e364ca996768e3eb6ef6316/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:48.790037 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd37ce3-4416-4c40-8985-02acdc304fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06332dc6f29b4d01b047104d93bbef0f, user_id=2463c2327e364ca996768e3eb6ef6316, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:48.793154 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd37ce3-4416-4c40-8985-02acdc304fe9 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:48.810935 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 798/1612] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:38:48 2022] PUT /identity/v3/projects/06332dc6f29b4d01b047104d93bbef0f/users/2463c2327e364ca996768e3eb6ef6316/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:48.810935 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd37ce3-4416-4c40-8985-02acdc304fe9 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:48.830014 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 815/1613] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:48 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:48.831821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf264d12-c37b-48c0-92e1-3fb86316e008 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:48.832125 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf264d12-c37b-48c0-92e1-3fb86316e008 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:48.832406 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf264d12-c37b-48c0-92e1-3fb86316e008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:48.859576 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-bf264d12-c37b-48c0-92e1-3fb86316e008 None None] MFA Rules not processed for user `8e175ff5381a4e92a04d2b1bb5cdd5dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:48.860808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-bf264d12-c37b-48c0-92e1-3fb86316e008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:48.895037 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd37ce3-4416-4c40-8985-02acdc304fe9 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:48.901570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fd829-d7c4-47d0-9c77-e4da1cf7874e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:48.903030 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fd829-d7c4-47d0-9c77-e4da1cf7874e admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:48.903340 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fd829-d7c4-47d0-9c77-e4da1cf7874e admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:48.903636 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fd829-d7c4-47d0-9c77-e4da1cf7874e admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:48.904304 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fd829-d7c4-47d0-9c77-e4da1cf7874e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:48.906196 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fd829-d7c4-47d0-9c77-e4da1cf7874e admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:48.935389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 816/1614] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:48.936727 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054d74e-4693-4072-bf8f-5d712ed8051a None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:48.937024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054d74e-4693-4072-bf8f-5d712ed8051a None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:48.937307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054d74e-4693-4072-bf8f-5d712ed8051a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:48.942620 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 799/1615] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:38:48 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:48.943727 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874aaef-2c2a-4e58-ba2d-4b54c9ee3219 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:48.944089 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874aaef-2c2a-4e58-ba2d-4b54c9ee3219 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:48.944262 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874aaef-2c2a-4e58-ba2d-4b54c9ee3219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:48.962310 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-f874aaef-2c2a-4e58-ba2d-4b54c9ee3219 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:48.963369 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-2054d74e-4693-4072-bf8f-5d712ed8051a None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:48.963587 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f874aaef-2c2a-4e58-ba2d-4b54c9ee3219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:48.965120 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-2054d74e-4693-4072-bf8f-5d712ed8051a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:49.038337 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 817/1616] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:49.039223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054d74e-4693-4072-bf8f-5d712ed8051a None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:49.048693 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 800/1617] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:49.050700 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d84aa0-d143-43fe-bdaa-de5b43bba1a2 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:49.050989 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d84aa0-d143-43fe-bdaa-de5b43bba1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:49.051263 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d84aa0-d143-43fe-bdaa-de5b43bba1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:49.068648 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-f4d84aa0-d143-43fe-bdaa-de5b43bba1a2 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:49.069842 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f4d84aa0-d143-43fe-bdaa-de5b43bba1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:49.073519 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:49.078624 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 801/1618] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:49.079687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d84aa0-d143-43fe-bdaa-de5b43bba1a2 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:49.090783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d84aa0-d143-43fe-bdaa-de5b43bba1a2 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:49.095752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2577c46-f852-4d89-886e-29e582df0a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:49.096238 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2577c46-f852-4d89-886e-29e582df0a36 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:49.096523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2577c46-f852-4d89-886e-29e582df0a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:49.096845 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2577c46-f852-4d89-886e-29e582df0a36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:49.098057 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2577c46-f852-4d89-886e-29e582df0a36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:49.100479 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2577c46-f852-4d89-886e-29e582df0a36 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:49.111578 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054d74e-4693-4072-bf8f-5d712ed8051a None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:49.115175 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024ea67-e683-4d0d-94aa-94333ee2ef87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:49.115896 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024ea67-e683-4d0d-94aa-94333ee2ef87 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:49.116145 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024ea67-e683-4d0d-94aa-94333ee2ef87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:49.116424 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024ea67-e683-4d0d-94aa-94333ee2ef87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:49.121553 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:49.126054 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024ea67-e683-4d0d-94aa-94333ee2ef87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:49.127537 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024ea67-e683-4d0d-94aa-94333ee2ef87 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:49.129827 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 802/1619] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:38:49 2022] POST /identity/v3/projects => generated 357 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:49.131194 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484d81a-74af-406b-bf2f-7c47f0c64ede None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:49.131724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484d81a-74af-406b-bf2f-7c47f0c64ede None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:49.132013 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484d81a-74af-406b-bf2f-7c47f0c64ede None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:49.133407 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 803/1620] 10.222.0.41 () {54 vars in 961 bytes} [Fri May 27 09:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:38:49.134330 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484d81a-74af-406b-bf2f-7c47f0c64ede None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:49.139422 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 818/1621] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:38:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:49.140257 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024ea67-e683-4d0d-94aa-94333ee2ef87 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:49.211997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484d81a-74af-406b-bf2f-7c47f0c64ede None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:49.217424 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0969d-c760-49b4-8656-b6df423a58b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:49.218047 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0969d-c760-49b4-8656-b6df423a58b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:49.218336 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0969d-c760-49b4-8656-b6df423a58b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:49.218614 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0969d-c760-49b4-8656-b6df423a58b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:49.219339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0969d-c760-49b4-8656-b6df423a58b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:49.220592 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024ea67-e683-4d0d-94aa-94333ee2ef87 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:49.221288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0969d-c760-49b4-8656-b6df423a58b2 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:49.246335 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 804/1622] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:38:49 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:49.249979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0969d-c760-49b4-8656-b6df423a58b2 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:49.298754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820fecca-a371-49f8-94c1-6a575275dafb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:49.299552 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fecca-a371-49f8-94c1-6a575275dafb service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:49.299948 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fecca-a371-49f8-94c1-6a575275dafb service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:49.300288 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fecca-a371-49f8-94c1-6a575275dafb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:49.318095 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0969d-c760-49b4-8656-b6df423a58b2 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:49.323230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda1807-214d-4670-aba5-3fb425ba08e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:49.323992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda1807-214d-4670-aba5-3fb425ba08e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:49.324283 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda1807-214d-4670-aba5-3fb425ba08e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:49.324572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda1807-214d-4670-aba5-3fb425ba08e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:49.349819 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda1807-214d-4670-aba5-3fb425ba08e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:49.351983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda1807-214d-4670-aba5-3fb425ba08e7 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:49.363121 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 805/1623] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:38:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:49.363939 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda1807-214d-4670-aba5-3fb425ba08e7 service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:49.372539 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda1807-214d-4670-aba5-3fb425ba08e7 service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:49.376944 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc9469-7dec-4c71-8599-756fb9bb54d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:49.377583 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc9469-7dec-4c71-8599-756fb9bb54d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:49.377896 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc9469-7dec-4c71-8599-756fb9bb54d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:49.378175 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc9469-7dec-4c71-8599-756fb9bb54d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:49.378903 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820fecca-a371-49f8-94c1-6a575275dafb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:49.381686 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820fecca-a371-49f8-94c1-6a575275dafb service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:49.386496 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:49.388829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc9469-7dec-4c71-8599-756fb9bb54d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:49.390420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc9469-7dec-4c71-8599-756fb9bb54d0 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:49.394127 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 819/1624] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:38:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:49.395897 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820fecca-a371-49f8-94c1-6a575275dafb service nova] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:49.402633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 806/1625] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:38:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:49.403505 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc9469-7dec-4c71-8599-756fb9bb54d0 service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:49.406805 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820fecca-a371-49f8-94c1-6a575275dafb service nova] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:49.412925 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd04094-f828-4dc0-bb4b-b7489dd94baa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:49.413596 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd04094-f828-4dc0-bb4b-b7489dd94baa service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:49.413891 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd04094-f828-4dc0-bb4b-b7489dd94baa service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:49.414274 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd04094-f828-4dc0-bb4b-b7489dd94baa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:49.425271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd04094-f828-4dc0-bb4b-b7489dd94baa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:49.427019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd04094-f828-4dc0-bb4b-b7489dd94baa service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:49.428003 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc9469-7dec-4c71-8599-756fb9bb54d0 service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:49.435003 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cfd06-7fc8-42ba-8186-f4ad818916c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:49.436258 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cfd06-7fc8-42ba-8186-f4ad818916c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:49.437021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cfd06-7fc8-42ba-8186-f4ad818916c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:49.437550 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cfd06-7fc8-42ba-8186-f4ad818916c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:49.438534 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cfd06-7fc8-42ba-8186-f4ad818916c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:49.439010 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 820/1626] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:38:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:49.440527 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebaff2-13b4-4285-a4aa-7813d2014173 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:49.440826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebaff2-13b4-4285-a4aa-7813d2014173 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:49.441111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebaff2-13b4-4285-a4aa-7813d2014173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:49.443501 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cfd06-7fc8-42ba-8186-f4ad818916c4 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:49.462498 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-ccebaff2-13b4-4285-a4aa-7813d2014173 None None] MFA Rules not processed for user `d2b1c12e88c549208894fc0dd0c60b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:49.463817 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-ccebaff2-13b4-4285-a4aa-7813d2014173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:49.475795 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 821/1627] 10.222.0.41 () {58 vars in 1058 bytes} [Fri May 27 09:38:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:49.476543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebaff2-13b4-4285-a4aa-7813d2014173 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:49.479945 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 807/1628] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:38:49 2022] POST /identity/v3/users => generated 285 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:49.484687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cfd06-7fc8-42ba-8186-f4ad818916c4 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:49.493115 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebaff2-13b4-4285-a4aa-7813d2014173 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:49.498568 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8616b8-ea41-4402-845f-f1a434c22220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:49.499060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8616b8-ea41-4402-845f-f1a434c22220 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:49.499435 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8616b8-ea41-4402-845f-f1a434c22220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:49.499844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8616b8-ea41-4402-845f-f1a434c22220 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:49.500699 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8616b8-ea41-4402-845f-f1a434c22220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:49.502537 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8616b8-ea41-4402-845f-f1a434c22220 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:49.506282 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cfd06-7fc8-42ba-8186-f4ad818916c4 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:49.514662 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 822/1629] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:49.515772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b8605-b594-47a6-9266-498eb6c16681 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:49.516070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b8605-b594-47a6-9266-498eb6c16681 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:49.516259 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465eb0c-251d-40aa-ad98-9cd96b4ea14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:49.516373 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b8605-b594-47a6-9266-498eb6c16681 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:49.517632 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465eb0c-251d-40aa-ad98-9cd96b4ea14f admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:49.518097 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 823/1630] 10.222.0.41 () {54 vars in 912 bytes} [Fri May 27 09:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:38:49.519480 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b8605-b594-47a6-9266-498eb6c16681 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:49.519694 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465eb0c-251d-40aa-ad98-9cd96b4ea14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:49.520223 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465eb0c-251d-40aa-ad98-9cd96b4ea14f admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:49.521174 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465eb0c-251d-40aa-ad98-9cd96b4ea14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:49.524852 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465eb0c-251d-40aa-ad98-9cd96b4ea14f admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:49.536301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b8605-b594-47a6-9266-498eb6c16681 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:49.542850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 808/1631] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:49.547640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133cca1-6d71-46bd-a793-b437d8331f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:49.548670 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cb506-6ca1-444e-bae6-b85519623cb7 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:49.549410 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cb506-6ca1-444e-bae6-b85519623cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:49.549829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cb506-6ca1-444e-bae6-b85519623cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:49.551012 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133cca1-6d71-46bd-a793-b437d8331f77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:49.551248 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133cca1-6d71-46bd-a793-b437d8331f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:49.551454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133cca1-6d71-46bd-a793-b437d8331f77 admin admin] PATH_INFO: `/v3/projects/c584d3848f444496b63638cd935d347f/users/05bc3a5eeb6b4c2fbb72ef58dfe36ec3/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:49.574648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133cca1-6d71-46bd-a793-b437d8331f77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c584d3848f444496b63638cd935d347f, user_id=05bc3a5eeb6b4c2fbb72ef58dfe36ec3, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:49.575556 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-8d6cb506-6ca1-444e-bae6-b85519623cb7 None None] MFA Rules not processed for user `d2b1c12e88c549208894fc0dd0c60b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:49.577038 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-8d6cb506-6ca1-444e-bae6-b85519623cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:49.579532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133cca1-6d71-46bd-a793-b437d8331f77 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:49.592788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 809/1632] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 09:38:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:49.593920 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cb506-6ca1-444e-bae6-b85519623cb7 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:49.597068 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 824/1633] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:38:49 2022] PUT /identity/v3/projects/c584d3848f444496b63638cd935d347f/users/05bc3a5eeb6b4c2fbb72ef58dfe36ec3/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:49.602885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133cca1-6d71-46bd-a793-b437d8331f77 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:49.614901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cb506-6ca1-444e-bae6-b85519623cb7 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:49.696650 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133cca1-6d71-46bd-a793-b437d8331f77 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:49.704964 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e2dd1-af4c-40a9-8436-5a67f5a74a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:49.706841 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e2dd1-af4c-40a9-8436-5a67f5a74a60 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:49.707239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e2dd1-af4c-40a9-8436-5a67f5a74a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:49.707644 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e2dd1-af4c-40a9-8436-5a67f5a74a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:49.709253 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e2dd1-af4c-40a9-8436-5a67f5a74a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:49.711262 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e2dd1-af4c-40a9-8436-5a67f5a74a60 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:49.726910 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:49.734110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 825/1634] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:49.734535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e2dd1-af4c-40a9-8436-5a67f5a74a60 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:49.771818 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e4475-8bc1-4362-b053-bb568a5ed966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:49.773954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e4475-8bc1-4362-b053-bb568a5ed966 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:49.775521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e4475-8bc1-4362-b053-bb568a5ed966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:49.775521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e4475-8bc1-4362-b053-bb568a5ed966 admin admin] PATH_INFO: `/v3/projects/b65acc1d0c1b4e9e8ae67337603ea0ec/users/a0324abb856b47fb84032c6694e499d2/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:49.808421 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e4475-8bc1-4362-b053-bb568a5ed966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b65acc1d0c1b4e9e8ae67337603ea0ec, user_id=a0324abb856b47fb84032c6694e499d2, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:49.822264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e4475-8bc1-4362-b053-bb568a5ed966 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:49.837043 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e2dd1-af4c-40a9-8436-5a67f5a74a60 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:49.850697 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 810/1635] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:38:49 2022] PUT /identity/v3/projects/b65acc1d0c1b4e9e8ae67337603ea0ec/users/a0324abb856b47fb84032c6694e499d2/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:49.850697 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e4475-8bc1-4362-b053-bb568a5ed966 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:49.966094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d66ad-4329-4b15-beb0-a099ed763f1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:49.967183 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d66ad-4329-4b15-beb0-a099ed763f1f service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:49.968119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d66ad-4329-4b15-beb0-a099ed763f1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:49.969767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d66ad-4329-4b15-beb0-a099ed763f1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:49.995472 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:50.082670 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e4475-8bc1-4362-b053-bb568a5ed966 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:50.088207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b7bda-b61b-4eb2-92c0-7cc8f39618b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:50.089143 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b7bda-b61b-4eb2-92c0-7cc8f39618b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:50.089429 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b7bda-b61b-4eb2-92c0-7cc8f39618b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:50.089710 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b7bda-b61b-4eb2-92c0-7cc8f39618b2 admin admin] PATH_INFO: `/v3/projects/c584d3848f444496b63638cd935d347f/users/05bc3a5eeb6b4c2fbb72ef58dfe36ec3/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:50.092102 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b7bda-b61b-4eb2-92c0-7cc8f39618b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c584d3848f444496b63638cd935d347f, user_id=05bc3a5eeb6b4c2fbb72ef58dfe36ec3, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:50.094809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b7bda-b61b-4eb2-92c0-7cc8f39618b2 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:50.108873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 811/1636] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:38:49 2022] PUT /identity/v3/projects/c584d3848f444496b63638cd935d347f/users/05bc3a5eeb6b4c2fbb72ef58dfe36ec3/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:50.116352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b7bda-b61b-4eb2-92c0-7cc8f39618b2 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:50.129781 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d66ad-4329-4b15-beb0-a099ed763f1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:50.131257 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d66ad-4329-4b15-beb0-a099ed763f1f service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:50.147063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 826/1637] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:38:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:50.148628 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e326f-f93b-485f-ba74-9c149a94f10f None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:50.148916 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e326f-f93b-485f-ba74-9c149a94f10f None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:50.149354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e326f-f93b-485f-ba74-9c149a94f10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:50.197374 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-b73e326f-f93b-485f-ba74-9c149a94f10f None None] MFA Rules not processed for user `05bc3a5eeb6b4c2fbb72ef58dfe36ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:50.198725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-b73e326f-f93b-485f-ba74-9c149a94f10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:50.218906 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b7bda-b61b-4eb2-92c0-7cc8f39618b2 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:50.227157 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49dcc1-5e4b-4669-a4a4-a7a049ad79ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:50.228056 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49dcc1-5e4b-4669-a4a4-a7a049ad79ae admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:50.228440 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49dcc1-5e4b-4669-a4a4-a7a049ad79ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:50.228908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49dcc1-5e4b-4669-a4a4-a7a049ad79ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:50.229754 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49dcc1-5e4b-4669-a4a4-a7a049ad79ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:50.232703 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49dcc1-5e4b-4669-a4a4-a7a049ad79ae admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:50.270837 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 812/1638] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:50.278090 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49dcc1-5e4b-4669-a4a4-a7a049ad79ae admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:50.306375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 827/1639] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:50 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:50.319551 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49dcc1-5e4b-4669-a4a4-a7a049ad79ae admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:50.319833 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e326f-f93b-485f-ba74-9c149a94f10f None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:50.326053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9c0e8-98c2-4436-be95-5d878cec5c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:50.327421 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9c0e8-98c2-4436-be95-5d878cec5c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:50.327812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9c0e8-98c2-4436-be95-5d878cec5c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:50.328229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9c0e8-98c2-4436-be95-5d878cec5c41 admin admin] PATH_INFO: `/v3/projects/b65acc1d0c1b4e9e8ae67337603ea0ec/users/a0324abb856b47fb84032c6694e499d2/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:50.330773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9c0e8-98c2-4436-be95-5d878cec5c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b65acc1d0c1b4e9e8ae67337603ea0ec, user_id=a0324abb856b47fb84032c6694e499d2, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:50.334072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9c0e8-98c2-4436-be95-5d878cec5c41 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:50.361159 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 813/1640] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:38:50 2022] PUT /identity/v3/projects/b65acc1d0c1b4e9e8ae67337603ea0ec/users/a0324abb856b47fb84032c6694e499d2/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:50.362777 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb7f55-d009-4805-9374-b67009f01434 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:50.363178 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb7f55-d009-4805-9374-b67009f01434 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:50.363492 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb7f55-d009-4805-9374-b67009f01434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:50.429943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-b5fb7f55-d009-4805-9374-b67009f01434 None None] MFA Rules not processed for user `a0324abb856b47fb84032c6694e499d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:50.431203 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-b5fb7f55-d009-4805-9374-b67009f01434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:50.488212 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e326f-f93b-485f-ba74-9c149a94f10f None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:50.532986 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:50.546237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:50.550469 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69c845-90d9-4a12-8766-1814b028e9cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:50.551991 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69c845-90d9-4a12-8766-1814b028e9cc service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:50.552384 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69c845-90d9-4a12-8766-1814b028e9cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:50.552765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69c845-90d9-4a12-8766-1814b028e9cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:50.629973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 814/1641] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:50 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:50.682000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69c845-90d9-4a12-8766-1814b028e9cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:50.682552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb7f55-d009-4805-9374-b67009f01434 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:50.688559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69c845-90d9-4a12-8766-1814b028e9cc service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:50.694790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb7f55-d009-4805-9374-b67009f01434 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:50.698919 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af00d8-b941-4bd2-8fe5-7a285653120b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:50.700091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af00d8-b941-4bd2-8fe5-7a285653120b service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:50.700532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af00d8-b941-4bd2-8fe5-7a285653120b service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:50.700984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af00d8-b941-4bd2-8fe5-7a285653120b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:50.709654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 828/1642] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:38:50 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:38:50.713788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af00d8-b941-4bd2-8fe5-7a285653120b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:50.716203 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af00d8-b941-4bd2-8fe5-7a285653120b service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:50.743710 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 815/1643] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:38:50 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:38:50.861700 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69c845-90d9-4a12-8766-1814b028e9cc service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:50.874608 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69c845-90d9-4a12-8766-1814b028e9cc service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:50.887939 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861e015-f106-465a-bc89-d224db9d34b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:50.888615 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861e015-f106-465a-bc89-d224db9d34b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:50.888905 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861e015-f106-465a-bc89-d224db9d34b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:50.897032 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861e015-f106-465a-bc89-d224db9d34b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:50.912895 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af00d8-b941-4bd2-8fe5-7a285653120b service cinder] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:50.925274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af00d8-b941-4bd2-8fe5-7a285653120b service cinder] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:50.936711 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916400e-9940-42d0-b55b-731aa7928bee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:50.938758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916400e-9940-42d0-b55b-731aa7928bee service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:50.940206 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916400e-9940-42d0-b55b-731aa7928bee service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:50.940657 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916400e-9940-42d0-b55b-731aa7928bee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:50.988860 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861e015-f106-465a-bc89-d224db9d34b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:50.991293 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861e015-f106-465a-bc89-d224db9d34b9 service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:51.010027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 829/1644] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:38:50 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:51.057034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916400e-9940-42d0-b55b-731aa7928bee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:51.059322 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916400e-9940-42d0-b55b-731aa7928bee service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:51.078033 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 816/1645] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:38:50 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:51.250113 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17149b34-c692-414b-b93e-eb84aacfd800 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:51.250417 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17149b34-c692-414b-b93e-eb84aacfd800 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:51.250706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17149b34-c692-414b-b93e-eb84aacfd800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:51.317733 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-17149b34-c692-414b-b93e-eb84aacfd800 None None] MFA Rules not processed for user `f31b5e67d2ac4b80bf16a766a7f9f423`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:51.321863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-17149b34-c692-414b-b93e-eb84aacfd800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:51.420856 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 830/1646] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:51.433225 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeea9ac-256f-4d51-8a47-cbf9c66d1c35 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:51.433788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeea9ac-256f-4d51-8a47-cbf9c66d1c35 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:51.433962 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeea9ac-256f-4d51-8a47-cbf9c66d1c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:51.494888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-4eeea9ac-256f-4d51-8a47-cbf9c66d1c35 None None] MFA Rules not processed for user `f31b5e67d2ac4b80bf16a766a7f9f423`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:51.500825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-4eeea9ac-256f-4d51-8a47-cbf9c66d1c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:51.523317 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 817/1647] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:51.532790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17149b34-c692-414b-b93e-eb84aacfd800 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:51.574438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:51.734653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17149b34-c692-414b-b93e-eb84aacfd800 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:51.742330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1320d-8df1-458a-916f-90fe6984433e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:51.743323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1320d-8df1-458a-916f-90fe6984433e service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:51.744244 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1320d-8df1-458a-916f-90fe6984433e service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:51.744697 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1320d-8df1-458a-916f-90fe6984433e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:51.758783 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1320d-8df1-458a-916f-90fe6984433e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:51.761154 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1320d-8df1-458a-916f-90fe6984433e service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:51.780210 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 831/1648] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:38:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:52.037413 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeea9ac-256f-4d51-8a47-cbf9c66d1c35 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:52.183392 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeea9ac-256f-4d51-8a47-cbf9c66d1c35 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:52.190789 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2dae3-dfa2-4e36-8d6d-3b65b3e05b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:52.192179 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2dae3-dfa2-4e36-8d6d-3b65b3e05b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:52.192910 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2dae3-dfa2-4e36-8d6d-3b65b3e05b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:52.193595 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2dae3-dfa2-4e36-8d6d-3b65b3e05b7d admin admin] PATH_INFO: `/v3/users/5e6748228e704e94a092ec7f6a50a21a` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:52.195381 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2dae3-dfa2-4e36-8d6d-3b65b3e05b7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e6748228e704e94a092ec7f6a50a21a)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:52.197084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: WARNING py.warnings [None req-60d2dae3-dfa2-4e36-8d6d-3b65b3e05b7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:38:52.197084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: warnings.warn(msg) May 27 09:38:52.197084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: May 27 09:38:52.199171 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2dae3-dfa2-4e36-8d6d-3b65b3e05b7d admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:52.332472 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-60d2dae3-dfa2-4e36-8d6d-3b65b3e05b7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e6748228e704e94a092ec7f6a50a21a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:52.337139 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:52.357802 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-60d2dae3-dfa2-4e36-8d6d-3b65b3e05b7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e6748228e704e94a092ec7f6a50a21a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:52.373057 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-60d2dae3-dfa2-4e36-8d6d-3b65b3e05b7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e6748228e704e94a092ec7f6a50a21a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:52.430014 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-60d2dae3-dfa2-4e36-8d6d-3b65b3e05b7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e6748228e704e94a092ec7f6a50a21a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:52.441011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfc1df-b3fa-4449-8590-8eaa56b71e1d None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:52.442682 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfc1df-b3fa-4449-8590-8eaa56b71e1d None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:52.443076 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-60d2dae3-dfa2-4e36-8d6d-3b65b3e05b7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e6748228e704e94a092ec7f6a50a21a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:52.444558 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfc1df-b3fa-4449-8590-8eaa56b71e1d None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:52.451985 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 832/1649] 10.222.0.41 () {54 vars in 912 bytes} [Fri May 27 09:38:52 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:38:52.457738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 818/1650] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:38:52 2022] DELETE /identity/v3/users/5e6748228e704e94a092ec7f6a50a21a => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:52.462382 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e40c0e-965f-41d2-978c-14639140f84e None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:52.462965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e40c0e-965f-41d2-978c-14639140f84e None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:52.473331 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db34501-44d7-4029-a97f-7ea344fc850a None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:52.473470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e40c0e-965f-41d2-978c-14639140f84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:52.473889 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db34501-44d7-4029-a97f-7ea344fc850a None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:52.474561 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db34501-44d7-4029-a97f-7ea344fc850a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:52.531871 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-c7e40c0e-965f-41d2-978c-14639140f84e None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:52.537751 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-c7e40c0e-965f-41d2-978c-14639140f84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:52.570404 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-4db34501-44d7-4029-a97f-7ea344fc850a None None] MFA Rules not processed for user `c1103a08484048da82c5e4627552253e`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:52.572039 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-4db34501-44d7-4029-a97f-7ea344fc850a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:52.682996 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 833/1651] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 09:38:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:52.685109 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 819/1652] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:52.689213 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db34501-44d7-4029-a97f-7ea344fc850a None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:52.691775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-4db34501-44d7-4029-a97f-7ea344fc850a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:52.693324 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e40c0e-965f-41d2-978c-14639140f84e None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:52.696219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-c7e40c0e-965f-41d2-978c-14639140f84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:52.711843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e40c0e-965f-41d2-978c-14639140f84e None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:52.712207 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db34501-44d7-4029-a97f-7ea344fc850a None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:52.715967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5800d-50ef-402f-88ad-d97fea8b2226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:52.716762 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5800d-50ef-402f-88ad-d97fea8b2226 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:52.717124 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5800d-50ef-402f-88ad-d97fea8b2226 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:52.717473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5800d-50ef-402f-88ad-d97fea8b2226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:52.723159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec3e93-2084-4bcf-b94d-b21529ff4e78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:52.723926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec3e93-2084-4bcf-b94d-b21529ff4e78 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:52.724478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec3e93-2084-4bcf-b94d-b21529ff4e78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:52.724755 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec3e93-2084-4bcf-b94d-b21529ff4e78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:52.729157 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5800d-50ef-402f-88ad-d97fea8b2226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:52.730959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5800d-50ef-402f-88ad-d97fea8b2226 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:52.757723 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 820/1653] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:38:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:38:52.770537 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec3e93-2084-4bcf-b94d-b21529ff4e78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:52.772195 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec3e93-2084-4bcf-b94d-b21529ff4e78 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:52.803748 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 834/1654] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:38:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:38:53.772151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9b3b0-7e3b-47f6-a616-5cecd3f426b5 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:53.772669 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9b3b0-7e3b-47f6-a616-5cecd3f426b5 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:53.772892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9b3b0-7e3b-47f6-a616-5cecd3f426b5 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:53.774413 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 821/1655] 10.222.0.41 () {54 vars in 960 bytes} [Fri May 27 09:38:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:38:53.783375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f7893-ff75-490d-8461-e4aba98f46e0 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:53.784803 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f7893-ff75-490d-8461-e4aba98f46e0 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:53.785252 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f7893-ff75-490d-8461-e4aba98f46e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:53.828056 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-d73f7893-ff75-490d-8461-e4aba98f46e0 None None] MFA Rules not processed for user `746fd8ed517446fe89c53df873abb2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:53.830435 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d73f7893-ff75-490d-8461-e4aba98f46e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:54.001969 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9b3b0-7e3b-47f6-a616-5cecd3f426b5 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:54.005116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-a7f9b3b0-7e3b-47f6-a616-5cecd3f426b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:54.023369 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 835/1656] 10.222.0.41 () {58 vars in 1057 bytes} [Fri May 27 09:38:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:54.028685 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f7893-ff75-490d-8461-e4aba98f46e0 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:54.070761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f7893-ff75-490d-8461-e4aba98f46e0 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:54.072109 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9b3b0-7e3b-47f6-a616-5cecd3f426b5 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:54.079410 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add394e-3ece-493d-a5b2-65ee1ab90d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:54.080481 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add394e-3ece-493d-a5b2-65ee1ab90d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:54.080862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add394e-3ece-493d-a5b2-65ee1ab90d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:54.082039 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add394e-3ece-493d-a5b2-65ee1ab90d99 admin admin] PATH_INFO: `/v3/projects/84ba4973a779495ab471f571b4fe1003` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:54.083440 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add394e-3ece-493d-a5b2-65ee1ab90d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84ba4973a779495ab471f571b4fe1003)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:54.085755 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add394e-3ece-493d-a5b2-65ee1ab90d99 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:54.090526 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7dd22-3840-4963-8960-928e1bcb522d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746fd8ed517446fe89c53df873abb2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:54.092114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7dd22-3840-4963-8960-928e1bcb522d service placement] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:54.093656 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7dd22-3840-4963-8960-928e1bcb522d service placement] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:54.094692 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7dd22-3840-4963-8960-928e1bcb522d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:54.101278 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d1c7dd22-3840-4963-8960-928e1bcb522d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:54.125445 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7dd22-3840-4963-8960-928e1bcb522d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:54.127730 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7dd22-3840-4963-8960-928e1bcb522d service placement] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:54.151757 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 836/1657] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:38:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:54.278733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-3add394e-3ece-493d-a5b2-65ee1ab90d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84ba4973a779495ab471f571b4fe1003', 'request_id': 'req-3add394e-3ece-493d-a5b2-65ee1ab90d99'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:54.287868 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-3add394e-3ece-493d-a5b2-65ee1ab90d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84ba4973a779495ab471f571b4fe1003', 'request_id': 'req-3add394e-3ece-493d-a5b2-65ee1ab90d99'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:54.298597 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-3add394e-3ece-493d-a5b2-65ee1ab90d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84ba4973a779495ab471f571b4fe1003', 'request_id': 'req-3add394e-3ece-493d-a5b2-65ee1ab90d99'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:54.310955 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-3add394e-3ece-493d-a5b2-65ee1ab90d99 admin admin] The token cache is being invalidate because project 84ba4973a779495ab471f571b4fe1003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:38:54.311364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-3add394e-3ece-493d-a5b2-65ee1ab90d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:54.312138 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-3add394e-3ece-493d-a5b2-65ee1ab90d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:38:54.314196 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 822/1658] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:38:54 2022] DELETE /identity/v3/projects/84ba4973a779495ab471f571b4fe1003 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:54.323546 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65160507-f41c-49a0-97a7-36f3d9506103 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:54.323934 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65160507-f41c-49a0-97a7-36f3d9506103 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:54.324202 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65160507-f41c-49a0-97a7-36f3d9506103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:54.360832 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-65160507-f41c-49a0-97a7-36f3d9506103 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:54.364724 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-65160507-f41c-49a0-97a7-36f3d9506103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:54.375627 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:54.489971 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 837/1659] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:54.494684 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171d775-71b0-4cb9-9ce8-0c856633db06 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:54.496244 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171d775-71b0-4cb9-9ce8-0c856633db06 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:54.496597 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171d775-71b0-4cb9-9ce8-0c856633db06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:54.525073 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-f171d775-71b0-4cb9-9ce8-0c856633db06 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:54.526630 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f171d775-71b0-4cb9-9ce8-0c856633db06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:54.539140 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 823/1660] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:54.543293 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65160507-f41c-49a0-97a7-36f3d9506103 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:54.559336 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65160507-f41c-49a0-97a7-36f3d9506103 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:54.564396 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04ccb1-c543-4ef1-af0e-85a405632ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:54.566017 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04ccb1-c543-4ef1-af0e-85a405632ccd admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:54.566017 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04ccb1-c543-4ef1-af0e-85a405632ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:54.568688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04ccb1-c543-4ef1-af0e-85a405632ccd admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:54.569348 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04ccb1-c543-4ef1-af0e-85a405632ccd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:38:54.569765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04ccb1-c543-4ef1-af0e-85a405632ccd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:54.571748 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04ccb1-c543-4ef1-af0e-85a405632ccd admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:54.604067 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 838/1661] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:38:54.606347 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171d775-71b0-4cb9-9ce8-0c856633db06 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:54.619849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171d775-71b0-4cb9-9ce8-0c856633db06 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:54.633528 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60881e-5009-4294-9db6-a6ef8c1fde56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:54.634285 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60881e-5009-4294-9db6-a6ef8c1fde56 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:54.634651 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60881e-5009-4294-9db6-a6ef8c1fde56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:54.634989 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60881e-5009-4294-9db6-a6ef8c1fde56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:54.635783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60881e-5009-4294-9db6-a6ef8c1fde56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:54.637781 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60881e-5009-4294-9db6-a6ef8c1fde56 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:54.698627 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 824/1662] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:38:54 2022] POST /identity/v3/projects => generated 403 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:54.699830 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04ccb1-c543-4ef1-af0e-85a405632ccd admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:54.730155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04ccb1-c543-4ef1-af0e-85a405632ccd admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:54.874147 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bb583-ec20-47ff-80d9-19e0da3609d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:54.875024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bb583-ec20-47ff-80d9-19e0da3609d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:54.875605 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bb583-ec20-47ff-80d9-19e0da3609d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:54.876005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bb583-ec20-47ff-80d9-19e0da3609d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:54.876834 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5bb583-ec20-47ff-80d9-19e0da3609d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:54.881779 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5bb583-ec20-47ff-80d9-19e0da3609d5 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:54.941000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 839/1663] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:38:54 2022] POST /identity/v3/users => generated 302 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:54.942119 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60881e-5009-4294-9db6-a6ef8c1fde56 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:54.957208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60881e-5009-4294-9db6-a6ef8c1fde56 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:54.962982 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e0dcb-39b8-40c5-9af9-9945df8dc501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:54.963793 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e0dcb-39b8-40c5-9af9-9945df8dc501 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:54.964148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e0dcb-39b8-40c5-9af9-9945df8dc501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:54.965023 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e0dcb-39b8-40c5-9af9-9945df8dc501 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:54.965889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e0dcb-39b8-40c5-9af9-9945df8dc501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:54.975863 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e0dcb-39b8-40c5-9af9-9945df8dc501 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:54.975863 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:54.992560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 825/1664] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:54.993992 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bb583-ec20-47ff-80d9-19e0da3609d5 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:55.008781 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bb583-ec20-47ff-80d9-19e0da3609d5 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:55.017530 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a665364-95d3-4bd9-aa35-62fc83c46e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:55.018253 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a665364-95d3-4bd9-aa35-62fc83c46e95 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:55.019124 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a665364-95d3-4bd9-aa35-62fc83c46e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:55.019441 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a665364-95d3-4bd9-aa35-62fc83c46e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:55.020179 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a665364-95d3-4bd9-aa35-62fc83c46e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:55.021807 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a665364-95d3-4bd9-aa35-62fc83c46e95 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:55.037635 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 840/1665] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:55.039671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e0dcb-39b8-40c5-9af9-9945df8dc501 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:55.053403 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e0dcb-39b8-40c5-9af9-9945df8dc501 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:55.060668 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c482a56-d0b0-4159-b9c1-9d21478de157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:55.064866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c482a56-d0b0-4159-b9c1-9d21478de157 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:55.065152 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c482a56-d0b0-4159-b9c1-9d21478de157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:55.066129 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c482a56-d0b0-4159-b9c1-9d21478de157 admin admin] PATH_INFO: `/v3/projects/a3b6a13fb1884c5c9700a0913b94e0ac/users/7a031f4ba1334a6e8d77101befa21955/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:55.088572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c482a56-d0b0-4159-b9c1-9d21478de157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b6a13fb1884c5c9700a0913b94e0ac, user_id=7a031f4ba1334a6e8d77101befa21955, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:55.092003 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c482a56-d0b0-4159-b9c1-9d21478de157 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:55.115664 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 826/1666] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:38:55 2022] PUT /identity/v3/projects/a3b6a13fb1884c5c9700a0913b94e0ac/users/7a031f4ba1334a6e8d77101befa21955/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:55.117672 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26b626-583c-4abe-a64d-0ff2e8f5d25d None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:55.117973 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26b626-583c-4abe-a64d-0ff2e8f5d25d None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:55.118707 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26b626-583c-4abe-a64d-0ff2e8f5d25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:55.150942 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-0e26b626-583c-4abe-a64d-0ff2e8f5d25d None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:55.154504 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-0e26b626-583c-4abe-a64d-0ff2e8f5d25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:55.336636 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 841/1667] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:55.342851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c482a56-d0b0-4159-b9c1-9d21478de157 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:55.345936 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-5c482a56-d0b0-4159-b9c1-9d21478de157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:55.536459 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c482a56-d0b0-4159-b9c1-9d21478de157 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:55.540393 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13042738-de41-4d26-92a8-8defa9216af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:55.541228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13042738-de41-4d26-92a8-8defa9216af3 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:55.541515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13042738-de41-4d26-92a8-8defa9216af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:55.542102 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13042738-de41-4d26-92a8-8defa9216af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:55.574996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13042738-de41-4d26-92a8-8defa9216af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:55.576515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13042738-de41-4d26-92a8-8defa9216af3 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:55.595244 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 827/1668] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:38:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:38:56.486180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d222c-f191-493b-92eb-58063d81d457 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:56.486623 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d222c-f191-493b-92eb-58063d81d457 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:56.486755 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d222c-f191-493b-92eb-58063d81d457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:56.558709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-6b7d222c-f191-493b-92eb-58063d81d457 None None] MFA Rules not processed for user `7a031f4ba1334a6e8d77101befa21955`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:56.560033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-6b7d222c-f191-493b-92eb-58063d81d457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:56.570928 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:56.707018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 842/1669] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:56.711527 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13042738-de41-4d26-92a8-8defa9216af3 service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:56.723901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13042738-de41-4d26-92a8-8defa9216af3 service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:56.738704 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691fcfc-7749-4002-902f-a26527e62e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:56.739439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691fcfc-7749-4002-902f-a26527e62e46 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:56.739727 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691fcfc-7749-4002-902f-a26527e62e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:56.740010 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691fcfc-7749-4002-902f-a26527e62e46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:56.741402 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691fcfc-7749-4002-902f-a26527e62e46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:56.743381 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691fcfc-7749-4002-902f-a26527e62e46 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:56.808430 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 828/1670] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:38:56 2022] POST /identity/v3/projects => generated 403 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:56.812089 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d222c-f191-493b-92eb-58063d81d457 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:56.825564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d222c-f191-493b-92eb-58063d81d457 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:56.936053 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adf548-483b-4bd2-aaa8-6b8f3ca4b273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:56.936752 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adf548-483b-4bd2-aaa8-6b8f3ca4b273 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:56.937677 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adf548-483b-4bd2-aaa8-6b8f3ca4b273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:56.940429 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adf548-483b-4bd2-aaa8-6b8f3ca4b273 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:56.941721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adf548-483b-4bd2-aaa8-6b8f3ca4b273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:56.945861 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adf548-483b-4bd2-aaa8-6b8f3ca4b273 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:56.987873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 843/1671] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:38:56 2022] POST /identity/v3/users => generated 308 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:38:56.991451 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691fcfc-7749-4002-902f-a26527e62e46 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:57.009755 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691fcfc-7749-4002-902f-a26527e62e46 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:57.023188 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae174936-56b0-478b-85c5-ee694f72c4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:57.023982 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae174936-56b0-478b-85c5-ee694f72c4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:57.024583 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae174936-56b0-478b-85c5-ee694f72c4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:57.024583 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae174936-56b0-478b-85c5-ee694f72c4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:57.025696 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae174936-56b0-478b-85c5-ee694f72c4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:57.037665 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae174936-56b0-478b-85c5-ee694f72c4e7 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:57.067291 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 829/1672] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:57.067660 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adf548-483b-4bd2-aaa8-6b8f3ca4b273 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:57.090534 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adf548-483b-4bd2-aaa8-6b8f3ca4b273 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:57.097766 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303b1e4-e6b2-4f29-83dd-bb0d57b46724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:57.099493 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303b1e4-e6b2-4f29-83dd-bb0d57b46724 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:57.099886 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303b1e4-e6b2-4f29-83dd-bb0d57b46724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:57.100286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303b1e4-e6b2-4f29-83dd-bb0d57b46724 admin admin] PATH_INFO: `/v3/projects/bb068315dab546399f08e56703237783/users/fb728d89323546bd94c9fba59b6afbd0/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:57.142199 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303b1e4-e6b2-4f29-83dd-bb0d57b46724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb068315dab546399f08e56703237783, user_id=fb728d89323546bd94c9fba59b6afbd0, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:57.149409 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303b1e4-e6b2-4f29-83dd-bb0d57b46724 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:57.179028 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 844/1673] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:38:57 2022] PUT /identity/v3/projects/bb068315dab546399f08e56703237783/users/fb728d89323546bd94c9fba59b6afbd0/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:57.180959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae174936-56b0-478b-85c5-ee694f72c4e7 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:57.210072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae174936-56b0-478b-85c5-ee694f72c4e7 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:57.312361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed067ed-f176-4bf6-a4d6-49217ef9c453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:57.313445 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed067ed-f176-4bf6-a4d6-49217ef9c453 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:57.313966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed067ed-f176-4bf6-a4d6-49217ef9c453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:57.314395 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed067ed-f176-4bf6-a4d6-49217ef9c453 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:57.315997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed067ed-f176-4bf6-a4d6-49217ef9c453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:57.318263 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed067ed-f176-4bf6-a4d6-49217ef9c453 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:57.336933 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 830/1674] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:38:57.340751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303b1e4-e6b2-4f29-83dd-bb0d57b46724 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:38:57.357817 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303b1e4-e6b2-4f29-83dd-bb0d57b46724 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:38:57.375728 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95bef6-b877-4d57-a587-2b8d04360dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:38:57.376762 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95bef6-b877-4d57-a587-2b8d04360dec admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:57.377161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95bef6-b877-4d57-a587-2b8d04360dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:57.377539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95bef6-b877-4d57-a587-2b8d04360dec admin admin] PATH_INFO: `/v3/projects/bb068315dab546399f08e56703237783/users/fb728d89323546bd94c9fba59b6afbd0/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:57.381159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95bef6-b877-4d57-a587-2b8d04360dec admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb068315dab546399f08e56703237783, user_id=fb728d89323546bd94c9fba59b6afbd0, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:38:57.385384 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95bef6-b877-4d57-a587-2b8d04360dec admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:38:57.399268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 845/1675] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:38:57 2022] PUT /identity/v3/projects/bb068315dab546399f08e56703237783/users/fb728d89323546bd94c9fba59b6afbd0/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:38:58.698148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00174b-7d79-4f79-a123-212dd775c4a5 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:58.698598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00174b-7d79-4f79-a123-212dd775c4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:58.698731 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00174b-7d79-4f79-a123-212dd775c4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:58.749440 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-8e00174b-7d79-4f79-a123-212dd775c4a5 None None] MFA Rules not processed for user `fb728d89323546bd94c9fba59b6afbd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:58.750555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-8e00174b-7d79-4f79-a123-212dd775c4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:58.791612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:58.861080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 831/1676] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:38:58 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:38:59.821309 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cf64a-7a58-4d35-948b-8ff9cc247af2 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:38:59.821835 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cf64a-7a58-4d35-948b-8ff9cc247af2 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:38:59.821835 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cf64a-7a58-4d35-948b-8ff9cc247af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:38:59.858381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-c88cf64a-7a58-4d35-948b-8ff9cc247af2 None None] MFA Rules not processed for user `f52f0a03cc0f494d82a091bd885478e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:38:59.859708 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-c88cf64a-7a58-4d35-948b-8ff9cc247af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:38:59.967856 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 846/1677] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 09:38:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:00.214370 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00174b-7d79-4f79-a123-212dd775c4a5 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:00.216662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-8e00174b-7d79-4f79-a123-212dd775c4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:00.336942 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00174b-7d79-4f79-a123-212dd775c4a5 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:00.343735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c2c5e-7590-45d1-a9e3-4f6b7217925c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '351f74222d394f39bda0663e0e4ebde6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:00.344364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c2c5e-7590-45d1-a9e3-4f6b7217925c service swift] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:00.344824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c2c5e-7590-45d1-a9e3-4f6b7217925c service swift] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:00.345111 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c2c5e-7590-45d1-a9e3-4f6b7217925c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:00.361200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c2c5e-7590-45d1-a9e3-4f6b7217925c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:00.362918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c2c5e-7590-45d1-a9e3-4f6b7217925c service swift] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:00.403397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 832/1678] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 09:39:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:39:01.244301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cf64a-7a58-4d35-948b-8ff9cc247af2 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:01.245771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-c88cf64a-7a58-4d35-948b-8ff9cc247af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:01.255034 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:01.629356 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cf64a-7a58-4d35-948b-8ff9cc247af2 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:01.657476 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e411c0-1eb8-4bcc-b447-08fb1a063e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:01.658412 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e411c0-1eb8-4bcc-b447-08fb1a063e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:01.659324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e411c0-1eb8-4bcc-b447-08fb1a063e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:01.659620 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e411c0-1eb8-4bcc-b447-08fb1a063e32 admin admin] PATH_INFO: `/v3/users/8e175ff5381a4e92a04d2b1bb5cdd5dc` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:01.670967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e411c0-1eb8-4bcc-b447-08fb1a063e32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e175ff5381a4e92a04d2b1bb5cdd5dc)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:01.726947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e411c0-1eb8-4bcc-b447-08fb1a063e32 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:01.902538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e2e411c0-1eb8-4bcc-b447-08fb1a063e32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e175ff5381a4e92a04d2b1bb5cdd5dc'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:01.906003 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e2e411c0-1eb8-4bcc-b447-08fb1a063e32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e175ff5381a4e92a04d2b1bb5cdd5dc'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:01.925894 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e2e411c0-1eb8-4bcc-b447-08fb1a063e32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e175ff5381a4e92a04d2b1bb5cdd5dc'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:01.927313 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e2e411c0-1eb8-4bcc-b447-08fb1a063e32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e175ff5381a4e92a04d2b1bb5cdd5dc'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:01.976267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e2e411c0-1eb8-4bcc-b447-08fb1a063e32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e175ff5381a4e92a04d2b1bb5cdd5dc'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:02.010974 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 847/1679] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:01 2022] DELETE /identity/v3/users/8e175ff5381a4e92a04d2b1bb5cdd5dc => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:02.015604 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e490831-9428-471f-8a26-4bb855c74bc5 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:02.016147 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e490831-9428-471f-8a26-4bb855c74bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:02.016147 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e490831-9428-471f-8a26-4bb855c74bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:02.056329 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-6e490831-9428-471f-8a26-4bb855c74bc5 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:02.057558 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-6e490831-9428-471f-8a26-4bb855c74bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:02.264152 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 833/1680] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:02.305394 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e411c0-1eb8-4bcc-b447-08fb1a063e32 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:02.307884 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-e2e411c0-1eb8-4bcc-b447-08fb1a063e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:02.455139 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e411c0-1eb8-4bcc-b447-08fb1a063e32 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:02.460906 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396ffc5-dd47-4365-85f6-931ff96d26b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:02.461768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396ffc5-dd47-4365-85f6-931ff96d26b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:02.462265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396ffc5-dd47-4365-85f6-931ff96d26b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:02.462728 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396ffc5-dd47-4365-85f6-931ff96d26b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:02.493748 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396ffc5-dd47-4365-85f6-931ff96d26b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:02.495342 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396ffc5-dd47-4365-85f6-931ff96d26b6 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:02.527065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 848/1681] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:03.116862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e081d82-099e-4f60-967b-89706070f528 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:03.117841 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e081d82-099e-4f60-967b-89706070f528 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:03.118275 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e081d82-099e-4f60-967b-89706070f528 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:03.120151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 834/1682] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 09:39:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:39:03.139763 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46196f-0b65-4bc8-8e5f-831460a35ee9 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:03.140059 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46196f-0b65-4bc8-8e5f-831460a35ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:03.140344 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46196f-0b65-4bc8-8e5f-831460a35ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:03.161886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e081d82-099e-4f60-967b-89706070f528 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:03.164553 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-7a46196f-0b65-4bc8-8e5f-831460a35ee9 None None] MFA Rules not processed for user `746fd8ed517446fe89c53df873abb2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:03.165491 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-1e081d82-099e-4f60-967b-89706070f528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:03.165962 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-7a46196f-0b65-4bc8-8e5f-831460a35ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:03.199150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e081d82-099e-4f60-967b-89706070f528 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:03.212649 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a9ebf-9742-4eec-9c62-58f18b55353c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:03.213866 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:03.214596 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a9ebf-9742-4eec-9c62-58f18b55353c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:03.215030 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a9ebf-9742-4eec-9c62-58f18b55353c admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:03.215714 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a9ebf-9742-4eec-9c62-58f18b55353c admin admin] PATH_INFO: `/v3/projects/28f5838929ea4e148c78de44e6f8333f` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:03.218090 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a9ebf-9742-4eec-9c62-58f18b55353c admin admin] RBAC: Authorizing `identity:delete_project(project_id=28f5838929ea4e148c78de44e6f8333f)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:03.220385 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a9ebf-9742-4eec-9c62-58f18b55353c admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:03.371529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c69a9ebf-9742-4eec-9c62-58f18b55353c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28f5838929ea4e148c78de44e6f8333f', 'request_id': 'req-c69a9ebf-9742-4eec-9c62-58f18b55353c'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:03.373864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:03.379939 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 849/1683] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 09:39:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:03.399326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c69a9ebf-9742-4eec-9c62-58f18b55353c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28f5838929ea4e148c78de44e6f8333f', 'request_id': 'req-c69a9ebf-9742-4eec-9c62-58f18b55353c'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:03.418780 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c69a9ebf-9742-4eec-9c62-58f18b55353c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28f5838929ea4e148c78de44e6f8333f', 'request_id': 'req-c69a9ebf-9742-4eec-9c62-58f18b55353c'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:03.441464 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46196f-0b65-4bc8-8e5f-831460a35ee9 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:03.441906 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c69a9ebf-9742-4eec-9c62-58f18b55353c admin admin] The token cache is being invalidate because project 28f5838929ea4e148c78de44e6f8333f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:03.442360 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c69a9ebf-9742-4eec-9c62-58f18b55353c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:03.443327 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c69a9ebf-9742-4eec-9c62-58f18b55353c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:03.444010 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-7a46196f-0b65-4bc8-8e5f-831460a35ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:03.451264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 835/1684] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:03 2022] DELETE /identity/v3/projects/28f5838929ea4e148c78de44e6f8333f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:03.453118 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c513f2-c7e4-4ca9-b230-165d04210f4b None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:03.459814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c513f2-c7e4-4ca9-b230-165d04210f4b None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:03.460409 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c513f2-c7e4-4ca9-b230-165d04210f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:03.464730 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46196f-0b65-4bc8-8e5f-831460a35ee9 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:03.533902 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-59c513f2-c7e4-4ca9-b230-165d04210f4b None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:03.536578 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-59c513f2-c7e4-4ca9-b230-165d04210f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:03.678468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c56cf8-1c38-4cd4-994e-40f610044458 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746fd8ed517446fe89c53df873abb2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:03.679578 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c56cf8-1c38-4cd4-994e-40f610044458 service placement] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:03.680070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c56cf8-1c38-4cd4-994e-40f610044458 service placement] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:03.680660 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c56cf8-1c38-4cd4-994e-40f610044458 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:03.682786 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-92c56cf8-1c38-4cd4-994e-40f610044458 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:03.709278 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c56cf8-1c38-4cd4-994e-40f610044458 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:03.713470 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c56cf8-1c38-4cd4-994e-40f610044458 service placement] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:03.748283 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 850/1685] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:03.781191 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 836/1686] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:03.789714 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc49daf-e257-418c-bd57-8172eaf86108 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:03.789870 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc49daf-e257-418c-bd57-8172eaf86108 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:03.790150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc49daf-e257-418c-bd57-8172eaf86108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:03.818440 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-7bc49daf-e257-418c-bd57-8172eaf86108 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:03.820915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-7bc49daf-e257-418c-bd57-8172eaf86108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:03.831052 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 851/1687] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:03.835153 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c513f2-c7e4-4ca9-b230-165d04210f4b None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:03.847087 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c513f2-c7e4-4ca9-b230-165d04210f4b None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:03.856492 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e9554-db42-4bd7-a822-25ed404a5628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:03.857191 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e9554-db42-4bd7-a822-25ed404a5628 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:03.857474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e9554-db42-4bd7-a822-25ed404a5628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:03.858503 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e9554-db42-4bd7-a822-25ed404a5628 admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:03.859591 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e9554-db42-4bd7-a822-25ed404a5628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:39:03.859908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e9554-db42-4bd7-a822-25ed404a5628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:03.864975 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e9554-db42-4bd7-a822-25ed404a5628 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:03.888791 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 837/1688] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:39:03.893099 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc49daf-e257-418c-bd57-8172eaf86108 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:03.916314 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc49daf-e257-418c-bd57-8172eaf86108 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:03.929424 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2114e29-b21e-4bda-8e2c-2190f3d1cce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:03.930117 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2114e29-b21e-4bda-8e2c-2190f3d1cce4 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:03.930402 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2114e29-b21e-4bda-8e2c-2190f3d1cce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:03.930677 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2114e29-b21e-4bda-8e2c-2190f3d1cce4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:03.931412 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2114e29-b21e-4bda-8e2c-2190f3d1cce4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:03.933368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2114e29-b21e-4bda-8e2c-2190f3d1cce4 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:04.037887 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 852/1689] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:03 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:39:04.040230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e9554-db42-4bd7-a822-25ed404a5628 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:04.055245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e9554-db42-4bd7-a822-25ed404a5628 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:04.236018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f382814-c7e7-42ac-942b-dd629a078163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:04.243481 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f382814-c7e7-42ac-942b-dd629a078163 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:04.244129 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f382814-c7e7-42ac-942b-dd629a078163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:04.244930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f382814-c7e7-42ac-942b-dd629a078163 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:04.251977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f382814-c7e7-42ac-942b-dd629a078163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:04.256951 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f382814-c7e7-42ac-942b-dd629a078163 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:04.349359 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2114e29-b21e-4bda-8e2c-2190f3d1cce4 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:04.349926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 838/1690] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:04 2022] POST /identity/v3/users => generated 283 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:04.362349 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2114e29-b21e-4bda-8e2c-2190f3d1cce4 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:04.380045 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1697d5-8233-44b3-aff1-0f51cce001c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:04.382839 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1697d5-8233-44b3-aff1-0f51cce001c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:04.384176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1697d5-8233-44b3-aff1-0f51cce001c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:04.385476 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1697d5-8233-44b3-aff1-0f51cce001c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:04.387227 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1697d5-8233-44b3-aff1-0f51cce001c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:04.396110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1697d5-8233-44b3-aff1-0f51cce001c2 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:04.466205 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 853/1691] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:39:04.469766 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f382814-c7e7-42ac-942b-dd629a078163 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:04.487539 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f382814-c7e7-42ac-942b-dd629a078163 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:04.503022 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e8faf-4563-4fab-9217-bf0a2036029c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:04.503404 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e8faf-4563-4fab-9217-bf0a2036029c admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:04.503979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e8faf-4563-4fab-9217-bf0a2036029c admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:04.503979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e8faf-4563-4fab-9217-bf0a2036029c admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:04.525323 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e8faf-4563-4fab-9217-bf0a2036029c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:04.537019 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e8faf-4563-4fab-9217-bf0a2036029c admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:04.585745 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 839/1692] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:04.590174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1697d5-8233-44b3-aff1-0f51cce001c2 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:04.641794 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1697d5-8233-44b3-aff1-0f51cce001c2 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:04.660278 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae6b57-97bf-42aa-a18b-228fa2cf58fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:04.676292 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae6b57-97bf-42aa-a18b-228fa2cf58fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:04.676942 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae6b57-97bf-42aa-a18b-228fa2cf58fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:04.677333 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae6b57-97bf-42aa-a18b-228fa2cf58fa admin admin] PATH_INFO: `/v3/projects/84755f8a60e0499dafa827933541e339/users/5372784e6c5c4b1fb7fd3b5174530ed5/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:04.775257 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae6b57-97bf-42aa-a18b-228fa2cf58fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=84755f8a60e0499dafa827933541e339, user_id=5372784e6c5c4b1fb7fd3b5174530ed5, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:04.789678 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae6b57-97bf-42aa-a18b-228fa2cf58fa admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:04.838963 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 854/1693] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:04 2022] PUT /identity/v3/projects/84755f8a60e0499dafa827933541e339/users/5372784e6c5c4b1fb7fd3b5174530ed5/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:04.854404 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9b1e8-d103-4d47-80d0-27e767bbb35d None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:04.854689 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9b1e8-d103-4d47-80d0-27e767bbb35d None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:04.854974 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9b1e8-d103-4d47-80d0-27e767bbb35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:04.968222 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-d4d9b1e8-d103-4d47-80d0-27e767bbb35d None None] MFA Rules not processed for user `5372784e6c5c4b1fb7fd3b5174530ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:04.979225 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-d4d9b1e8-d103-4d47-80d0-27e767bbb35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:05.084560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:05.198991 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 840/1694] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:05.203927 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae6b57-97bf-42aa-a18b-228fa2cf58fa admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:05.279701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:05.309933 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae6b57-97bf-42aa-a18b-228fa2cf58fa admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:05.319393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af94b5-1377-4512-adb8-233886c2d07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:05.321075 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af94b5-1377-4512-adb8-233886c2d07f admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:05.322300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af94b5-1377-4512-adb8-233886c2d07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:05.322828 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af94b5-1377-4512-adb8-233886c2d07f admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:05.323917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af94b5-1377-4512-adb8-233886c2d07f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:05.327734 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af94b5-1377-4512-adb8-233886c2d07f admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:05.381493 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 855/1695] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:05 2022] POST /identity/v3/projects => generated 363 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:05.385244 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9b1e8-d103-4d47-80d0-27e767bbb35d None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:05.400758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9b1e8-d103-4d47-80d0-27e767bbb35d None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:05.507125 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2041086-a4eb-4ade-9707-de056ad1b8fc None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:05.508328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2041086-a4eb-4ade-9707-de056ad1b8fc None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:05.509657 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2041086-a4eb-4ade-9707-de056ad1b8fc None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:05.511321 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 856/1696] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 09:39:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:39:05.539200 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2e147-4b4c-404b-86b1-b26800a86d38 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:05.539967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2e147-4b4c-404b-86b1-b26800a86d38 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:05.540525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2e147-4b4c-404b-86b1-b26800a86d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:05.597501 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45885128-1059-4fc3-bdb5-f1595cd2fc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:05.598497 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45885128-1059-4fc3-bdb5-f1595cd2fc4a admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:05.598497 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45885128-1059-4fc3-bdb5-f1595cd2fc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:05.599464 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45885128-1059-4fc3-bdb5-f1595cd2fc4a admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:05.600515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45885128-1059-4fc3-bdb5-f1595cd2fc4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:05.603317 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45885128-1059-4fc3-bdb5-f1595cd2fc4a admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:05.607063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-61e2e147-4b4c-404b-86b1-b26800a86d38 None None] MFA Rules not processed for user `5b0d25ff6a664177b463b834124802d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:05.608388 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-61e2e147-4b4c-404b-86b1-b26800a86d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:05.672869 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 841/1697] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:05 2022] POST /identity/v3/users => generated 288 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:05.681019 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29216c0d-a384-406e-9dfe-c3bf3b75a083 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:05.681019 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29216c0d-a384-406e-9dfe-c3bf3b75a083 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:05.681302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29216c0d-a384-406e-9dfe-c3bf3b75a083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:05.741000 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-29216c0d-a384-406e-9dfe-c3bf3b75a083 None None] MFA Rules not processed for user `746fd8ed517446fe89c53df873abb2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:05.746162 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-29216c0d-a384-406e-9dfe-c3bf3b75a083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:05.804497 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 857/1698] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:05.805687 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2e147-4b4c-404b-86b1-b26800a86d38 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:05.854944 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2e147-4b4c-404b-86b1-b26800a86d38 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:05.880987 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048f360-b95b-4631-8e98-3694a18d2e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:05.881630 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048f360-b95b-4631-8e98-3694a18d2e12 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:05.881989 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048f360-b95b-4631-8e98-3694a18d2e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:05.882281 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048f360-b95b-4631-8e98-3694a18d2e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:05.883029 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048f360-b95b-4631-8e98-3694a18d2e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:05.885812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048f360-b95b-4631-8e98-3694a18d2e12 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:05.907673 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 858/1699] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:05.908569 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048f360-b95b-4631-8e98-3694a18d2e12 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:05.912576 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-4048f360-b95b-4631-8e98-3694a18d2e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:05.912867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 842/1700] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 09:39:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:05.913762 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29216c0d-a384-406e-9dfe-c3bf3b75a083 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:05.915086 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-29216c0d-a384-406e-9dfe-c3bf3b75a083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:05.943927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29216c0d-a384-406e-9dfe-c3bf3b75a083 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:05.960892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba58c5e-7cfc-4a3b-99c7-871cca6c53bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:05.962062 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba58c5e-7cfc-4a3b-99c7-871cca6c53bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:05.962501 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba58c5e-7cfc-4a3b-99c7-871cca6c53bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:05.962786 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba58c5e-7cfc-4a3b-99c7-871cca6c53bb admin admin] PATH_INFO: `/v3/users/7a031f4ba1334a6e8d77101befa21955` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:05.965625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba58c5e-7cfc-4a3b-99c7-871cca6c53bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a031f4ba1334a6e8d77101befa21955)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:05.970575 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba58c5e-7cfc-4a3b-99c7-871cca6c53bb admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:06.066557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-4ba58c5e-7cfc-4a3b-99c7-871cca6c53bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a031f4ba1334a6e8d77101befa21955'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:06.077426 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048f360-b95b-4631-8e98-3694a18d2e12 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:06.080645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:06.084656 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-4ba58c5e-7cfc-4a3b-99c7-871cca6c53bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a031f4ba1334a6e8d77101befa21955'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:06.086008 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-4ba58c5e-7cfc-4a3b-99c7-871cca6c53bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a031f4ba1334a6e8d77101befa21955'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:06.087295 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3f8db-be94-492a-be3b-723be9301eda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:06.088414 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3f8db-be94-492a-be3b-723be9301eda service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:06.088838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3f8db-be94-492a-be3b-723be9301eda service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:06.089252 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3f8db-be94-492a-be3b-723be9301eda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:06.101865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3f8db-be94-492a-be3b-723be9301eda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:06.106252 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3f8db-be94-492a-be3b-723be9301eda service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:06.112540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-4ba58c5e-7cfc-4a3b-99c7-871cca6c53bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a031f4ba1334a6e8d77101befa21955'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:06.122714 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 859/1701] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:06.123615 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3f8db-be94-492a-be3b-723be9301eda service nova] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:06.130188 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-4ba58c5e-7cfc-4a3b-99c7-871cca6c53bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a031f4ba1334a6e8d77101befa21955'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:06.137609 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 843/1702] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:05 2022] DELETE /identity/v3/users/7a031f4ba1334a6e8d77101befa21955 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:06.138522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba58c5e-7cfc-4a3b-99c7-871cca6c53bb admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:06.140049 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-4ba58c5e-7cfc-4a3b-99c7-871cca6c53bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:06.166563 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3f8db-be94-492a-be3b-723be9301eda service nova] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:06.288559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:06.376983 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281be77-d46f-4544-b59c-478561946026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:06.378582 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281be77-d46f-4544-b59c-478561946026 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:06.387653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281be77-d46f-4544-b59c-478561946026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:06.388268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281be77-d46f-4544-b59c-478561946026 admin admin] PATH_INFO: `/v3/projects/3257639b05ab4533b294beeaf39f36f1/users/ee456e76b9614a98aeffb7093529d416/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:06.406513 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba58c5e-7cfc-4a3b-99c7-871cca6c53bb admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:06.424017 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0a0d7-57a3-44ee-aabd-230062ec7632 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746fd8ed517446fe89c53df873abb2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:06.428335 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0a0d7-57a3-44ee-aabd-230062ec7632 service placement] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:06.429295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0a0d7-57a3-44ee-aabd-230062ec7632 service placement] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:06.429932 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0a0d7-57a3-44ee-aabd-230062ec7632 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:06.442590 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-41a0a0d7-57a3-44ee-aabd-230062ec7632 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:06.445294 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281be77-d46f-4544-b59c-478561946026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3257639b05ab4533b294beeaf39f36f1, user_id=ee456e76b9614a98aeffb7093529d416, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:06.456110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281be77-d46f-4544-b59c-478561946026 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:06.489734 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0a0d7-57a3-44ee-aabd-230062ec7632 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:06.495193 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0a0d7-57a3-44ee-aabd-230062ec7632 service placement] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:06.498643 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 860/1703] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:06 2022] PUT /identity/v3/projects/3257639b05ab4533b294beeaf39f36f1/users/ee456e76b9614a98aeffb7093529d416/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:06.503719 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281be77-d46f-4544-b59c-478561946026 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:06.509588 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-6281be77-d46f-4544-b59c-478561946026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:06.540813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 844/1704] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:06.636348 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b096e-83d8-45cc-bfe8-0fe8e022ad1e None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:06.636827 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b096e-83d8-45cc-bfe8-0fe8e022ad1e None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:06.637283 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b096e-83d8-45cc-bfe8-0fe8e022ad1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:06.694553 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-e80b096e-83d8-45cc-bfe8-0fe8e022ad1e None None] MFA Rules not processed for user `c1103a08484048da82c5e4627552253e`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:06.698344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e80b096e-83d8-45cc-bfe8-0fe8e022ad1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:06.707931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281be77-d46f-4544-b59c-478561946026 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:06.733366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bbdde-06ff-4326-ae5a-6375d34574d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:06.734017 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bbdde-06ff-4326-ae5a-6375d34574d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:06.734470 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bbdde-06ff-4326-ae5a-6375d34574d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:06.734902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bbdde-06ff-4326-ae5a-6375d34574d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:06.735658 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9bbdde-06ff-4326-ae5a-6375d34574d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:06.742803 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9bbdde-06ff-4326-ae5a-6375d34574d7 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:06.775982 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 861/1705] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:06.776976 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bbdde-06ff-4326-ae5a-6375d34574d7 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:06.807343 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bbdde-06ff-4326-ae5a-6375d34574d7 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:06.821817 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582a703-43b4-4f4c-9687-def819717b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:06.822654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582a703-43b4-4f4c-9687-def819717b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:06.822790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582a703-43b4-4f4c-9687-def819717b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:06.823053 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582a703-43b4-4f4c-9687-def819717b13 admin admin] PATH_INFO: `/v3/projects/3257639b05ab4533b294beeaf39f36f1/users/ee456e76b9614a98aeffb7093529d416/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:06.827035 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582a703-43b4-4f4c-9687-def819717b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3257639b05ab4533b294beeaf39f36f1, user_id=ee456e76b9614a98aeffb7093529d416, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:06.837234 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582a703-43b4-4f4c-9687-def819717b13 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:06.882102 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 862/1706] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:06 2022] PUT /identity/v3/projects/3257639b05ab4533b294beeaf39f36f1/users/ee456e76b9614a98aeffb7093529d416/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:06.899033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038595e1-765d-4239-91fa-495a1e9f9abc None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:06.899414 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038595e1-765d-4239-91fa-495a1e9f9abc None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:06.899646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038595e1-765d-4239-91fa-495a1e9f9abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:06.939631 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 845/1707] 10.222.0.65 () {58 vars in 1015 bytes} [Fri May 27 09:39:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:06.984154 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-038595e1-765d-4239-91fa-495a1e9f9abc None None] MFA Rules not processed for user `ee456e76b9614a98aeffb7093529d416`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:06.985383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-038595e1-765d-4239-91fa-495a1e9f9abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:07.162588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b096e-83d8-45cc-bfe8-0fe8e022ad1e None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:07.164278 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e80b096e-83d8-45cc-bfe8-0fe8e022ad1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:07.182334 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b096e-83d8-45cc-bfe8-0fe8e022ad1e None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:07.249708 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 863/1708] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:06 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:07.260802 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038595e1-765d-4239-91fa-495a1e9f9abc None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:07.262334 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-038595e1-765d-4239-91fa-495a1e9f9abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:07.383622 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:07.433455 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcddf25-0a77-411b-96be-f77679bb65cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:07.442189 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcddf25-0a77-411b-96be-f77679bb65cf service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:07.442497 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcddf25-0a77-411b-96be-f77679bb65cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:07.442789 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcddf25-0a77-411b-96be-f77679bb65cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:07.456804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038595e1-765d-4239-91fa-495a1e9f9abc None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:07.468174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef475ba2-4395-476f-addb-db4f03911fae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:07.468992 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef475ba2-4395-476f-addb-db4f03911fae service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:07.469427 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef475ba2-4395-476f-addb-db4f03911fae service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:07.469813 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef475ba2-4395-476f-addb-db4f03911fae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:07.488543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef475ba2-4395-476f-addb-db4f03911fae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:07.490368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef475ba2-4395-476f-addb-db4f03911fae service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:07.491590 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcddf25-0a77-411b-96be-f77679bb65cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:07.494046 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcddf25-0a77-411b-96be-f77679bb65cf service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:07.528734 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 864/1709] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:07 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:39:07.529810 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef475ba2-4395-476f-addb-db4f03911fae service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:07.531962 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-ef475ba2-4395-476f-addb-db4f03911fae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:07.536716 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 846/1710] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:39:07.651522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcddf25-0a77-411b-96be-f77679bb65cf service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:07.663021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcddf25-0a77-411b-96be-f77679bb65cf service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:07.673496 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef475ba2-4395-476f-addb-db4f03911fae service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:07.674417 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b56f81-1f6d-47c6-a658-957e08059291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:07.677185 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b56f81-1f6d-47c6-a658-957e08059291 service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:07.678309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b56f81-1f6d-47c6-a658-957e08059291 service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:07.679571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b56f81-1f6d-47c6-a658-957e08059291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:07.683937 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae553c10-6873-4d6b-b7ef-636e356361f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:07.684829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae553c10-6873-4d6b-b7ef-636e356361f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:07.685116 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae553c10-6873-4d6b-b7ef-636e356361f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:07.685397 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae553c10-6873-4d6b-b7ef-636e356361f5 admin admin] PATH_INFO: `/v3/projects/a3b6a13fb1884c5c9700a0913b94e0ac` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:07.686466 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-29b56f81-1f6d-47c6-a658-957e08059291 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:07.686624 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae553c10-6873-4d6b-b7ef-636e356361f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3b6a13fb1884c5c9700a0913b94e0ac)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:07.687702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: WARNING py.warnings [None req-ae553c10-6873-4d6b-b7ef-636e356361f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 09:39:07.687702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: warnings.warn(msg) May 27 09:39:07.687702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: May 27 09:39:07.688929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae553c10-6873-4d6b-b7ef-636e356361f5 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:07.718353 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:07.812739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ae553c10-6873-4d6b-b7ef-636e356361f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b6a13fb1884c5c9700a0913b94e0ac', 'request_id': 'req-ae553c10-6873-4d6b-b7ef-636e356361f5'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:07.822163 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ae553c10-6873-4d6b-b7ef-636e356361f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b6a13fb1884c5c9700a0913b94e0ac', 'request_id': 'req-ae553c10-6873-4d6b-b7ef-636e356361f5'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:07.835862 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ae553c10-6873-4d6b-b7ef-636e356361f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b6a13fb1884c5c9700a0913b94e0ac', 'request_id': 'req-ae553c10-6873-4d6b-b7ef-636e356361f5'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:07.875038 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ae553c10-6873-4d6b-b7ef-636e356361f5 admin admin] The token cache is being invalidate because project a3b6a13fb1884c5c9700a0913b94e0ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:07.875363 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ae553c10-6873-4d6b-b7ef-636e356361f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:07.876180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ae553c10-6873-4d6b-b7ef-636e356361f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:07.883822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 865/1711] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:07 2022] DELETE /identity/v3/projects/a3b6a13fb1884c5c9700a0913b94e0ac => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:07.884758 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae553c10-6873-4d6b-b7ef-636e356361f5 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:07.887015 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-ae553c10-6873-4d6b-b7ef-636e356361f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:07.902728 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b56f81-1f6d-47c6-a658-957e08059291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:07.913648 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b56f81-1f6d-47c6-a658-957e08059291 service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:07.956567 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 847/1712] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:07 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:07.962136 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617bf3a-f3d4-4ae8-a324-2e46e69b05ed None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:07.965659 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617bf3a-f3d4-4ae8-a324-2e46e69b05ed None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:07.966125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617bf3a-f3d4-4ae8-a324-2e46e69b05ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:08.021510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae553c10-6873-4d6b-b7ef-636e356361f5 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:08.035728 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef41107-1926-4826-8aa1-b5ccc2b9fa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:08.036469 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef41107-1926-4826-8aa1-b5ccc2b9fa78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:08.036676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef41107-1926-4826-8aa1-b5ccc2b9fa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:08.036950 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef41107-1926-4826-8aa1-b5ccc2b9fa78 admin admin] PATH_INFO: `/v3/users/fb728d89323546bd94c9fba59b6afbd0` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:08.042668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef41107-1926-4826-8aa1-b5ccc2b9fa78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb728d89323546bd94c9fba59b6afbd0)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:08.044862 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef41107-1926-4826-8aa1-b5ccc2b9fa78 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:08.046827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:08.136183 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-1ef41107-1926-4826-8aa1-b5ccc2b9fa78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb728d89323546bd94c9fba59b6afbd0'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:08.136895 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-1ef41107-1926-4826-8aa1-b5ccc2b9fa78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb728d89323546bd94c9fba59b6afbd0'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:08.153372 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-1ef41107-1926-4826-8aa1-b5ccc2b9fa78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb728d89323546bd94c9fba59b6afbd0'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:08.154894 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-1ef41107-1926-4826-8aa1-b5ccc2b9fa78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb728d89323546bd94c9fba59b6afbd0'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:08.166813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-f617bf3a-f3d4-4ae8-a324-2e46e69b05ed None None] MFA Rules not processed for user `1331ba69eaec44dd9bd8f8db7d53ba5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:08.183525 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f617bf3a-f3d4-4ae8-a324-2e46e69b05ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:08.183792 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-1ef41107-1926-4826-8aa1-b5ccc2b9fa78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb728d89323546bd94c9fba59b6afbd0'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:08.247156 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 866/1713] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:07 2022] DELETE /identity/v3/users/fb728d89323546bd94c9fba59b6afbd0 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:08.473687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 848/1714] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 516 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:08.490707 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bfac4-4819-4541-abb4-e60089210a2f None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:08.491736 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bfac4-4819-4541-abb4-e60089210a2f None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:08.491736 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bfac4-4819-4541-abb4-e60089210a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:08.555228 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-524bfac4-4819-4541-abb4-e60089210a2f None None] MFA Rules not processed for user `1331ba69eaec44dd9bd8f8db7d53ba5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:08.559805 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-524bfac4-4819-4541-abb4-e60089210a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:08.840805 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 867/1715] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:08.851340 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617bf3a-f3d4-4ae8-a324-2e46e69b05ed None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:08.854499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f617bf3a-f3d4-4ae8-a324-2e46e69b05ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:09.227522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617bf3a-f3d4-4ae8-a324-2e46e69b05ed None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:09.424246 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:09.497725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5cbef-14d4-45bf-bf9f-baae2e67069a None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:09.498285 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5cbef-14d4-45bf-bf9f-baae2e67069a None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:09.498397 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5cbef-14d4-45bf-bf9f-baae2e67069a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:09.541680 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a8a9a-1810-459a-9be6-a8ac843528f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:09.546702 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a8a9a-1810-459a-9be6-a8ac843528f4 service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:09.547159 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a8a9a-1810-459a-9be6-a8ac843528f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:09.547569 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a8a9a-1810-459a-9be6-a8ac843528f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:09.583668 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a8a9a-1810-459a-9be6-a8ac843528f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:09.585460 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a8a9a-1810-459a-9be6-a8ac843528f4 service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:09.618512 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 849/1716] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 769 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:09.619691 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a8a9a-1810-459a-9be6-a8ac843528f4 service nova] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:09.622444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-74a5cbef-14d4-45bf-bf9f-baae2e67069a None None] MFA Rules not processed for user `2463c2327e364ca996768e3eb6ef6316`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:09.623976 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-74a5cbef-14d4-45bf-bf9f-baae2e67069a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:09.624178 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-025a8a9a-1810-459a-9be6-a8ac843528f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:09.831869 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 868/1717] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:09.857669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5cbef-14d4-45bf-bf9f-baae2e67069a None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:09.859714 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-74a5cbef-14d4-45bf-bf9f-baae2e67069a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:09.888479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5cbef-14d4-45bf-bf9f-baae2e67069a None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:09.890833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a8a9a-1810-459a-9be6-a8ac843528f4 service nova] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:09.911983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319d523-7bde-4f6a-a388-da9477e89994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:09.916043 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0aaaf-2f3e-4dd2-9136-4d1d85f4ff00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:09.916208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319d523-7bde-4f6a-a388-da9477e89994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:09.916208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319d523-7bde-4f6a-a388-da9477e89994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:09.916397 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0aaaf-2f3e-4dd2-9136-4d1d85f4ff00 service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:09.916397 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0aaaf-2f3e-4dd2-9136-4d1d85f4ff00 service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:09.917628 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0aaaf-2f3e-4dd2-9136-4d1d85f4ff00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:09.920210 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319d523-7bde-4f6a-a388-da9477e89994 admin admin] PATH_INFO: `/v3/projects/bb068315dab546399f08e56703237783` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:09.928097 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319d523-7bde-4f6a-a388-da9477e89994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb068315dab546399f08e56703237783)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:09.943509 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319d523-7bde-4f6a-a388-da9477e89994 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:09.968794 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0aaaf-2f3e-4dd2-9136-4d1d85f4ff00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:09.977586 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0aaaf-2f3e-4dd2-9136-4d1d85f4ff00 service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:10.011564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:10.040493 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 869/1718] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:10.153450 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-9319d523-7bde-4f6a-a388-da9477e89994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb068315dab546399f08e56703237783', 'request_id': 'req-9319d523-7bde-4f6a-a388-da9477e89994'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:10.168954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-9319d523-7bde-4f6a-a388-da9477e89994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb068315dab546399f08e56703237783', 'request_id': 'req-9319d523-7bde-4f6a-a388-da9477e89994'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:10.184820 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-9319d523-7bde-4f6a-a388-da9477e89994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb068315dab546399f08e56703237783', 'request_id': 'req-9319d523-7bde-4f6a-a388-da9477e89994'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:10.218369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-9319d523-7bde-4f6a-a388-da9477e89994 admin admin] The token cache is being invalidate because project bb068315dab546399f08e56703237783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:10.218676 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-9319d523-7bde-4f6a-a388-da9477e89994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:10.220517 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-9319d523-7bde-4f6a-a388-da9477e89994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:10.225377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 850/1719] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:09 2022] DELETE /identity/v3/projects/bb068315dab546399f08e56703237783 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:10.231184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6cf91-6642-4bbb-aea3-3b7c1baf8189 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:10.231730 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6cf91-6642-4bbb-aea3-3b7c1baf8189 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:10.232208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6cf91-6642-4bbb-aea3-3b7c1baf8189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:10.281226 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-63e6cf91-6642-4bbb-aea3-3b7c1baf8189 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:10.282508 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-63e6cf91-6642-4bbb-aea3-3b7c1baf8189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:10.462416 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 870/1720] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:10.463015 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c25d3-4782-4123-ae28-921dd2b3aaee None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:10.463418 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c25d3-4782-4123-ae28-921dd2b3aaee None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:10.463876 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c25d3-4782-4123-ae28-921dd2b3aaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:10.504574 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-761c25d3-4782-4123-ae28-921dd2b3aaee None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:10.510206 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-761c25d3-4782-4123-ae28-921dd2b3aaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:10.545976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 851/1721] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:10.555860 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6cf91-6642-4bbb-aea3-3b7c1baf8189 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:10.575479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6cf91-6642-4bbb-aea3-3b7c1baf8189 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:10.591132 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d29cc4-ea07-49ec-9cd2-ae883723b703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:10.593310 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d29cc4-ea07-49ec-9cd2-ae883723b703 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:10.594447 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d29cc4-ea07-49ec-9cd2-ae883723b703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:10.599585 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d29cc4-ea07-49ec-9cd2-ae883723b703 admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:10.601995 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d29cc4-ea07-49ec-9cd2-ae883723b703 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:39:10.604443 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d29cc4-ea07-49ec-9cd2-ae883723b703 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:10.610931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d29cc4-ea07-49ec-9cd2-ae883723b703 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:10.659739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 871/1722] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:39:10.659881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c25d3-4782-4123-ae28-921dd2b3aaee None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:10.673570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c25d3-4782-4123-ae28-921dd2b3aaee None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:10.711628 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366d1c0-6051-4af9-9f3a-9942cdd60053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:10.718577 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366d1c0-6051-4af9-9f3a-9942cdd60053 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:10.718936 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366d1c0-6051-4af9-9f3a-9942cdd60053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:10.721755 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366d1c0-6051-4af9-9f3a-9942cdd60053 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:10.723039 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366d1c0-6051-4af9-9f3a-9942cdd60053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:10.726868 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366d1c0-6051-4af9-9f3a-9942cdd60053 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:10.802136 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 852/1723] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:10 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:39:10.808278 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d29cc4-ea07-49ec-9cd2-ae883723b703 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:10.829671 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d29cc4-ea07-49ec-9cd2-ae883723b703 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:11.129555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84ccaa-9417-4fc8-a358-ae132dea9605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:11.131521 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84ccaa-9417-4fc8-a358-ae132dea9605 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:11.131815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84ccaa-9417-4fc8-a358-ae132dea9605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:11.132527 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84ccaa-9417-4fc8-a358-ae132dea9605 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:11.134385 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84ccaa-9417-4fc8-a358-ae132dea9605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:11.138036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84ccaa-9417-4fc8-a358-ae132dea9605 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:11.207776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 872/1724] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:10 2022] POST /identity/v3/users => generated 294 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:11.208815 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366d1c0-6051-4af9-9f3a-9942cdd60053 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:11.231556 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366d1c0-6051-4af9-9f3a-9942cdd60053 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:11.251508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e79f0-a7e9-47b0-b443-e67e4e6149d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:11.255375 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e79f0-a7e9-47b0-b443-e67e4e6149d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:11.257676 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e79f0-a7e9-47b0-b443-e67e4e6149d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:11.258696 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e79f0-a7e9-47b0-b443-e67e4e6149d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:11.263417 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e79f0-a7e9-47b0-b443-e67e4e6149d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:11.267551 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e79f0-a7e9-47b0-b443-e67e4e6149d9 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:11.332099 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 853/1725] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:39:11.337479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84ccaa-9417-4fc8-a358-ae132dea9605 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:11.353590 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84ccaa-9417-4fc8-a358-ae132dea9605 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:11.361139 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a27df-5477-4058-9f7d-d8ba21868f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:11.362122 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a27df-5477-4058-9f7d-d8ba21868f86 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:11.362746 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a27df-5477-4058-9f7d-d8ba21868f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:11.363354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a27df-5477-4058-9f7d-d8ba21868f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:11.364409 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a27df-5477-4058-9f7d-d8ba21868f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:11.366736 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a27df-5477-4058-9f7d-d8ba21868f86 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:11.389350 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e79f0-a7e9-47b0-b443-e67e4e6149d9 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:11.400883 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 873/1726] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:11.404303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e79f0-a7e9-47b0-b443-e67e4e6149d9 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:11.410015 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09d470-f217-478a-a56f-f87eedb566b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:11.411296 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09d470-f217-478a-a56f-f87eedb566b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:11.411835 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09d470-f217-478a-a56f-f87eedb566b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:11.413172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09d470-f217-478a-a56f-f87eedb566b4 admin admin] PATH_INFO: `/v3/projects/d43eab32ab3043f3921055b60f21c944/users/3ceb9b55c4a1481da6650f17ad4d1b1a/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:11.438033 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:11.447149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09d470-f217-478a-a56f-f87eedb566b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d43eab32ab3043f3921055b60f21c944, user_id=3ceb9b55c4a1481da6650f17ad4d1b1a, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:11.453840 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09d470-f217-478a-a56f-f87eedb566b4 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:11.506627 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 854/1727] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:11 2022] PUT /identity/v3/projects/d43eab32ab3043f3921055b60f21c944/users/3ceb9b55c4a1481da6650f17ad4d1b1a/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:11.508606 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aff893-60a2-407f-af03-dc09f6245b78 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:11.510217 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aff893-60a2-407f-af03-dc09f6245b78 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:11.511035 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aff893-60a2-407f-af03-dc09f6245b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:11.558814 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-d9aff893-60a2-407f-af03-dc09f6245b78 None None] MFA Rules not processed for user `3ceb9b55c4a1481da6650f17ad4d1b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:11.560602 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d9aff893-60a2-407f-af03-dc09f6245b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:11.701463 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09d470-f217-478a-a56f-f87eedb566b4 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:11.703965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-2f09d470-f217-478a-a56f-f87eedb566b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:11.775245 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:11.812489 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 874/1728] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:11.817845 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aff893-60a2-407f-af03-dc09f6245b78 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:11.987623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09d470-f217-478a-a56f-f87eedb566b4 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:11.993116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3bc38-0373-41d4-8cd5-09f98db7ba0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:11.994154 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3bc38-0373-41d4-8cd5-09f98db7ba0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:11.994452 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3bc38-0373-41d4-8cd5-09f98db7ba0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:11.994720 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3bc38-0373-41d4-8cd5-09f98db7ba0d admin admin] PATH_INFO: `/v3/users/5372784e6c5c4b1fb7fd3b5174530ed5` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:11.996613 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3bc38-0373-41d4-8cd5-09f98db7ba0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5372784e6c5c4b1fb7fd3b5174530ed5)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:11.999005 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3bc38-0373-41d4-8cd5-09f98db7ba0d admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:12.076071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aff893-60a2-407f-af03-dc09f6245b78 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:12.115495 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4a4b9-1da6-4491-85fc-d2300f9ea511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:12.120894 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4a4b9-1da6-4491-85fc-d2300f9ea511 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:12.121155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4a4b9-1da6-4491-85fc-d2300f9ea511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:12.121435 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4a4b9-1da6-4491-85fc-d2300f9ea511 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:12.131338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4a4b9-1da6-4491-85fc-d2300f9ea511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:12.136467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4a4b9-1da6-4491-85fc-d2300f9ea511 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:12.303627 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-77d3bc38-0373-41d4-8cd5-09f98db7ba0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5372784e6c5c4b1fb7fd3b5174530ed5'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:12.337968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 875/1729] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:11 2022] POST /identity/v3/projects => generated 387 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:12.343038 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-77d3bc38-0373-41d4-8cd5-09f98db7ba0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5372784e6c5c4b1fb7fd3b5174530ed5'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:12.345336 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4a4b9-1da6-4491-85fc-d2300f9ea511 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:12.345804 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-77d3bc38-0373-41d4-8cd5-09f98db7ba0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5372784e6c5c4b1fb7fd3b5174530ed5'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:12.393844 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-77d3bc38-0373-41d4-8cd5-09f98db7ba0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5372784e6c5c4b1fb7fd3b5174530ed5'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:12.421705 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-77d3bc38-0373-41d4-8cd5-09f98db7ba0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5372784e6c5c4b1fb7fd3b5174530ed5'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:12.435072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 855/1730] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:11 2022] DELETE /identity/v3/users/5372784e6c5c4b1fb7fd3b5174530ed5 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:12.436594 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afb616-4721-4791-9f4a-69a79932a33c None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:12.436890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afb616-4721-4791-9f4a-69a79932a33c None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:12.437173 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afb616-4721-4791-9f4a-69a79932a33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:12.484265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-f7afb616-4721-4791-9f4a-69a79932a33c None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:12.485223 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f7afb616-4721-4791-9f4a-69a79932a33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:12.560240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4a4b9-1da6-4491-85fc-d2300f9ea511 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:12.795593 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 856/1731] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:12.817318 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afb616-4721-4791-9f4a-69a79932a33c None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:12.823451 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f7afb616-4721-4791-9f4a-69a79932a33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:12.833850 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014235e7-dad7-4df9-a09e-0b0b2f11e0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:12.838832 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014235e7-dad7-4df9-a09e-0b0b2f11e0da admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:12.839205 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014235e7-dad7-4df9-a09e-0b0b2f11e0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:12.840469 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014235e7-dad7-4df9-a09e-0b0b2f11e0da admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:12.841287 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014235e7-dad7-4df9-a09e-0b0b2f11e0da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:12.846400 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014235e7-dad7-4df9-a09e-0b0b2f11e0da admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:12.881581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:12.902094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 876/1732] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:12 2022] POST /identity/v3/users => generated 300 bytes in 556 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:12.904985 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014235e7-dad7-4df9-a09e-0b0b2f11e0da admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:12.909079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-014235e7-dad7-4df9-a09e-0b0b2f11e0da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:12.941781 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014235e7-dad7-4df9-a09e-0b0b2f11e0da admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:12.967843 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645d2df-872c-477a-883b-d11d4e5930b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:12.968552 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645d2df-872c-477a-883b-d11d4e5930b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:12.968843 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645d2df-872c-477a-883b-d11d4e5930b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:12.969183 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645d2df-872c-477a-883b-d11d4e5930b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:12.969941 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645d2df-872c-477a-883b-d11d4e5930b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:12.975406 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645d2df-872c-477a-883b-d11d4e5930b1 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:13.024589 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 877/1733] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:13.025619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645d2df-872c-477a-883b-d11d4e5930b1 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:13.063397 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645d2df-872c-477a-883b-d11d4e5930b1 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:13.064607 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afb616-4721-4791-9f4a-69a79932a33c None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:13.088727 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1ae58-aed2-4b3d-b783-710d71f73605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:13.089896 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1ae58-aed2-4b3d-b783-710d71f73605 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:13.090569 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1ae58-aed2-4b3d-b783-710d71f73605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:13.090970 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1ae58-aed2-4b3d-b783-710d71f73605 admin admin] PATH_INFO: `/v3/projects/786edc12bdb941679adf96e2040ee682/users/59e7fd4706b545a7938fcb325cf50e70/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:13.095617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:13.104105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6f41f-d6cb-41c2-aa8a-3f67739a51fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:13.111054 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6f41f-d6cb-41c2-aa8a-3f67739a51fc service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:13.111381 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6f41f-d6cb-41c2-aa8a-3f67739a51fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:13.111700 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6f41f-d6cb-41c2-aa8a-3f67739a51fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:13.179421 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6f41f-d6cb-41c2-aa8a-3f67739a51fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:13.182922 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1ae58-aed2-4b3d-b783-710d71f73605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=786edc12bdb941679adf96e2040ee682, user_id=59e7fd4706b545a7938fcb325cf50e70, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:13.187116 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1ae58-aed2-4b3d-b783-710d71f73605 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:13.190589 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6f41f-d6cb-41c2-aa8a-3f67739a51fc service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:13.217893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 878/1734] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:13 2022] PUT /identity/v3/projects/786edc12bdb941679adf96e2040ee682/users/59e7fd4706b545a7938fcb325cf50e70/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:13.222103 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1ae58-aed2-4b3d-b783-710d71f73605 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:13.269465 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 857/1735] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:13.481875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1ae58-aed2-4b3d-b783-710d71f73605 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:13.489694 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b548218-25ec-44b9-9162-78d2119f8822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:13.491917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b548218-25ec-44b9-9162-78d2119f8822 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:13.492609 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b548218-25ec-44b9-9162-78d2119f8822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:13.494332 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b548218-25ec-44b9-9162-78d2119f8822 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:13.495626 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b548218-25ec-44b9-9162-78d2119f8822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:13.498132 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b548218-25ec-44b9-9162-78d2119f8822 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:13.520317 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 879/1736] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:13.523675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6f41f-d6cb-41c2-aa8a-3f67739a51fc service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:13.540166 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6f41f-d6cb-41c2-aa8a-3f67739a51fc service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:13.564870 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d07251-65f9-40a9-b32c-6feb40011099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:13.565914 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d07251-65f9-40a9-b32c-6feb40011099 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:13.566271 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d07251-65f9-40a9-b32c-6feb40011099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:13.566611 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d07251-65f9-40a9-b32c-6feb40011099 admin admin] PATH_INFO: `/v3/projects/786edc12bdb941679adf96e2040ee682/users/59e7fd4706b545a7938fcb325cf50e70/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:13.575755 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d07251-65f9-40a9-b32c-6feb40011099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=786edc12bdb941679adf96e2040ee682, user_id=59e7fd4706b545a7938fcb325cf50e70, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:13.586164 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d07251-65f9-40a9-b32c-6feb40011099 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:13.641558 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 858/1737] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:13 2022] PUT /identity/v3/projects/786edc12bdb941679adf96e2040ee682/users/59e7fd4706b545a7938fcb325cf50e70/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:13.654687 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536004b-a59b-4dd4-90ec-759d1a3a5e89 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:13.658256 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536004b-a59b-4dd4-90ec-759d1a3a5e89 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:13.659652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536004b-a59b-4dd4-90ec-759d1a3a5e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:13.680484 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d07251-65f9-40a9-b32c-6feb40011099 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:13.685119 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-c5d07251-65f9-40a9-b32c-6feb40011099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:13.808912 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-d536004b-a59b-4dd4-90ec-759d1a3a5e89 None None] MFA Rules not processed for user `59e7fd4706b545a7938fcb325cf50e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:13.818098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d536004b-a59b-4dd4-90ec-759d1a3a5e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:13.990459 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d07251-65f9-40a9-b32c-6feb40011099 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:14.004544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b1d71-d7f3-400d-aa38-0f595f41355f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:14.005610 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b1d71-d7f3-400d-aa38-0f595f41355f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:14.005912 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b1d71-d7f3-400d-aa38-0f595f41355f admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:14.006165 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b1d71-d7f3-400d-aa38-0f595f41355f admin admin] PATH_INFO: `/v3/users/419801de50d14e2f94502d095b9cbbb6` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:14.008356 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b1d71-d7f3-400d-aa38-0f595f41355f admin admin] RBAC: Authorizing `identity:delete_user(user_id=419801de50d14e2f94502d095b9cbbb6)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:14.015409 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b1d71-d7f3-400d-aa38-0f595f41355f admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:14.138406 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 880/1738] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:14.150940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536004b-a59b-4dd4-90ec-759d1a3a5e89 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:14.154066 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d536004b-a59b-4dd4-90ec-759d1a3a5e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:14.156507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-8a8b1d71-d7f3-400d-aa38-0f595f41355f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '419801de50d14e2f94502d095b9cbbb6'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:14.169684 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-8a8b1d71-d7f3-400d-aa38-0f595f41355f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '419801de50d14e2f94502d095b9cbbb6'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:14.170550 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-8a8b1d71-d7f3-400d-aa38-0f595f41355f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '419801de50d14e2f94502d095b9cbbb6'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:14.190450 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-8a8b1d71-d7f3-400d-aa38-0f595f41355f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '419801de50d14e2f94502d095b9cbbb6'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:14.209953 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-8a8b1d71-d7f3-400d-aa38-0f595f41355f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '419801de50d14e2f94502d095b9cbbb6'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:14.228088 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 859/1739] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:13 2022] DELETE /identity/v3/users/419801de50d14e2f94502d095b9cbbb6 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:14.230073 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0b5d0-6d83-4d7f-8362-20d550e9c8ff None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:14.230366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0b5d0-6d83-4d7f-8362-20d550e9c8ff None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:14.230690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0b5d0-6d83-4d7f-8362-20d550e9c8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:14.258659 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-60e0b5d0-6d83-4d7f-8362-20d550e9c8ff None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:14.260622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-60e0b5d0-6d83-4d7f-8362-20d550e9c8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:14.286613 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:14.395827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536004b-a59b-4dd4-90ec-759d1a3a5e89 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:14.441481 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:14.477106 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 860/1740] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:14.485197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdaca4e-492f-43f7-a367-36c8c8c35916 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:14.485557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdaca4e-492f-43f7-a367-36c8c8c35916 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:14.485843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdaca4e-492f-43f7-a367-36c8c8c35916 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:14.497239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 861/1741] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 09:39:14 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:39:14.502666 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1b9ef-6bca-442a-b880-974d33709850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:14.503720 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1b9ef-6bca-442a-b880-974d33709850 service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:14.504279 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1b9ef-6bca-442a-b880-974d33709850 service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:14.504793 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1b9ef-6bca-442a-b880-974d33709850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:14.507213 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-16f1b9ef-6bca-442a-b880-974d33709850 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:14.515958 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdaca4e-492f-43f7-a367-36c8c8c35916 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:14.518033 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-9fdaca4e-492f-43f7-a367-36c8c8c35916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:14.609377 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1b9ef-6bca-442a-b880-974d33709850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:14.611306 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1b9ef-6bca-442a-b880-974d33709850 service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:14.664298 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 881/1742] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:14.670963 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95332ab7-40c9-4a41-bdf9-9cb80c57bc66 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:14.673796 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95332ab7-40c9-4a41-bdf9-9cb80c57bc66 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:14.674700 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95332ab7-40c9-4a41-bdf9-9cb80c57bc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:14.742384 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-95332ab7-40c9-4a41-bdf9-9cb80c57bc66 None None] MFA Rules not processed for user `d2b1c12e88c549208894fc0dd0c60b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:14.747334 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdaca4e-492f-43f7-a367-36c8c8c35916 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:14.753552 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-95332ab7-40c9-4a41-bdf9-9cb80c57bc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:14.753991 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a155f-4909-4d15-b715-fc6c58d6e49e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:14.756920 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a155f-4909-4d15-b715-fc6c58d6e49e service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:14.757224 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a155f-4909-4d15-b715-fc6c58d6e49e service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:14.757490 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a155f-4909-4d15-b715-fc6c58d6e49e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:14.778707 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a155f-4909-4d15-b715-fc6c58d6e49e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:14.782836 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a155f-4909-4d15-b715-fc6c58d6e49e service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:14.829766 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 862/1743] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:14.837249 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a155f-4909-4d15-b715-fc6c58d6e49e service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:14.848184 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-fb0a155f-4909-4d15-b715-fc6c58d6e49e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:14.898399 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a155f-4909-4d15-b715-fc6c58d6e49e service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:14.918376 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23841e14-f187-4a7e-88f5-ce79ec4c989e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:14.919295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23841e14-f187-4a7e-88f5-ce79ec4c989e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:14.919578 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23841e14-f187-4a7e-88f5-ce79ec4c989e admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:14.919852 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23841e14-f187-4a7e-88f5-ce79ec4c989e admin admin] PATH_INFO: `/v3/users/3ceb9b55c4a1481da6650f17ad4d1b1a` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:14.921412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23841e14-f187-4a7e-88f5-ce79ec4c989e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ceb9b55c4a1481da6650f17ad4d1b1a)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:14.926048 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23841e14-f187-4a7e-88f5-ce79ec4c989e admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:15.044315 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 882/1744] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 09:39:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:15.056010 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-23841e14-f187-4a7e-88f5-ce79ec4c989e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ceb9b55c4a1481da6650f17ad4d1b1a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:15.066222 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-23841e14-f187-4a7e-88f5-ce79ec4c989e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ceb9b55c4a1481da6650f17ad4d1b1a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:15.066960 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-23841e14-f187-4a7e-88f5-ce79ec4c989e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ceb9b55c4a1481da6650f17ad4d1b1a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:15.083896 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-23841e14-f187-4a7e-88f5-ce79ec4c989e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ceb9b55c4a1481da6650f17ad4d1b1a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:15.103207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-23841e14-f187-4a7e-88f5-ce79ec4c989e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ceb9b55c4a1481da6650f17ad4d1b1a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:15.120692 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 863/1745] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:14 2022] DELETE /identity/v3/users/3ceb9b55c4a1481da6650f17ad4d1b1a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:15.125844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a09ce6-23ce-45d8-b731-ef58f5d6bb26 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:15.126322 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a09ce6-23ce-45d8-b731-ef58f5d6bb26 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:15.126796 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a09ce6-23ce-45d8-b731-ef58f5d6bb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:15.163325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-02a09ce6-23ce-45d8-b731-ef58f5d6bb26 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:15.177555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-02a09ce6-23ce-45d8-b731-ef58f5d6bb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:15.342473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23841e14-f187-4a7e-88f5-ce79ec4c989e admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:15.344836 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-23841e14-f187-4a7e-88f5-ce79ec4c989e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:15.489888 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 883/1746] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:15.491257 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57daf0c-1cf2-4d54-ad80-091d1279f806 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:15.494110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57daf0c-1cf2-4d54-ad80-091d1279f806 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:15.494407 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57daf0c-1cf2-4d54-ad80-091d1279f806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:15.508589 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:15.508724 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:15.539967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-a57daf0c-1cf2-4d54-ad80-091d1279f806 None None] MFA Rules not processed for user `1331ba69eaec44dd9bd8f8db7d53ba5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:15.543348 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-a57daf0c-1cf2-4d54-ad80-091d1279f806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:15.602400 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23841e14-f187-4a7e-88f5-ce79ec4c989e admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:15.617873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21dfbf-3d2d-4b25-8572-b970a58ac47a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:15.618786 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21dfbf-3d2d-4b25-8572-b970a58ac47a service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:15.619078 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21dfbf-3d2d-4b25-8572-b970a58ac47a service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:15.619388 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21dfbf-3d2d-4b25-8572-b970a58ac47a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:15.624584 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-3b21dfbf-3d2d-4b25-8572-b970a58ac47a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:15.666563 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21dfbf-3d2d-4b25-8572-b970a58ac47a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:15.670424 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21dfbf-3d2d-4b25-8572-b970a58ac47a service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:15.689125 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 884/1747] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:15.689724 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57daf0c-1cf2-4d54-ad80-091d1279f806 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:15.691926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-a57daf0c-1cf2-4d54-ad80-091d1279f806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:15.713263 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 864/1748] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:15.742606 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445357c5-a1b4-420d-bc7f-a5cd3e86384b None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:15.742606 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445357c5-a1b4-420d-bc7f-a5cd3e86384b None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:15.742606 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445357c5-a1b4-420d-bc7f-a5cd3e86384b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:15.857166 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-445357c5-a1b4-420d-bc7f-a5cd3e86384b None None] MFA Rules not processed for user `5b0d25ff6a664177b463b834124802d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:15.858410 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-445357c5-a1b4-420d-bc7f-a5cd3e86384b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:15.974959 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57daf0c-1cf2-4d54-ad80-091d1279f806 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:15.984785 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eaa7a5-6383-4444-9c59-88bf925ce518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:15.985449 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eaa7a5-6383-4444-9c59-88bf925ce518 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:15.985795 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eaa7a5-6383-4444-9c59-88bf925ce518 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:15.986384 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eaa7a5-6383-4444-9c59-88bf925ce518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:16.015637 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eaa7a5-6383-4444-9c59-88bf925ce518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:16.020003 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eaa7a5-6383-4444-9c59-88bf925ce518 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:16.048554 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 885/1749] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:16.049671 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eaa7a5-6383-4444-9c59-88bf925ce518 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:16.053100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-b6eaa7a5-6383-4444-9c59-88bf925ce518 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:16.091433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eaa7a5-6383-4444-9c59-88bf925ce518 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:16.105382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b5246-63a1-4798-916f-4f9e47812901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:16.106306 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b5246-63a1-4798-916f-4f9e47812901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:16.106591 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b5246-63a1-4798-916f-4f9e47812901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:16.106868 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b5246-63a1-4798-916f-4f9e47812901 admin admin] PATH_INFO: `/v3/projects/84755f8a60e0499dafa827933541e339` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:16.109559 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 865/1750] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:16.120517 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b5246-63a1-4798-916f-4f9e47812901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84755f8a60e0499dafa827933541e339)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:16.122606 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b5246-63a1-4798-916f-4f9e47812901 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:16.372375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-b25b5246-63a1-4798-916f-4f9e47812901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84755f8a60e0499dafa827933541e339', 'request_id': 'req-b25b5246-63a1-4798-916f-4f9e47812901'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:16.404301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-b25b5246-63a1-4798-916f-4f9e47812901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84755f8a60e0499dafa827933541e339', 'request_id': 'req-b25b5246-63a1-4798-916f-4f9e47812901'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:16.422370 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-b25b5246-63a1-4798-916f-4f9e47812901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84755f8a60e0499dafa827933541e339', 'request_id': 'req-b25b5246-63a1-4798-916f-4f9e47812901'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:16.479522 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-b25b5246-63a1-4798-916f-4f9e47812901 admin admin] The token cache is being invalidate because project 84755f8a60e0499dafa827933541e339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:16.484799 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-b25b5246-63a1-4798-916f-4f9e47812901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:16.488080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-b25b5246-63a1-4798-916f-4f9e47812901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:16.494530 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 886/1751] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:16 2022] DELETE /identity/v3/projects/84755f8a60e0499dafa827933541e339 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:16.499217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445357c5-a1b4-420d-bc7f-a5cd3e86384b None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:16.559497 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445357c5-a1b4-420d-bc7f-a5cd3e86384b None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:16.839602 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8895e-2985-46b7-8858-da1dd2ac3bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:16.846620 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8895e-2985-46b7-8858-da1dd2ac3bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:16.846920 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8895e-2985-46b7-8858-da1dd2ac3bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:16.847205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8895e-2985-46b7-8858-da1dd2ac3bd1 admin admin] PATH_INFO: `/v3/users/ee456e76b9614a98aeffb7093529d416` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:16.855581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8895e-2985-46b7-8858-da1dd2ac3bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee456e76b9614a98aeffb7093529d416)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:16.857708 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8895e-2985-46b7-8858-da1dd2ac3bd1 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:17.168588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-14b8895e-2985-46b7-8858-da1dd2ac3bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee456e76b9614a98aeffb7093529d416'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:17.190743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-14b8895e-2985-46b7-8858-da1dd2ac3bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee456e76b9614a98aeffb7093529d416'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:17.191664 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-14b8895e-2985-46b7-8858-da1dd2ac3bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee456e76b9614a98aeffb7093529d416'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:17.211653 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:17.225880 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-14b8895e-2985-46b7-8858-da1dd2ac3bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee456e76b9614a98aeffb7093529d416'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:17.242748 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-14b8895e-2985-46b7-8858-da1dd2ac3bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee456e76b9614a98aeffb7093529d416'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:17.267517 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 866/1752] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:16 2022] DELETE /identity/v3/users/ee456e76b9614a98aeffb7093529d416 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:39:17.322969 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b5246-63a1-4798-916f-4f9e47812901 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:17.325032 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-b25b5246-63a1-4798-916f-4f9e47812901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:17.360039 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b5246-63a1-4798-916f-4f9e47812901 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:17.558536 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:17.639116 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e2b92-8e26-4528-b8b6-3221483ffbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:17.640012 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e2b92-8e26-4528-b8b6-3221483ffbf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:17.640476 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e2b92-8e26-4528-b8b6-3221483ffbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:17.640985 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e2b92-8e26-4528-b8b6-3221483ffbf3 admin admin] PATH_INFO: `/v3/projects/d43eab32ab3043f3921055b60f21c944` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:17.644972 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e2b92-8e26-4528-b8b6-3221483ffbf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d43eab32ab3043f3921055b60f21c944)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:17.648177 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e2b92-8e26-4528-b8b6-3221483ffbf3 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:17.812962 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6c8e2b92-8e26-4528-b8b6-3221483ffbf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd43eab32ab3043f3921055b60f21c944', 'request_id': 'req-6c8e2b92-8e26-4528-b8b6-3221483ffbf3'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:17.849902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6c8e2b92-8e26-4528-b8b6-3221483ffbf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd43eab32ab3043f3921055b60f21c944', 'request_id': 'req-6c8e2b92-8e26-4528-b8b6-3221483ffbf3'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:17.875476 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6c8e2b92-8e26-4528-b8b6-3221483ffbf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd43eab32ab3043f3921055b60f21c944', 'request_id': 'req-6c8e2b92-8e26-4528-b8b6-3221483ffbf3'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:17.903057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6c8e2b92-8e26-4528-b8b6-3221483ffbf3 admin admin] The token cache is being invalidate because project d43eab32ab3043f3921055b60f21c944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:17.904402 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6c8e2b92-8e26-4528-b8b6-3221483ffbf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:17.910116 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6c8e2b92-8e26-4528-b8b6-3221483ffbf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:17.914795 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 887/1753] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:17 2022] DELETE /identity/v3/projects/d43eab32ab3043f3921055b60f21c944 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:17.918695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8895e-2985-46b7-8858-da1dd2ac3bd1 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:17.921616 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-14b8895e-2985-46b7-8858-da1dd2ac3bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:17.940721 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8895e-2985-46b7-8858-da1dd2ac3bd1 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:17.992650 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e2b92-8e26-4528-b8b6-3221483ffbf3 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:17.994442 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-6c8e2b92-8e26-4528-b8b6-3221483ffbf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:18.148875 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694085e1-d100-41d0-8846-ff2a7c095a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:18.150902 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694085e1-d100-41d0-8846-ff2a7c095a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:18.152031 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694085e1-d100-41d0-8846-ff2a7c095a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:18.153322 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694085e1-d100-41d0-8846-ff2a7c095a35 admin admin] PATH_INFO: `/v3/users/59e7fd4706b545a7938fcb325cf50e70` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:18.154892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694085e1-d100-41d0-8846-ff2a7c095a35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59e7fd4706b545a7938fcb325cf50e70)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:18.161682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694085e1-d100-41d0-8846-ff2a7c095a35 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:18.195551 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e2b92-8e26-4528-b8b6-3221483ffbf3 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:18.210740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3012400-6958-464d-a12d-94970cad4a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:18.211968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3012400-6958-464d-a12d-94970cad4a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:18.212361 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3012400-6958-464d-a12d-94970cad4a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:18.212807 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3012400-6958-464d-a12d-94970cad4a6f admin admin] PATH_INFO: `/v3/projects/3257639b05ab4533b294beeaf39f36f1` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:18.215865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3012400-6958-464d-a12d-94970cad4a6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3257639b05ab4533b294beeaf39f36f1)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:18.218957 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3012400-6958-464d-a12d-94970cad4a6f admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:18.266261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-694085e1-d100-41d0-8846-ff2a7c095a35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59e7fd4706b545a7938fcb325cf50e70'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:18.287064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-694085e1-d100-41d0-8846-ff2a7c095a35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59e7fd4706b545a7938fcb325cf50e70'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:18.288099 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-694085e1-d100-41d0-8846-ff2a7c095a35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59e7fd4706b545a7938fcb325cf50e70'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:18.322166 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-694085e1-d100-41d0-8846-ff2a7c095a35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59e7fd4706b545a7938fcb325cf50e70'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:18.328366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-a3012400-6958-464d-a12d-94970cad4a6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3257639b05ab4533b294beeaf39f36f1', 'request_id': 'req-a3012400-6958-464d-a12d-94970cad4a6f'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:18.340169 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-694085e1-d100-41d0-8846-ff2a7c095a35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59e7fd4706b545a7938fcb325cf50e70'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:18.346975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-a3012400-6958-464d-a12d-94970cad4a6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3257639b05ab4533b294beeaf39f36f1', 'request_id': 'req-a3012400-6958-464d-a12d-94970cad4a6f'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:18.350630 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 867/1754] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:17 2022] DELETE /identity/v3/users/59e7fd4706b545a7938fcb325cf50e70 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:18.363894 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-a3012400-6958-464d-a12d-94970cad4a6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3257639b05ab4533b294beeaf39f36f1', 'request_id': 'req-a3012400-6958-464d-a12d-94970cad4a6f'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:18.365462 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:18.389576 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-a3012400-6958-464d-a12d-94970cad4a6f admin admin] The token cache is being invalidate because project 3257639b05ab4533b294beeaf39f36f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:18.390515 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-a3012400-6958-464d-a12d-94970cad4a6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:18.392427 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-a3012400-6958-464d-a12d-94970cad4a6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:18.399604 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 888/1755] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:17 2022] DELETE /identity/v3/projects/3257639b05ab4533b294beeaf39f36f1 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:18.401960 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e339a0-b060-46a8-8c7d-9a085aa315f3 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:18.402253 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e339a0-b060-46a8-8c7d-9a085aa315f3 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:18.402590 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e339a0-b060-46a8-8c7d-9a085aa315f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:18.431590 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-83e339a0-b060-46a8-8c7d-9a085aa315f3 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:18.432890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-83e339a0-b060-46a8-8c7d-9a085aa315f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:18.532794 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 868/1756] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:18.536466 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ea505-5802-4335-aee8-b5272a0e800f None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:18.537019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ea505-5802-4335-aee8-b5272a0e800f None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:18.537532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ea505-5802-4335-aee8-b5272a0e800f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:18.564833 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-270ea505-5802-4335-aee8-b5272a0e800f None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:18.575593 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-270ea505-5802-4335-aee8-b5272a0e800f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:18.594534 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 889/1757] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:18.600364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e339a0-b060-46a8-8c7d-9a085aa315f3 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:18.607369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:18.613686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e339a0-b060-46a8-8c7d-9a085aa315f3 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:18.627220 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e53a7d-13c1-4f17-b24c-c76aec455ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:18.630188 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e53a7d-13c1-4f17-b24c-c76aec455ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:18.630994 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e53a7d-13c1-4f17-b24c-c76aec455ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:18.632403 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e53a7d-13c1-4f17-b24c-c76aec455ad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:18.633302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e53a7d-13c1-4f17-b24c-c76aec455ad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:39:18.634801 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e53a7d-13c1-4f17-b24c-c76aec455ad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:18.640522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e53a7d-13c1-4f17-b24c-c76aec455ad8 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:18.673692 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 869/1758] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:39:18.677522 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ea505-5802-4335-aee8-b5272a0e800f None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:18.687716 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ea505-5802-4335-aee8-b5272a0e800f None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:18.702575 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87619421-2f8c-46de-866f-1fb04c3c6d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:18.703430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87619421-2f8c-46de-866f-1fb04c3c6d33 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:18.703841 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87619421-2f8c-46de-866f-1fb04c3c6d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:18.705025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87619421-2f8c-46de-866f-1fb04c3c6d33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:18.706323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87619421-2f8c-46de-866f-1fb04c3c6d33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:18.709850 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87619421-2f8c-46de-866f-1fb04c3c6d33 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:18.772543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 890/1759] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:18 2022] POST /identity/v3/projects => generated 391 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:18.773938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e53a7d-13c1-4f17-b24c-c76aec455ad8 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:18.789492 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e53a7d-13c1-4f17-b24c-c76aec455ad8 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:18.914645 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415a6a5-af6b-41af-9a90-66b2bde10085 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:18.915233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415a6a5-af6b-41af-9a90-66b2bde10085 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:18.915721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415a6a5-af6b-41af-9a90-66b2bde10085 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:18.923341 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 891/1760] 10.222.0.41 () {54 vars in 912 bytes} [Fri May 27 09:39:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:39:18.934900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd2451-cf4f-4268-b3e3-5ff9a58e31e9 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:18.935556 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd2451-cf4f-4268-b3e3-5ff9a58e31e9 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:18.936761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd2451-cf4f-4268-b3e3-5ff9a58e31e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:18.972578 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa4eea-ae19-40e3-a958-5474fa9e29e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:18.974890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa4eea-ae19-40e3-a958-5474fa9e29e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:18.975255 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa4eea-ae19-40e3-a958-5474fa9e29e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:18.975631 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa4eea-ae19-40e3-a958-5474fa9e29e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:18.976613 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa4eea-ae19-40e3-a958-5474fa9e29e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:18.984464 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa4eea-ae19-40e3-a958-5474fa9e29e6 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:18.987323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-56cd2451-cf4f-4268-b3e3-5ff9a58e31e9 None None] MFA Rules not processed for user `c1103a08484048da82c5e4627552253e`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:18.988430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-56cd2451-cf4f-4268-b3e3-5ff9a58e31e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:19.027570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 870/1761] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:18 2022] POST /identity/v3/users => generated 296 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:19.030023 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa4eea-ae19-40e3-a958-5474fa9e29e6 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:19.032651 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-67aa4eea-ae19-40e3-a958-5474fa9e29e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:19.060978 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa4eea-ae19-40e3-a958-5474fa9e29e6 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:19.072096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e1123-07f5-465d-baa8-c975934694dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:19.076105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e1123-07f5-465d-baa8-c975934694dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:19.076860 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e1123-07f5-465d-baa8-c975934694dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:19.077481 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e1123-07f5-465d-baa8-c975934694dd admin admin] PATH_INFO: `/v3/projects/97ea2c06722447ea9af654b260acd724` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:19.082390 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e1123-07f5-465d-baa8-c975934694dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=97ea2c06722447ea9af654b260acd724)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:19.086101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e1123-07f5-465d-baa8-c975934694dd admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:19.119182 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 892/1762] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 09:39:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:19.120228 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd2451-cf4f-4268-b3e3-5ff9a58e31e9 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:19.133433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd2451-cf4f-4268-b3e3-5ff9a58e31e9 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:19.145537 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bfabe-0412-43e0-a8e2-0611318f2fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:19.146167 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bfabe-0412-43e0-a8e2-0611318f2fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:19.146456 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bfabe-0412-43e0-a8e2-0611318f2fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:19.146741 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bfabe-0412-43e0-a8e2-0611318f2fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:19.147735 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bfabe-0412-43e0-a8e2-0611318f2fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:19.151215 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bfabe-0412-43e0-a8e2-0611318f2fb6 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:19.164579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 893/1763] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:19.165032 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bfabe-0412-43e0-a8e2-0611318f2fb6 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:19.168577 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-033bfabe-0412-43e0-a8e2-0611318f2fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:19.182900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bfabe-0412-43e0-a8e2-0611318f2fb6 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:19.190678 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e08e1123-07f5-465d-baa8-c975934694dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97ea2c06722447ea9af654b260acd724', 'request_id': 'req-e08e1123-07f5-465d-baa8-c975934694dd'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:19.221970 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e08e1123-07f5-465d-baa8-c975934694dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97ea2c06722447ea9af654b260acd724', 'request_id': 'req-e08e1123-07f5-465d-baa8-c975934694dd'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:19.240930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e08e1123-07f5-465d-baa8-c975934694dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97ea2c06722447ea9af654b260acd724', 'request_id': 'req-e08e1123-07f5-465d-baa8-c975934694dd'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:19.255615 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e08e1123-07f5-465d-baa8-c975934694dd admin admin] The token cache is being invalidate because project 97ea2c06722447ea9af654b260acd724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:19.255919 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e08e1123-07f5-465d-baa8-c975934694dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:19.256677 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e08e1123-07f5-465d-baa8-c975934694dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:19.258697 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 871/1764] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:19 2022] DELETE /identity/v3/projects/97ea2c06722447ea9af654b260acd724 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:19.259614 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e1123-07f5-465d-baa8-c975934694dd admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:19.261532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e08e1123-07f5-465d-baa8-c975934694dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:19.293775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9a85a-4cc3-42e9-abe4-19e4a72cf15b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:19.295491 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9a85a-4cc3-42e9-abe4-19e4a72cf15b service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:19.295937 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9a85a-4cc3-42e9-abe4-19e4a72cf15b service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:19.296354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9a85a-4cc3-42e9-abe4-19e4a72cf15b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:19.298538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-11a9a85a-4cc3-42e9-abe4-19e4a72cf15b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:19.309922 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9a85a-4cc3-42e9-abe4-19e4a72cf15b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:19.313005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9a85a-4cc3-42e9-abe4-19e4a72cf15b service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:19.334013 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 894/1765] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:19.335109 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9a85a-4cc3-42e9-abe4-19e4a72cf15b service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:19.339089 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-11a9a85a-4cc3-42e9-abe4-19e4a72cf15b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:19.348212 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e1123-07f5-465d-baa8-c975934694dd admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:19.354081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9aad8-7fb4-40ff-ae7a-866f0508d5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:19.354819 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9aad8-7fb4-40ff-ae7a-866f0508d5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:19.355114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9aad8-7fb4-40ff-ae7a-866f0508d5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:19.355495 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9aad8-7fb4-40ff-ae7a-866f0508d5b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:19.356439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9aad8-7fb4-40ff-ae7a-866f0508d5b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:19.358390 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9aad8-7fb4-40ff-ae7a-866f0508d5b8 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:19.366635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:19.370803 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9a85a-4cc3-42e9-abe4-19e4a72cf15b service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:19.375399 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 872/1766] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:19.377246 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9aad8-7fb4-40ff-ae7a-866f0508d5b8 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:19.389543 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9aad8-7fb4-40ff-ae7a-866f0508d5b8 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:19.392137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fca59-b6da-434e-b251-ee18202fa3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:19.394502 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fca59-b6da-434e-b251-ee18202fa3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:19.395164 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fca59-b6da-434e-b251-ee18202fa3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:19.395553 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162accc9-cdc0-4d74-98bd-48a12aa3b20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:19.395836 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fca59-b6da-434e-b251-ee18202fa3f4 admin admin] PATH_INFO: `/v3/users/05bc3a5eeb6b4c2fbb72ef58dfe36ec3` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:19.396643 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162accc9-cdc0-4d74-98bd-48a12aa3b20f admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:19.396916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162accc9-cdc0-4d74-98bd-48a12aa3b20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:19.398165 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fca59-b6da-434e-b251-ee18202fa3f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05bc3a5eeb6b4c2fbb72ef58dfe36ec3)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:19.402264 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fca59-b6da-434e-b251-ee18202fa3f4 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:19.403457 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162accc9-cdc0-4d74-98bd-48a12aa3b20f admin admin] PATH_INFO: `/v3/projects/008091b03d6e48809bbe2bf9be881f6b/users/d1cc037de16940009399412a85bcf529/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:19.431837 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162accc9-cdc0-4d74-98bd-48a12aa3b20f admin admin] RBAC: Authorizing `identity:create_grant(project_id=008091b03d6e48809bbe2bf9be881f6b, user_id=d1cc037de16940009399412a85bcf529, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:19.437130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162accc9-cdc0-4d74-98bd-48a12aa3b20f admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:19.476172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 873/1767] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:19 2022] PUT /identity/v3/projects/008091b03d6e48809bbe2bf9be881f6b/users/d1cc037de16940009399412a85bcf529/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:19.477980 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482f36a-7db0-42fa-b656-2cc3589e0ec3 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:19.478341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482f36a-7db0-42fa-b656-2cc3589e0ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:19.478803 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482f36a-7db0-42fa-b656-2cc3589e0ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:19.478921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-de3fca59-b6da-434e-b251-ee18202fa3f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05bc3a5eeb6b4c2fbb72ef58dfe36ec3'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:19.479578 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-de3fca59-b6da-434e-b251-ee18202fa3f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05bc3a5eeb6b4c2fbb72ef58dfe36ec3'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:19.491405 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-de3fca59-b6da-434e-b251-ee18202fa3f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05bc3a5eeb6b4c2fbb72ef58dfe36ec3'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:19.493260 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-de3fca59-b6da-434e-b251-ee18202fa3f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05bc3a5eeb6b4c2fbb72ef58dfe36ec3'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:19.500949 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:19.511149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-4482f36a-7db0-42fa-b656-2cc3589e0ec3 None None] MFA Rules not processed for user `d1cc037de16940009399412a85bcf529`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:19.512522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-4482f36a-7db0-42fa-b656-2cc3589e0ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:19.515083 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-de3fca59-b6da-434e-b251-ee18202fa3f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05bc3a5eeb6b4c2fbb72ef58dfe36ec3'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:19.535828 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 895/1768] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:19 2022] DELETE /identity/v3/users/05bc3a5eeb6b4c2fbb72ef58dfe36ec3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:19.622941 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fca59-b6da-434e-b251-ee18202fa3f4 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:19.624954 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-de3fca59-b6da-434e-b251-ee18202fa3f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:19.636115 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 874/1769] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:19.642159 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482f36a-7db0-42fa-b656-2cc3589e0ec3 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:19.646222 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-4482f36a-7db0-42fa-b656-2cc3589e0ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:19.789717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482f36a-7db0-42fa-b656-2cc3589e0ec3 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:19.819365 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fca59-b6da-434e-b251-ee18202fa3f4 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:19.835440 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80dd0e6-52e8-497a-a2b6-d7635aee3760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:19.837537 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dd0e6-52e8-497a-a2b6-d7635aee3760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:19.837828 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dd0e6-52e8-497a-a2b6-d7635aee3760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:19.838113 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dd0e6-52e8-497a-a2b6-d7635aee3760 admin admin] PATH_INFO: `/v3/projects/786edc12bdb941679adf96e2040ee682` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:19.843769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80dd0e6-52e8-497a-a2b6-d7635aee3760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=786edc12bdb941679adf96e2040ee682)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:19.845810 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80dd0e6-52e8-497a-a2b6-d7635aee3760 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:19.974664 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae9125-62ad-41f1-8ab9-5c62c29e1c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:19.975377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae9125-62ad-41f1-8ab9-5c62c29e1c3a admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:19.975663 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae9125-62ad-41f1-8ab9-5c62c29e1c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:19.975939 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae9125-62ad-41f1-8ab9-5c62c29e1c3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:19.979712 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae9125-62ad-41f1-8ab9-5c62c29e1c3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:19.981702 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae9125-62ad-41f1-8ab9-5c62c29e1c3a admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:20.004462 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-f80dd0e6-52e8-497a-a2b6-d7635aee3760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '786edc12bdb941679adf96e2040ee682', 'request_id': 'req-f80dd0e6-52e8-497a-a2b6-d7635aee3760'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:20.022614 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:20.023921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-f80dd0e6-52e8-497a-a2b6-d7635aee3760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '786edc12bdb941679adf96e2040ee682', 'request_id': 'req-f80dd0e6-52e8-497a-a2b6-d7635aee3760'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:20.041577 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 875/1770] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:19 2022] POST /identity/v3/projects => generated 391 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:20.042169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-f80dd0e6-52e8-497a-a2b6-d7635aee3760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '786edc12bdb941679adf96e2040ee682', 'request_id': 'req-f80dd0e6-52e8-497a-a2b6-d7635aee3760'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:20.043459 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051a241-eca2-4f66-9dcb-9f37a8b38d0c None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:20.045491 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051a241-eca2-4f66-9dcb-9f37a8b38d0c None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:20.045852 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051a241-eca2-4f66-9dcb-9f37a8b38d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:20.078367 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-b051a241-eca2-4f66-9dcb-9f37a8b38d0c None None] MFA Rules not processed for user `2463c2327e364ca996768e3eb6ef6316`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:20.080509 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-b051a241-eca2-4f66-9dcb-9f37a8b38d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:20.082115 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-f80dd0e6-52e8-497a-a2b6-d7635aee3760 admin admin] The token cache is being invalidate because project 786edc12bdb941679adf96e2040ee682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:20.082417 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-f80dd0e6-52e8-497a-a2b6-d7635aee3760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:20.084822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-f80dd0e6-52e8-497a-a2b6-d7635aee3760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:20.087292 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 896/1771] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:19 2022] DELETE /identity/v3/projects/786edc12bdb941679adf96e2040ee682 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:20.088109 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80dd0e6-52e8-497a-a2b6-d7635aee3760 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:20.116055 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f80dd0e6-52e8-497a-a2b6-d7635aee3760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:20.245251 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 876/1772] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:20.261335 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051a241-eca2-4f66-9dcb-9f37a8b38d0c None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:20.266413 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-b051a241-eca2-4f66-9dcb-9f37a8b38d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:20.336326 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80dd0e6-52e8-497a-a2b6-d7635aee3760 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:20.392528 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:20.520581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051a241-eca2-4f66-9dcb-9f37a8b38d0c None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:20.558112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b20e5e-e922-4acf-8687-8ac0969b354c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:20.560566 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b20e5e-e922-4acf-8687-8ac0969b354c admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:20.563068 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b20e5e-e922-4acf-8687-8ac0969b354c admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:20.565452 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b20e5e-e922-4acf-8687-8ac0969b354c admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:20.568360 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b20e5e-e922-4acf-8687-8ac0969b354c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:20.579237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b20e5e-e922-4acf-8687-8ac0969b354c admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:20.586923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc5763-a92c-4d7a-b1ea-76e56d3e9117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:20.590827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc5763-a92c-4d7a-b1ea-76e56d3e9117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:20.591118 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc5763-a92c-4d7a-b1ea-76e56d3e9117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:20.591435 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc5763-a92c-4d7a-b1ea-76e56d3e9117 admin admin] PATH_INFO: `/v3/projects/c584d3848f444496b63638cd935d347f` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:20.602780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc5763-a92c-4d7a-b1ea-76e56d3e9117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c584d3848f444496b63638cd935d347f)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:20.612399 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc5763-a92c-4d7a-b1ea-76e56d3e9117 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:20.656838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 877/1773] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:20 2022] POST /identity/v3/users => generated 302 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:20.665419 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6eced-a09b-481c-a298-8909beb1257b None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:20.666230 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6eced-a09b-481c-a298-8909beb1257b None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:20.667555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6eced-a09b-481c-a298-8909beb1257b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:20.741978 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-49f6eced-a09b-481c-a298-8909beb1257b None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:20.744831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-49f6eced-a09b-481c-a298-8909beb1257b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:20.756967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-b2dc5763-a92c-4d7a-b1ea-76e56d3e9117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c584d3848f444496b63638cd935d347f', 'request_id': 'req-b2dc5763-a92c-4d7a-b1ea-76e56d3e9117'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:20.777222 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-b2dc5763-a92c-4d7a-b1ea-76e56d3e9117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c584d3848f444496b63638cd935d347f', 'request_id': 'req-b2dc5763-a92c-4d7a-b1ea-76e56d3e9117'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:20.785886 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-b2dc5763-a92c-4d7a-b1ea-76e56d3e9117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c584d3848f444496b63638cd935d347f', 'request_id': 'req-b2dc5763-a92c-4d7a-b1ea-76e56d3e9117'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:20.810034 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-b2dc5763-a92c-4d7a-b1ea-76e56d3e9117 admin admin] The token cache is being invalidate because project c584d3848f444496b63638cd935d347f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:20.810345 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-b2dc5763-a92c-4d7a-b1ea-76e56d3e9117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:20.811576 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-b2dc5763-a92c-4d7a-b1ea-76e56d3e9117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:20.813471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 897/1774] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:20 2022] DELETE /identity/v3/projects/c584d3848f444496b63638cd935d347f => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:20.814383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc5763-a92c-4d7a-b1ea-76e56d3e9117 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:20.817828 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-b2dc5763-a92c-4d7a-b1ea-76e56d3e9117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:20.911789 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 878/1775] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:20.911789 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9120cc6-9dc1-42d0-b32d-2f6964e13fcd None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:20.912059 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9120cc6-9dc1-42d0-b32d-2f6964e13fcd None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:20.913459 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9120cc6-9dc1-42d0-b32d-2f6964e13fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:20.946199 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-e9120cc6-9dc1-42d0-b32d-2f6964e13fcd None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:20.947657 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e9120cc6-9dc1-42d0-b32d-2f6964e13fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:20.958183 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc5763-a92c-4d7a-b1ea-76e56d3e9117 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:20.959625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 879/1776] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:20.961332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeab803-9bb0-4df9-a73c-6c9b2aca7da4 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:20.961678 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeab803-9bb0-4df9-a73c-6c9b2aca7da4 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:20.961974 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeab803-9bb0-4df9-a73c-6c9b2aca7da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:20.963552 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8f375-55a7-4698-b8ab-31cb2220db6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:20.964566 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8f375-55a7-4698-b8ab-31cb2220db6e admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:20.965290 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8f375-55a7-4698-b8ab-31cb2220db6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:20.965490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8f375-55a7-4698-b8ab-31cb2220db6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:20.966396 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8f375-55a7-4698-b8ab-31cb2220db6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:20.968248 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8f375-55a7-4698-b8ab-31cb2220db6e admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:20.982243 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 898/1777] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:20.983980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ee7a3-36c7-498f-b651-3aa1d3568779 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:20.984357 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ee7a3-36c7-498f-b651-3aa1d3568779 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:20.985055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-aeeab803-9bb0-4df9-a73c-6c9b2aca7da4 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:20.985163 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ee7a3-36c7-498f-b651-3aa1d3568779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:20.987025 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-aeeab803-9bb0-4df9-a73c-6c9b2aca7da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:21.003336 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 880/1778] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:21.007816 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeab803-9bb0-4df9-a73c-6c9b2aca7da4 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:21.016628 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-d43ee7a3-36c7-498f-b651-3aa1d3568779 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:21.018571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeab803-9bb0-4df9-a73c-6c9b2aca7da4 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:21.019439 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d43ee7a3-36c7-498f-b651-3aa1d3568779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:21.024010 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cff30a-a9c3-4026-a1a7-fee15411d924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:21.024856 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cff30a-a9c3-4026-a1a7-fee15411d924 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:21.025178 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cff30a-a9c3-4026-a1a7-fee15411d924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:21.025799 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cff30a-a9c3-4026-a1a7-fee15411d924 admin admin] PATH_INFO: `/v3/projects/64972e5f58ae4896bc96e504a432f232/users/d1792fe46e4f4e41a5d072fd29ab4402/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:21.045110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 899/1779] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:21.046159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ee7a3-36c7-498f-b651-3aa1d3568779 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:21.050990 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cff30a-a9c3-4026-a1a7-fee15411d924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64972e5f58ae4896bc96e504a432f232, user_id=d1792fe46e4f4e41a5d072fd29ab4402, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:21.054212 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cff30a-a9c3-4026-a1a7-fee15411d924 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:21.059522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:21.076793 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ee7a3-36c7-498f-b651-3aa1d3568779 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:21.083418 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 881/1780] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:21 2022] PUT /identity/v3/projects/64972e5f58ae4896bc96e504a432f232/users/d1792fe46e4f4e41a5d072fd29ab4402/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:21.084547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cff30a-a9c3-4026-a1a7-fee15411d924 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:21.126751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:21.167132 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cff30a-a9c3-4026-a1a7-fee15411d924 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:21.172496 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4884bd5-73c3-40ee-b2d9-e7962cb33dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:21.173287 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4884bd5-73c3-40ee-b2d9-e7962cb33dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:21.174057 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4884bd5-73c3-40ee-b2d9-e7962cb33dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:21.174465 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4884bd5-73c3-40ee-b2d9-e7962cb33dd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:21.175211 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4884bd5-73c3-40ee-b2d9-e7962cb33dd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:39:21.175555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4884bd5-73c3-40ee-b2d9-e7962cb33dd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:21.177205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4884bd5-73c3-40ee-b2d9-e7962cb33dd4 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:21.182544 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26e654-ccd7-4fab-ae26-dcd6cd627a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:21.183384 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26e654-ccd7-4fab-ae26-dcd6cd627a61 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:21.183815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26e654-ccd7-4fab-ae26-dcd6cd627a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:21.184187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26e654-ccd7-4fab-ae26-dcd6cd627a61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:21.185127 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26e654-ccd7-4fab-ae26-dcd6cd627a61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:39:21.185537 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26e654-ccd7-4fab-ae26-dcd6cd627a61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:21.187533 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26e654-ccd7-4fab-ae26-dcd6cd627a61 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:21.192820 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 882/1781] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:39:21.192820 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4884bd5-73c3-40ee-b2d9-e7962cb33dd4 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:21.204833 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 900/1782] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:39:21.206384 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26e654-ccd7-4fab-ae26-dcd6cd627a61 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:21.210453 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4884bd5-73c3-40ee-b2d9-e7962cb33dd4 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:21.219112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26e654-ccd7-4fab-ae26-dcd6cd627a61 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:21.226761 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53688f-ba9b-446a-ae70-609fb62e2a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:21.227495 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53688f-ba9b-446a-ae70-609fb62e2a26 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:21.227777 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53688f-ba9b-446a-ae70-609fb62e2a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:21.228055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53688f-ba9b-446a-ae70-609fb62e2a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:21.228785 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53688f-ba9b-446a-ae70-609fb62e2a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:21.231031 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53688f-ba9b-446a-ae70-609fb62e2a26 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:21.238968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a22f2-6947-4781-80ea-45639a6cc566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:21.240324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a22f2-6947-4781-80ea-45639a6cc566 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:21.240868 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a22f2-6947-4781-80ea-45639a6cc566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:21.241303 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a22f2-6947-4781-80ea-45639a6cc566 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:21.242187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a22f2-6947-4781-80ea-45639a6cc566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:21.244549 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a22f2-6947-4781-80ea-45639a6cc566 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:21.246717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 883/1783] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:21.247910 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53688f-ba9b-446a-ae70-609fb62e2a26 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:21.266261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53688f-ba9b-446a-ae70-609fb62e2a26 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:21.271878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22559ac9-e355-406d-8176-2fff5c7fdd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:21.272637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22559ac9-e355-406d-8176-2fff5c7fdd1c admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:21.272845 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22559ac9-e355-406d-8176-2fff5c7fdd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:21.273237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22559ac9-e355-406d-8176-2fff5c7fdd1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:21.274129 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22559ac9-e355-406d-8176-2fff5c7fdd1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:21.276840 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22559ac9-e355-406d-8176-2fff5c7fdd1c admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:21.296459 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 901/1784] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:21 2022] POST /identity/v3/projects => generated 387 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:21.298073 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a22f2-6947-4781-80ea-45639a6cc566 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:21.319745 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 884/1785] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:21 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:21.320988 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22559ac9-e355-406d-8176-2fff5c7fdd1c admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:21.384922 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a22f2-6947-4781-80ea-45639a6cc566 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:21.423909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22559ac9-e355-406d-8176-2fff5c7fdd1c admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:21.428793 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d906e-01d5-481e-8e46-89581d09ec01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:21.429472 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d906e-01d5-481e-8e46-89581d09ec01 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:21.429759 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d906e-01d5-481e-8e46-89581d09ec01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:21.430031 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d906e-01d5-481e-8e46-89581d09ec01 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:21.430879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d906e-01d5-481e-8e46-89581d09ec01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:21.432683 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d906e-01d5-481e-8e46-89581d09ec01 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:21.456488 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 885/1786] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:21 2022] POST /identity/v3/users => generated 294 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:21.460462 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d906e-01d5-481e-8e46-89581d09ec01 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:21.464599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3775103-5f99-473c-809a-a284c47af9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:21.465885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3775103-5f99-473c-809a-a284c47af9ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:21.466222 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3775103-5f99-473c-809a-a284c47af9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:21.466574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3775103-5f99-473c-809a-a284c47af9ff admin admin] PATH_INFO: `/v3/projects/64972e5f58ae4896bc96e504a432f232/users/d1792fe46e4f4e41a5d072fd29ab4402/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:21.468978 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3775103-5f99-473c-809a-a284c47af9ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=64972e5f58ae4896bc96e504a432f232, user_id=d1792fe46e4f4e41a5d072fd29ab4402, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:21.471686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d906e-01d5-481e-8e46-89581d09ec01 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:21.471999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3775103-5f99-473c-809a-a284c47af9ff admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:21.482766 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06d5bf-f5b6-4998-a41c-03bb47a0e467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:21.483706 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06d5bf-f5b6-4998-a41c-03bb47a0e467 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:21.483828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06d5bf-f5b6-4998-a41c-03bb47a0e467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:21.484101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06d5bf-f5b6-4998-a41c-03bb47a0e467 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:21.484727 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a06d5bf-f5b6-4998-a41c-03bb47a0e467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:21.486865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a06d5bf-f5b6-4998-a41c-03bb47a0e467 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:21.503521 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 902/1787] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:21 2022] PUT /identity/v3/projects/64972e5f58ae4896bc96e504a432f232/users/d1792fe46e4f4e41a5d072fd29ab4402/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:21.503521 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3775103-5f99-473c-809a-a284c47af9ff admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:21.512861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 886/1788] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:21 2022] POST /identity/v3/users => generated 294 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:21.512861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9e9f7-274f-401b-8eb0-f9cae06f5ab6 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:21.512861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9e9f7-274f-401b-8eb0-f9cae06f5ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:21.512861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9e9f7-274f-401b-8eb0-f9cae06f5ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:21.539575 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-6ca9e9f7-274f-401b-8eb0-f9cae06f5ab6 None None] MFA Rules not processed for user `d1792fe46e4f4e41a5d072fd29ab4402`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:21.540937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-6ca9e9f7-274f-401b-8eb0-f9cae06f5ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:21.561689 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:21.563976 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:21.584788 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3775103-5f99-473c-809a-a284c47af9ff admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:21.593316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0089693-0d7f-47c2-8f2f-2a718acd90f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:21.594019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0089693-0d7f-47c2-8f2f-2a718acd90f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:21.594317 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0089693-0d7f-47c2-8f2f-2a718acd90f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:21.594587 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0089693-0d7f-47c2-8f2f-2a718acd90f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:21.595511 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0089693-0d7f-47c2-8f2f-2a718acd90f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:21.597161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0089693-0d7f-47c2-8f2f-2a718acd90f1 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:21.613303 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 903/1789] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:21.613971 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0089693-0d7f-47c2-8f2f-2a718acd90f1 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:21.624832 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0089693-0d7f-47c2-8f2f-2a718acd90f1 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:21.631349 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c89af1-82f6-4846-bcbf-da9210142f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:21.632058 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c89af1-82f6-4846-bcbf-da9210142f66 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:21.632322 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c89af1-82f6-4846-bcbf-da9210142f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:21.632604 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c89af1-82f6-4846-bcbf-da9210142f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:21.633873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c89af1-82f6-4846-bcbf-da9210142f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:21.635215 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c89af1-82f6-4846-bcbf-da9210142f66 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:21.649384 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 904/1790] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:21.650636 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c89af1-82f6-4846-bcbf-da9210142f66 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:21.655113 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 887/1791] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:21.655113 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9e9f7-274f-401b-8eb0-f9cae06f5ab6 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:21.666668 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9e9f7-274f-401b-8eb0-f9cae06f5ab6 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:21.671372 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c89af1-82f6-4846-bcbf-da9210142f66 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:21.674937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee193ca7-934c-43fb-a33c-e15026623552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:21.675664 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee193ca7-934c-43fb-a33c-e15026623552 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:21.676289 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee193ca7-934c-43fb-a33c-e15026623552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:21.676519 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e893e42-6262-4ceb-a301-9f51330faa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:21.676665 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee193ca7-934c-43fb-a33c-e15026623552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:21.677319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee193ca7-934c-43fb-a33c-e15026623552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:21.678385 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e893e42-6262-4ceb-a301-9f51330faa14 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:21.678669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e893e42-6262-4ceb-a301-9f51330faa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:21.678942 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e893e42-6262-4ceb-a301-9f51330faa14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:21.679040 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee193ca7-934c-43fb-a33c-e15026623552 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:21.679709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e893e42-6262-4ceb-a301-9f51330faa14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:21.681839 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e893e42-6262-4ceb-a301-9f51330faa14 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:21.690886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 888/1792] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:21.691907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee193ca7-934c-43fb-a33c-e15026623552 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:21.693699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-ee193ca7-934c-43fb-a33c-e15026623552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:21.696636 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 905/1793] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:21.697396 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e893e42-6262-4ceb-a301-9f51330faa14 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:21.714215 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e893e42-6262-4ceb-a301-9f51330faa14 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:21.720473 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388b70c-ee40-4c8d-8b5c-a83b391a997f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:21.721498 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388b70c-ee40-4c8d-8b5c-a83b391a997f admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:21.729718 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388b70c-ee40-4c8d-8b5c-a83b391a997f admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:21.730044 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388b70c-ee40-4c8d-8b5c-a83b391a997f admin admin] PATH_INFO: `/v3/projects/e850bae55371493cb840433c1376e0ab/users/00a67a38a88344f5b7d11fa06721d43d/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:21.751393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388b70c-ee40-4c8d-8b5c-a83b391a997f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e850bae55371493cb840433c1376e0ab, user_id=00a67a38a88344f5b7d11fa06721d43d, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:21.755042 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388b70c-ee40-4c8d-8b5c-a83b391a997f admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:21.772329 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 906/1794] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:21 2022] PUT /identity/v3/projects/e850bae55371493cb840433c1376e0ab/users/00a67a38a88344f5b7d11fa06721d43d/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:21.773675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388b70c-ee40-4c8d-8b5c-a83b391a997f admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:21.783618 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee193ca7-934c-43fb-a33c-e15026623552 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:21.859726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388b70c-ee40-4c8d-8b5c-a83b391a997f admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:21.860218 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a2f53-c344-4efd-8ee1-970873fef794 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:21.861003 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a2f53-c344-4efd-8ee1-970873fef794 service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:21.861148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a2f53-c344-4efd-8ee1-970873fef794 service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:21.862203 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a2f53-c344-4efd-8ee1-970873fef794 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:21.865839 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c245e4-22b0-4d2d-999a-a0a66f24440a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:21.866727 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c245e4-22b0-4d2d-999a-a0a66f24440a admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:21.867017 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c245e4-22b0-4d2d-999a-a0a66f24440a admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:21.867414 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c245e4-22b0-4d2d-999a-a0a66f24440a admin admin] PATH_INFO: `/v3/projects/d68224014d9848deafa04447c90a83b6/users/093204e519ac41ee959323324216cc2d/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:21.968803 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a2f53-c344-4efd-8ee1-970873fef794 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:21.970461 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a2f53-c344-4efd-8ee1-970873fef794 service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:21.995563 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 889/1795] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:21 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:21.999348 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1651316-b0f6-4f48-ae9c-50fe614ea00d None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:21.999651 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1651316-b0f6-4f48-ae9c-50fe614ea00d None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:21.999930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1651316-b0f6-4f48-ae9c-50fe614ea00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:22.047324 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:22.072065 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-f1651316-b0f6-4f48-ae9c-50fe614ea00d None None] MFA Rules not processed for user `00a67a38a88344f5b7d11fa06721d43d`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:22.072065 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f1651316-b0f6-4f48-ae9c-50fe614ea00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:22.075265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c245e4-22b0-4d2d-999a-a0a66f24440a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d68224014d9848deafa04447c90a83b6, user_id=093204e519ac41ee959323324216cc2d, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:22.083457 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c245e4-22b0-4d2d-999a-a0a66f24440a admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:22.109281 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 907/1796] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:21 2022] PUT /identity/v3/projects/d68224014d9848deafa04447c90a83b6/users/093204e519ac41ee959323324216cc2d/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:22.118703 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c245e4-22b0-4d2d-999a-a0a66f24440a admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:22.203997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 890/1797] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:22.205695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b82ba0-343b-4528-ab91-27d4d46e0ca4 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:22.205992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b82ba0-343b-4528-ab91-27d4d46e0ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:22.206272 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b82ba0-343b-4528-ab91-27d4d46e0ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:22.240035 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c245e4-22b0-4d2d-999a-a0a66f24440a admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:22.247433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-85b82ba0-343b-4528-ab91-27d4d46e0ca4 None None] MFA Rules not processed for user `093204e519ac41ee959323324216cc2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:22.249242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-85b82ba0-343b-4528-ab91-27d4d46e0ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:22.252340 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251d8f3-808e-4f9f-9dda-c0b4bf017a9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:22.253077 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251d8f3-808e-4f9f-9dda-c0b4bf017a9e service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:22.255169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251d8f3-808e-4f9f-9dda-c0b4bf017a9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:22.255524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251d8f3-808e-4f9f-9dda-c0b4bf017a9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:22.257698 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-1251d8f3-808e-4f9f-9dda-c0b4bf017a9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:22.326686 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:22.368529 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251d8f3-808e-4f9f-9dda-c0b4bf017a9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:22.370801 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251d8f3-808e-4f9f-9dda-c0b4bf017a9e service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:22.376687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 891/1798] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:22.381544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b82ba0-343b-4528-ab91-27d4d46e0ca4 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:22.384843 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 908/1799] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:22.399302 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251d8f3-808e-4f9f-9dda-c0b4bf017a9e service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:22.465264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b82ba0-343b-4528-ab91-27d4d46e0ca4 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:22.473487 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251d8f3-808e-4f9f-9dda-c0b4bf017a9e service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:22.474641 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c76d2-a816-48ea-8ca6-34cc4bf5f14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:22.475460 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c76d2-a816-48ea-8ca6-34cc4bf5f14e admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:22.475823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c76d2-a816-48ea-8ca6-34cc4bf5f14e admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:22.477043 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c76d2-a816-48ea-8ca6-34cc4bf5f14e admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:22.477939 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c76d2-a816-48ea-8ca6-34cc4bf5f14e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:22.480664 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa7bc1-b2a1-4205-b7e4-17361ae408df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:22.481007 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c76d2-a816-48ea-8ca6-34cc4bf5f14e admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:22.482118 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa7bc1-b2a1-4205-b7e4-17361ae408df admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:22.482918 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa7bc1-b2a1-4205-b7e4-17361ae408df admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:22.483058 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa7bc1-b2a1-4205-b7e4-17361ae408df admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:22.484060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa7bc1-b2a1-4205-b7e4-17361ae408df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:22.486393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa7bc1-b2a1-4205-b7e4-17361ae408df admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:22.516925 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 892/1800] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:22 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:22.525664 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 909/1801] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:22 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:22.529015 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c76d2-a816-48ea-8ca6-34cc4bf5f14e admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:22.531935 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa7bc1-b2a1-4205-b7e4-17361ae408df admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:22.546015 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:22.608179 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c76d2-a816-48ea-8ca6-34cc4bf5f14e admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:22.627522 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa7bc1-b2a1-4205-b7e4-17361ae408df admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:22.635125 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824c06a-6d32-4f00-bf11-36f3ec1c19e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:22.635944 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824c06a-6d32-4f00-bf11-36f3ec1c19e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:22.636309 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824c06a-6d32-4f00-bf11-36f3ec1c19e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:22.636654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824c06a-6d32-4f00-bf11-36f3ec1c19e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:22.637361 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824c06a-6d32-4f00-bf11-36f3ec1c19e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:22.639370 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824c06a-6d32-4f00-bf11-36f3ec1c19e1 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:22.668751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 910/1802] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:22 2022] POST /identity/v3/users => generated 294 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:22.670350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824c06a-6d32-4f00-bf11-36f3ec1c19e1 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:22.676637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2992ab-2465-45df-af07-d6b222d908c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:22.677810 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2992ab-2465-45df-af07-d6b222d908c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:22.678298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2992ab-2465-45df-af07-d6b222d908c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:22.680324 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2992ab-2465-45df-af07-d6b222d908c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:22.681594 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2992ab-2465-45df-af07-d6b222d908c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:22.683937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2992ab-2465-45df-af07-d6b222d908c3 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:22.684093 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824c06a-6d32-4f00-bf11-36f3ec1c19e1 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:22.691386 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703d20b-0448-49c2-bdb5-4933b344c044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:22.692824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703d20b-0448-49c2-bdb5-4933b344c044 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:22.693203 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703d20b-0448-49c2-bdb5-4933b344c044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:22.693581 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703d20b-0448-49c2-bdb5-4933b344c044 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:22.694629 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703d20b-0448-49c2-bdb5-4933b344c044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:22.697535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703d20b-0448-49c2-bdb5-4933b344c044 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:22.710789 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 893/1803] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:22 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:22.714658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2992ab-2465-45df-af07-d6b222d908c3 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:22.728745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 911/1804] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:39:22.731224 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703d20b-0448-49c2-bdb5-4933b344c044 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:22.739537 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2992ab-2465-45df-af07-d6b222d908c3 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:22.750082 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd5b03-49fd-4805-92b8-81faaac7bc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:22.750689 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd5b03-49fd-4805-92b8-81faaac7bc68 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:22.750973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd5b03-49fd-4805-92b8-81faaac7bc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:22.751250 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd5b03-49fd-4805-92b8-81faaac7bc68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:22.752038 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd5b03-49fd-4805-92b8-81faaac7bc68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:22.755064 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703d20b-0448-49c2-bdb5-4933b344c044 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:22.756899 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd5b03-49fd-4805-92b8-81faaac7bc68 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:22.766605 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23feffd2-c4ec-41c0-b18e-3a0074605888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:22.767305 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23feffd2-c4ec-41c0-b18e-3a0074605888 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:22.768172 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23feffd2-c4ec-41c0-b18e-3a0074605888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:22.768454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23feffd2-c4ec-41c0-b18e-3a0074605888 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:22.770966 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23feffd2-c4ec-41c0-b18e-3a0074605888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:22.774952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23feffd2-c4ec-41c0-b18e-3a0074605888 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:22.783853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 894/1805] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:39:22.786035 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd5b03-49fd-4805-92b8-81faaac7bc68 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:22.796585 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 912/1806] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:22.801755 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23feffd2-c4ec-41c0-b18e-3a0074605888 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:22.803095 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd5b03-49fd-4805-92b8-81faaac7bc68 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:22.810182 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8ecdb-8e1f-4a08-8cb2-b1f64b04d2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:22.811286 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8ecdb-8e1f-4a08-8cb2-b1f64b04d2d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:22.811707 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8ecdb-8e1f-4a08-8cb2-b1f64b04d2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:22.812080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8ecdb-8e1f-4a08-8cb2-b1f64b04d2d7 admin admin] PATH_INFO: `/v3/projects/8c8080e399e24746bd0f01113ec9e20f/users/99038ca5243f429a8d971e08c08f5fda/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:22.822374 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23feffd2-c4ec-41c0-b18e-3a0074605888 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:22.829753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c88dc-def2-4339-b753-339ef56b0c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:22.831642 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c88dc-def2-4339-b753-339ef56b0c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:22.831931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c88dc-def2-4339-b753-339ef56b0c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:22.832208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c88dc-def2-4339-b753-339ef56b0c77 admin admin] PATH_INFO: `/v3/projects/08ad6eb1944c4ba0943718886ae363ca/users/e4366d64c4be4d4cab1586c8a6969dde/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:22.848272 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8ecdb-8e1f-4a08-8cb2-b1f64b04d2d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c8080e399e24746bd0f01113ec9e20f, user_id=99038ca5243f429a8d971e08c08f5fda, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:22.851631 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8ecdb-8e1f-4a08-8cb2-b1f64b04d2d7 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:22.852699 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c88dc-def2-4339-b753-339ef56b0c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ad6eb1944c4ba0943718886ae363ca, user_id=e4366d64c4be4d4cab1586c8a6969dde, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:22.856094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c88dc-def2-4339-b753-339ef56b0c77 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:22.870074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 895/1807] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:22 2022] PUT /identity/v3/projects/8c8080e399e24746bd0f01113ec9e20f/users/99038ca5243f429a8d971e08c08f5fda/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:22.874469 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8ecdb-8e1f-4a08-8cb2-b1f64b04d2d7 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:22.888327 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 913/1808] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:22 2022] PUT /identity/v3/projects/08ad6eb1944c4ba0943718886ae363ca/users/e4366d64c4be4d4cab1586c8a6969dde/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:22.897136 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fa4ae-01a8-4532-bfc1-cf0c18d04a5e None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:22.897438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fa4ae-01a8-4532-bfc1-cf0c18d04a5e None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:22.897722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fa4ae-01a8-4532-bfc1-cf0c18d04a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:22.904404 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:22.927957 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-ef9fa4ae-01a8-4532-bfc1-cf0c18d04a5e None None] MFA Rules not processed for user `e4366d64c4be4d4cab1586c8a6969dde`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:22.929179 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-ef9fa4ae-01a8-4532-bfc1-cf0c18d04a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:22.946007 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8ecdb-8e1f-4a08-8cb2-b1f64b04d2d7 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:22.966366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:22.993369 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 914/1809] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:22.997742 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fa4ae-01a8-4532-bfc1-cf0c18d04a5e None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:23.007872 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc08274-d759-4167-955f-8c5686c67cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:23.008487 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc08274-d759-4167-955f-8c5686c67cee admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:23.008779 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc08274-d759-4167-955f-8c5686c67cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:23.009065 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc08274-d759-4167-955f-8c5686c67cee admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:23.009936 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc08274-d759-4167-955f-8c5686c67cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:23.011565 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc08274-d759-4167-955f-8c5686c67cee admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:23.021376 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 896/1810] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:39:23.025414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc08274-d759-4167-955f-8c5686c67cee admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:23.036361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc08274-d759-4167-955f-8c5686c67cee admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:23.041093 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776429f-4cc3-4f60-8592-b924d8316a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:23.041976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776429f-4cc3-4f60-8592-b924d8316a0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:23.042289 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776429f-4cc3-4f60-8592-b924d8316a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:23.042565 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776429f-4cc3-4f60-8592-b924d8316a0d admin admin] PATH_INFO: `/v3/projects/8c8080e399e24746bd0f01113ec9e20f/users/99038ca5243f429a8d971e08c08f5fda/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:23.044577 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776429f-4cc3-4f60-8592-b924d8316a0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c8080e399e24746bd0f01113ec9e20f, user_id=99038ca5243f429a8d971e08c08f5fda, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:23.047249 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776429f-4cc3-4f60-8592-b924d8316a0d admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:23.057846 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 897/1811] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:23 2022] PUT /identity/v3/projects/8c8080e399e24746bd0f01113ec9e20f/users/99038ca5243f429a8d971e08c08f5fda/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:39:23.065312 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fa4ae-01a8-4532-bfc1-cf0c18d04a5e None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:23.068685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d8dcf-70ae-4090-8ecf-89183802498d None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:23.068975 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d8dcf-70ae-4090-8ecf-89183802498d None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:23.069252 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d8dcf-70ae-4090-8ecf-89183802498d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:23.099431 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-567d8dcf-70ae-4090-8ecf-89183802498d None None] MFA Rules not processed for user `99038ca5243f429a8d971e08c08f5fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:23.100722 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-567d8dcf-70ae-4090-8ecf-89183802498d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:23.127136 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12679801-99c1-429b-ba71-f7c16a678d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:23.128138 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12679801-99c1-429b-ba71-f7c16a678d18 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:23.128632 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12679801-99c1-429b-ba71-f7c16a678d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:23.129088 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12679801-99c1-429b-ba71-f7c16a678d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:23.129960 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12679801-99c1-429b-ba71-f7c16a678d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:23.132090 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12679801-99c1-429b-ba71-f7c16a678d18 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:23.164609 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 915/1812] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:22 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:39:23.165597 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12679801-99c1-429b-ba71-f7c16a678d18 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:23.186257 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 898/1813] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:23.197454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d8dcf-70ae-4090-8ecf-89183802498d None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:23.198945 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:23.232074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12679801-99c1-429b-ba71-f7c16a678d18 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:23.237468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be4551-6bfe-4cd6-9451-3689f959751c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:23.238142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be4551-6bfe-4cd6-9451-3689f959751c admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:23.238435 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be4551-6bfe-4cd6-9451-3689f959751c admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:23.238711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be4551-6bfe-4cd6-9451-3689f959751c admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:23.239433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be4551-6bfe-4cd6-9451-3689f959751c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:23.241368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be4551-6bfe-4cd6-9451-3689f959751c admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:23.254124 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d8dcf-70ae-4090-8ecf-89183802498d None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:23.262484 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 916/1814] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:23 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:39:23.266298 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be4551-6bfe-4cd6-9451-3689f959751c admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:23.276548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be4551-6bfe-4cd6-9451-3689f959751c admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:23.281159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4ba0e-9f2a-4d05-b296-af828286db67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:23.281810 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4ba0e-9f2a-4d05-b296-af828286db67 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:23.282095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4ba0e-9f2a-4d05-b296-af828286db67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:23.282371 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4ba0e-9f2a-4d05-b296-af828286db67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:23.283163 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4ba0e-9f2a-4d05-b296-af828286db67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:23.284820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4ba0e-9f2a-4d05-b296-af828286db67 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:23.294487 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 917/1815] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:39:23.297301 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:23.298633 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4ba0e-9f2a-4d05-b296-af828286db67 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:23.304544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3675211-d87c-4430-b015-b7b2f7539d36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:23.305576 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3675211-d87c-4430-b015-b7b2f7539d36 service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:23.305867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3675211-d87c-4430-b015-b7b2f7539d36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:23.306138 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3675211-d87c-4430-b015-b7b2f7539d36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:23.309272 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4ba0e-9f2a-4d05-b296-af828286db67 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:23.313936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb8107-83a2-4235-b147-076dd0784b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:23.314853 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb8107-83a2-4235-b147-076dd0784b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:23.315139 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb8107-83a2-4235-b147-076dd0784b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:23.315458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb8107-83a2-4235-b147-076dd0784b82 admin admin] PATH_INFO: `/v3/projects/bcb5fbcaf531462ea208cc319f2f54b7/users/5079cebe9f044f508d5f22cca18181f2/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:23.332137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb8107-83a2-4235-b147-076dd0784b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb5fbcaf531462ea208cc319f2f54b7, user_id=5079cebe9f044f508d5f22cca18181f2, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:23.334858 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb8107-83a2-4235-b147-076dd0784b82 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:23.349479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 918/1816] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:23 2022] PUT /identity/v3/projects/bcb5fbcaf531462ea208cc319f2f54b7/users/5079cebe9f044f508d5f22cca18181f2/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:39:23.353956 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb8107-83a2-4235-b147-076dd0784b82 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:23.380072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3675211-d87c-4430-b015-b7b2f7539d36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:23.381711 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3675211-d87c-4430-b015-b7b2f7539d36 service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:23.398954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 899/1817] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:39:23.435655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb8107-83a2-4235-b147-076dd0784b82 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:23.443378 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e692cdb-4705-4687-9b56-46803b523bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:23.444828 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e692cdb-4705-4687-9b56-46803b523bbb admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:23.445331 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e692cdb-4705-4687-9b56-46803b523bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:23.445661 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e692cdb-4705-4687-9b56-46803b523bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:23.446501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e692cdb-4705-4687-9b56-46803b523bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:23.448544 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e692cdb-4705-4687-9b56-46803b523bbb admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:23.471320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 919/1818] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:39:23.475437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3675211-d87c-4430-b015-b7b2f7539d36 service cinder] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:23.489498 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e692cdb-4705-4687-9b56-46803b523bbb admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:23.494610 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3675211-d87c-4430-b015-b7b2f7539d36 service cinder] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:23.500202 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e692cdb-4705-4687-9b56-46803b523bbb admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:23.501041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915701ca-f4f9-4689-82d6-344a3e88aa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:23.503044 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915701ca-f4f9-4689-82d6-344a3e88aa9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:23.503941 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915701ca-f4f9-4689-82d6-344a3e88aa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:23.504228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915701ca-f4f9-4689-82d6-344a3e88aa9b admin admin] PATH_INFO: `/v3/projects/bcb5fbcaf531462ea208cc319f2f54b7/users/5079cebe9f044f508d5f22cca18181f2/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:23.511580 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166aeb7-b938-48eb-a0fe-3b414b183e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:23.512210 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915701ca-f4f9-4689-82d6-344a3e88aa9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb5fbcaf531462ea208cc319f2f54b7, user_id=5079cebe9f044f508d5f22cca18181f2, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:23.513143 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166aeb7-b938-48eb-a0fe-3b414b183e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:23.513496 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166aeb7-b938-48eb-a0fe-3b414b183e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:23.513868 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166aeb7-b938-48eb-a0fe-3b414b183e62 admin admin] PATH_INFO: `/v3/users/00a67a38a88344f5b7d11fa06721d43d` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:23.515185 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166aeb7-b938-48eb-a0fe-3b414b183e62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a67a38a88344f5b7d11fa06721d43d)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:23.515508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915701ca-f4f9-4689-82d6-344a3e88aa9b admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:23.517525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166aeb7-b938-48eb-a0fe-3b414b183e62 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:23.529881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 900/1819] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:23 2022] PUT /identity/v3/projects/bcb5fbcaf531462ea208cc319f2f54b7/users/5079cebe9f044f508d5f22cca18181f2/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:23.545581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db9399-3a2d-43e9-98f2-bd032524ca34 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:23.545879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db9399-3a2d-43e9-98f2-bd032524ca34 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:23.546160 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db9399-3a2d-43e9-98f2-bd032524ca34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:23.579565 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-55db9399-3a2d-43e9-98f2-bd032524ca34 None None] MFA Rules not processed for user `5079cebe9f044f508d5f22cca18181f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:23.580698 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-9166aeb7-b938-48eb-a0fe-3b414b183e62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a67a38a88344f5b7d11fa06721d43d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:23.580848 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-55db9399-3a2d-43e9-98f2-bd032524ca34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:23.581445 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-9166aeb7-b938-48eb-a0fe-3b414b183e62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a67a38a88344f5b7d11fa06721d43d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:23.590047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-9166aeb7-b938-48eb-a0fe-3b414b183e62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a67a38a88344f5b7d11fa06721d43d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:23.591421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-9166aeb7-b938-48eb-a0fe-3b414b183e62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a67a38a88344f5b7d11fa06721d43d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:23.605183 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:23.606431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-9166aeb7-b938-48eb-a0fe-3b414b183e62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a67a38a88344f5b7d11fa06721d43d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:23.625935 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 920/1820] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:23 2022] DELETE /identity/v3/users/00a67a38a88344f5b7d11fa06721d43d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:23.631019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d942ef-990d-4a4e-95be-30cc11d9daf5 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:23.631324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d942ef-990d-4a4e-95be-30cc11d9daf5 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:23.632377 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d942ef-990d-4a4e-95be-30cc11d9daf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:23.653921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-68d942ef-990d-4a4e-95be-30cc11d9daf5 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:23.653921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-68d942ef-990d-4a4e-95be-30cc11d9daf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:23.664579 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 901/1821] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:23.677986 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db9399-3a2d-43e9-98f2-bd032524ca34 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:23.679547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-55db9399-3a2d-43e9-98f2-bd032524ca34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:23.721482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 921/1822] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:23.733198 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d942ef-990d-4a4e-95be-30cc11d9daf5 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:23.734728 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-68d942ef-990d-4a4e-95be-30cc11d9daf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:23.751216 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db9399-3a2d-43e9-98f2-bd032524ca34 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:23.771369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:23.796192 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d942ef-990d-4a4e-95be-30cc11d9daf5 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:23.801491 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b37162-c46f-4fbf-b803-5a92de5297bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:23.802267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b37162-c46f-4fbf-b803-5a92de5297bd service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:23.802532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b37162-c46f-4fbf-b803-5a92de5297bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:23.802808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b37162-c46f-4fbf-b803-5a92de5297bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:23.804091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5c9a2-bc41-4ef5-850f-792764a10fdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:23.804941 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5c9a2-bc41-4ef5-850f-792764a10fdf service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:23.805294 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5c9a2-bc41-4ef5-850f-792764a10fdf service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:23.805639 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5c9a2-bc41-4ef5-850f-792764a10fdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:23.814250 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b37162-c46f-4fbf-b803-5a92de5297bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:23.816620 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b37162-c46f-4fbf-b803-5a92de5297bd service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:23.828809 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 922/1823] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:39:23.830375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b37162-c46f-4fbf-b803-5a92de5297bd service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:23.831886 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-b3b37162-c46f-4fbf-b803-5a92de5297bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:23.846225 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b37162-c46f-4fbf-b803-5a92de5297bd service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:23.852199 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a2730-eab9-4e74-baef-81c595a3d603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:23.852564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a2730-eab9-4e74-baef-81c595a3d603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:23.852849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a2730-eab9-4e74-baef-81c595a3d603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:23.853173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a2730-eab9-4e74-baef-81c595a3d603 admin admin] PATH_INFO: `/v3/users/9a20dc7b1f67467fa9cac4306bcd882a` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:23.854542 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a2730-eab9-4e74-baef-81c595a3d603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a20dc7b1f67467fa9cac4306bcd882a)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:23.857033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a2730-eab9-4e74-baef-81c595a3d603 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:23.886528 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5c9a2-bc41-4ef5-850f-792764a10fdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:23.888759 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5c9a2-bc41-4ef5-850f-792764a10fdf service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:23.901734 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 902/1824] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:39:23.927876 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-d97a2730-eab9-4e74-baef-81c595a3d603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a20dc7b1f67467fa9cac4306bcd882a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:23.929619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-d97a2730-eab9-4e74-baef-81c595a3d603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a20dc7b1f67467fa9cac4306bcd882a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:23.948191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-d97a2730-eab9-4e74-baef-81c595a3d603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a20dc7b1f67467fa9cac4306bcd882a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:23.949173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-d97a2730-eab9-4e74-baef-81c595a3d603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a20dc7b1f67467fa9cac4306bcd882a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:23.967078 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-d97a2730-eab9-4e74-baef-81c595a3d603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a20dc7b1f67467fa9cac4306bcd882a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:23.998519 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 923/1825] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:23 2022] DELETE /identity/v3/users/9a20dc7b1f67467fa9cac4306bcd882a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:24.003713 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956cd34-d4ac-4aa0-80f7-4a03acd7fe5a None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:24.004007 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956cd34-d4ac-4aa0-80f7-4a03acd7fe5a None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:24.004295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956cd34-d4ac-4aa0-80f7-4a03acd7fe5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:24.036634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-3956cd34-d4ac-4aa0-80f7-4a03acd7fe5a None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:24.038576 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-3956cd34-d4ac-4aa0-80f7-4a03acd7fe5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:24.185298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 903/1826] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:24.198923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a2730-eab9-4e74-baef-81c595a3d603 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:24.200548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d97a2730-eab9-4e74-baef-81c595a3d603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:24.209978 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:24.348931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a2730-eab9-4e74-baef-81c595a3d603 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:24.354567 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff1b4a-000e-48cb-87bd-e23f715f42ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:24.355264 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff1b4a-000e-48cb-87bd-e23f715f42ab service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:24.355568 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff1b4a-000e-48cb-87bd-e23f715f42ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:24.356034 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff1b4a-000e-48cb-87bd-e23f715f42ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:24.369302 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff1b4a-000e-48cb-87bd-e23f715f42ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:24.371190 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff1b4a-000e-48cb-87bd-e23f715f42ab service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:24.402313 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 924/1827] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:39:24.864645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956cd34-d4ac-4aa0-80f7-4a03acd7fe5a None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:24.866207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-3956cd34-d4ac-4aa0-80f7-4a03acd7fe5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:25.016162 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956cd34-d4ac-4aa0-80f7-4a03acd7fe5a None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:25.023669 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0d890-729b-40bf-88ab-3dcc9eb789e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:25.025343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0d890-729b-40bf-88ab-3dcc9eb789e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:25.025893 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0d890-729b-40bf-88ab-3dcc9eb789e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:25.026545 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0d890-729b-40bf-88ab-3dcc9eb789e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:25.036008 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-baf0d890-729b-40bf-88ab-3dcc9eb789e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:25.097143 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:25.111951 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff1b4a-000e-48cb-87bd-e23f715f42ab service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:25.113801 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-e6ff1b4a-000e-48cb-87bd-e23f715f42ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:25.126295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0d890-729b-40bf-88ab-3dcc9eb789e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:25.129112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0d890-729b-40bf-88ab-3dcc9eb789e4 service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:25.139722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff1b4a-000e-48cb-87bd-e23f715f42ab service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:25.141375 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 904/1828] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:25.146957 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ffb45-5ae8-4349-b592-046871fd3afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:25.148074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ffb45-5ae8-4349-b592-046871fd3afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:25.148157 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ffb45-5ae8-4349-b592-046871fd3afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:25.148416 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ffb45-5ae8-4349-b592-046871fd3afd admin admin] PATH_INFO: `/v3/projects/e850bae55371493cb840433c1376e0ab` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:25.149830 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ffb45-5ae8-4349-b592-046871fd3afd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e850bae55371493cb840433c1376e0ab)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:25.154316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ffb45-5ae8-4349-b592-046871fd3afd admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:25.293922 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-264ffb45-5ae8-4349-b592-046871fd3afd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e850bae55371493cb840433c1376e0ab', 'request_id': 'req-264ffb45-5ae8-4349-b592-046871fd3afd'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:25.306338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-264ffb45-5ae8-4349-b592-046871fd3afd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e850bae55371493cb840433c1376e0ab', 'request_id': 'req-264ffb45-5ae8-4349-b592-046871fd3afd'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:25.320641 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-264ffb45-5ae8-4349-b592-046871fd3afd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e850bae55371493cb840433c1376e0ab', 'request_id': 'req-264ffb45-5ae8-4349-b592-046871fd3afd'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:25.351610 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-264ffb45-5ae8-4349-b592-046871fd3afd admin admin] The token cache is being invalidate because project e850bae55371493cb840433c1376e0ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:25.352046 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-264ffb45-5ae8-4349-b592-046871fd3afd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:25.352851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-264ffb45-5ae8-4349-b592-046871fd3afd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:25.354987 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 925/1829] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:25 2022] DELETE /identity/v3/projects/e850bae55371493cb840433c1376e0ab => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:25.358994 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0d890-729b-40bf-88ab-3dcc9eb789e4 service cinder] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:25.376649 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0d890-729b-40bf-88ab-3dcc9eb789e4 service cinder] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:25.491065 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6866a71-965d-41ff-b687-b183d4871e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:25.492060 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6866a71-965d-41ff-b687-b183d4871e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:25.492341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6866a71-965d-41ff-b687-b183d4871e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:25.492616 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6866a71-965d-41ff-b687-b183d4871e77 admin admin] PATH_INFO: `/v3/users/99038ca5243f429a8d971e08c08f5fda` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:25.493849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6866a71-965d-41ff-b687-b183d4871e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99038ca5243f429a8d971e08c08f5fda)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:25.495891 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6866a71-965d-41ff-b687-b183d4871e77 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:25.620713 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c6866a71-965d-41ff-b687-b183d4871e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99038ca5243f429a8d971e08c08f5fda'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:25.637860 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c6866a71-965d-41ff-b687-b183d4871e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99038ca5243f429a8d971e08c08f5fda'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:25.638623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c6866a71-965d-41ff-b687-b183d4871e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99038ca5243f429a8d971e08c08f5fda'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:25.668179 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c6866a71-965d-41ff-b687-b183d4871e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99038ca5243f429a8d971e08c08f5fda'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:25.685488 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c6866a71-965d-41ff-b687-b183d4871e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99038ca5243f429a8d971e08c08f5fda'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:25.702562 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 905/1830] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:25 2022] DELETE /identity/v3/users/99038ca5243f429a8d971e08c08f5fda => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:26.620656 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ffb45-5ae8-4349-b592-046871fd3afd admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:26.622379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-264ffb45-5ae8-4349-b592-046871fd3afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:26.637349 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ffb45-5ae8-4349-b592-046871fd3afd admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:26.637494 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6866a71-965d-41ff-b687-b183d4871e77 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:26.638973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-c6866a71-965d-41ff-b687-b183d4871e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:26.697246 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:26.710718 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a4b57-8ac7-4dc6-acc1-0710b6fb26a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:26.711879 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a4b57-8ac7-4dc6-acc1-0710b6fb26a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:26.712261 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a4b57-8ac7-4dc6-acc1-0710b6fb26a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:26.713187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a4b57-8ac7-4dc6-acc1-0710b6fb26a1 admin admin] PATH_INFO: `/v3/users/d1cc037de16940009399412a85bcf529` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:26.714540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a4b57-8ac7-4dc6-acc1-0710b6fb26a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1cc037de16940009399412a85bcf529)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:26.716773 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a4b57-8ac7-4dc6-acc1-0710b6fb26a1 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:26.718299 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6866a71-965d-41ff-b687-b183d4871e77 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:26.734524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4ce20-995c-4f6b-8565-6d9b6d63d1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:26.737613 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4ce20-995c-4f6b-8565-6d9b6d63d1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:26.738055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4ce20-995c-4f6b-8565-6d9b6d63d1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:26.738500 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4ce20-995c-4f6b-8565-6d9b6d63d1c7 admin admin] PATH_INFO: `/v3/projects/0d75ba3ac12d4760aab4c0778c76d54e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:26.739963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4ce20-995c-4f6b-8565-6d9b6d63d1c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d75ba3ac12d4760aab4c0778c76d54e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:26.743807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4ce20-995c-4f6b-8565-6d9b6d63d1c7 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:26.819356 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:26.849805 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-731a4b57-8ac7-4dc6-acc1-0710b6fb26a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1cc037de16940009399412a85bcf529'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:26.851039 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-731a4b57-8ac7-4dc6-acc1-0710b6fb26a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1cc037de16940009399412a85bcf529'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:26.867002 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e3d4ce20-995c-4f6b-8565-6d9b6d63d1c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d75ba3ac12d4760aab4c0778c76d54e', 'request_id': 'req-e3d4ce20-995c-4f6b-8565-6d9b6d63d1c7'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:26.869012 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-731a4b57-8ac7-4dc6-acc1-0710b6fb26a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1cc037de16940009399412a85bcf529'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:26.871634 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-731a4b57-8ac7-4dc6-acc1-0710b6fb26a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1cc037de16940009399412a85bcf529'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:26.879145 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e3d4ce20-995c-4f6b-8565-6d9b6d63d1c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d75ba3ac12d4760aab4c0778c76d54e', 'request_id': 'req-e3d4ce20-995c-4f6b-8565-6d9b6d63d1c7'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:26.887573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e3d4ce20-995c-4f6b-8565-6d9b6d63d1c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d75ba3ac12d4760aab4c0778c76d54e', 'request_id': 'req-e3d4ce20-995c-4f6b-8565-6d9b6d63d1c7'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:26.896283 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-731a4b57-8ac7-4dc6-acc1-0710b6fb26a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1cc037de16940009399412a85bcf529'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:26.908535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e3d4ce20-995c-4f6b-8565-6d9b6d63d1c7 admin admin] The token cache is being invalidate because project 0d75ba3ac12d4760aab4c0778c76d54e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:26.909001 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e3d4ce20-995c-4f6b-8565-6d9b6d63d1c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:26.909748 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e3d4ce20-995c-4f6b-8565-6d9b6d63d1c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:26.914176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 906/1831] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:26 2022] DELETE /identity/v3/projects/0d75ba3ac12d4760aab4c0778c76d54e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:26.916831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4ce20-995c-4f6b-8565-6d9b6d63d1c7 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:26.919880 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e3d4ce20-995c-4f6b-8565-6d9b6d63d1c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:26.972648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 926/1832] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:26 2022] DELETE /identity/v3/users/d1cc037de16940009399412a85bcf529 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:26.979835 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02127355-79ac-47ab-82f2-8f67348e66f4 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:26.980254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02127355-79ac-47ab-82f2-8f67348e66f4 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:26.981079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02127355-79ac-47ab-82f2-8f67348e66f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:27.021176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-02127355-79ac-47ab-82f2-8f67348e66f4 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:27.024071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-02127355-79ac-47ab-82f2-8f67348e66f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:27.085667 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4ce20-995c-4f6b-8565-6d9b6d63d1c7 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:27.187075 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b21d5-ed09-40c5-a25b-3c4f2d29d8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:27.188023 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b21d5-ed09-40c5-a25b-3c4f2d29d8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:27.188382 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b21d5-ed09-40c5-a25b-3c4f2d29d8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:27.189114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b21d5-ed09-40c5-a25b-3c4f2d29d8c3 admin admin] PATH_INFO: `/v3/users/a0324abb856b47fb84032c6694e499d2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:27.192984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b21d5-ed09-40c5-a25b-3c4f2d29d8c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0324abb856b47fb84032c6694e499d2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:27.195346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b21d5-ed09-40c5-a25b-3c4f2d29d8c3 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:27.270743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 927/1833] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:27.287753 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:27.319643 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e45b21d5-ed09-40c5-a25b-3c4f2d29d8c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0324abb856b47fb84032c6694e499d2'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:27.350835 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e45b21d5-ed09-40c5-a25b-3c4f2d29d8c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0324abb856b47fb84032c6694e499d2'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:27.354887 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e45b21d5-ed09-40c5-a25b-3c4f2d29d8c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0324abb856b47fb84032c6694e499d2'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:27.391320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02127355-79ac-47ab-82f2-8f67348e66f4 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:27.393834 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-02127355-79ac-47ab-82f2-8f67348e66f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:27.404527 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e45b21d5-ed09-40c5-a25b-3c4f2d29d8c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0324abb856b47fb84032c6694e499d2'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:27.418808 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e45b21d5-ed09-40c5-a25b-3c4f2d29d8c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0324abb856b47fb84032c6694e499d2'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:27.438432 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 907/1834] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:26 2022] DELETE /identity/v3/users/a0324abb856b47fb84032c6694e499d2 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:39:27.570485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02127355-79ac-47ab-82f2-8f67348e66f4 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:27.666579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272409c-2b61-4490-af3b-f1b40c657e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:27.667249 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272409c-2b61-4490-af3b-f1b40c657e14 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:27.667699 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272409c-2b61-4490-af3b-f1b40c657e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:27.667888 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272409c-2b61-4490-af3b-f1b40c657e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:27.669831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-6272409c-2b61-4490-af3b-f1b40c657e14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:27.683938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af3123-c154-45dc-9d9f-4d820fa83c32 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:27.684469 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af3123-c154-45dc-9d9f-4d820fa83c32 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:27.685467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af3123-c154-45dc-9d9f-4d820fa83c32 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:27.686954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 908/1835] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 09:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:39:27.694516 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:27.709166 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf16a05-cc68-4dfb-b93d-badb70fb227c None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:27.709747 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf16a05-cc68-4dfb-b93d-badb70fb227c None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:27.710133 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf16a05-cc68-4dfb-b93d-badb70fb227c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:27.746172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-8bf16a05-cc68-4dfb-b93d-badb70fb227c None None] MFA Rules not processed for user `d2b1c12e88c549208894fc0dd0c60b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:27.749928 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-8bf16a05-cc68-4dfb-b93d-badb70fb227c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:27.754211 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272409c-2b61-4490-af3b-f1b40c657e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:27.755863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272409c-2b61-4490-af3b-f1b40c657e14 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:27.770091 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 928/1836] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:39:27.901358 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c9412-2fe4-4720-972c-ad416d7263c0 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:27.902081 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c9412-2fe4-4720-972c-ad416d7263c0 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:27.902546 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c9412-2fe4-4720-972c-ad416d7263c0 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:27.904935 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 929/1837] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 09:39:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:39:27.914892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 909/1838] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 09:39:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:27.926433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092601f-b2b8-41ff-9158-0b869ed5b5ae None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:27.927558 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092601f-b2b8-41ff-9158-0b869ed5b5ae None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:27.927988 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092601f-b2b8-41ff-9158-0b869ed5b5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:27.950908 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-a092601f-b2b8-41ff-9158-0b869ed5b5ae None None] MFA Rules not processed for user `d2b1c12e88c549208894fc0dd0c60b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:27.952171 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-a092601f-b2b8-41ff-9158-0b869ed5b5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:27.963086 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 930/1839] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 09:39:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:28.208449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf16a05-cc68-4dfb-b93d-badb70fb227c None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:28.209775 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-8bf16a05-cc68-4dfb-b93d-badb70fb227c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:28.223059 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf16a05-cc68-4dfb-b93d-badb70fb227c None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:28.229947 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb18831-1a28-487b-b335-f1df8c8e8e80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:28.230618 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb18831-1a28-487b-b335-f1df8c8e8e80 service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:28.230901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb18831-1a28-487b-b335-f1df8c8e8e80 service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:28.231175 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb18831-1a28-487b-b335-f1df8c8e8e80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:28.240996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb18831-1a28-487b-b335-f1df8c8e8e80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:28.242584 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb18831-1a28-487b-b335-f1df8c8e8e80 service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:28.255720 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 910/1840] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:28.266248 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092601f-b2b8-41ff-9158-0b869ed5b5ae None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:28.269390 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-a092601f-b2b8-41ff-9158-0b869ed5b5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:28.303825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092601f-b2b8-41ff-9158-0b869ed5b5ae None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:28.308463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145d07a-0f4c-4552-a3f9-6e145cd9d410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:28.309467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145d07a-0f4c-4552-a3f9-6e145cd9d410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:28.309851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145d07a-0f4c-4552-a3f9-6e145cd9d410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:28.310244 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145d07a-0f4c-4552-a3f9-6e145cd9d410 admin admin] PATH_INFO: `/v3/projects/8c8080e399e24746bd0f01113ec9e20f` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:28.311616 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145d07a-0f4c-4552-a3f9-6e145cd9d410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c8080e399e24746bd0f01113ec9e20f)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:28.313865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145d07a-0f4c-4552-a3f9-6e145cd9d410 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:28.348244 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb18831-1a28-487b-b335-f1df8c8e8e80 service nova] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:28.364212 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb18831-1a28-487b-b335-f1df8c8e8e80 service nova] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:28.375351 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9e6ca-e416-4f15-9b42-71c5354aad34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:28.376111 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9e6ca-e416-4f15-9b42-71c5354aad34 service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:28.376396 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9e6ca-e416-4f15-9b42-71c5354aad34 service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:28.378677 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9e6ca-e416-4f15-9b42-71c5354aad34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:28.394536 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9e6ca-e416-4f15-9b42-71c5354aad34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:28.398097 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-9145d07a-0f4c-4552-a3f9-6e145cd9d410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c8080e399e24746bd0f01113ec9e20f', 'request_id': 'req-9145d07a-0f4c-4552-a3f9-6e145cd9d410'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:28.401228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9e6ca-e416-4f15-9b42-71c5354aad34 service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:28.412843 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-9145d07a-0f4c-4552-a3f9-6e145cd9d410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c8080e399e24746bd0f01113ec9e20f', 'request_id': 'req-9145d07a-0f4c-4552-a3f9-6e145cd9d410'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:28.421533 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-9145d07a-0f4c-4552-a3f9-6e145cd9d410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c8080e399e24746bd0f01113ec9e20f', 'request_id': 'req-9145d07a-0f4c-4552-a3f9-6e145cd9d410'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:28.424133 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 911/1841] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:39:28.440259 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-9145d07a-0f4c-4552-a3f9-6e145cd9d410 admin admin] The token cache is being invalidate because project 8c8080e399e24746bd0f01113ec9e20f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:28.440660 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-9145d07a-0f4c-4552-a3f9-6e145cd9d410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:28.442006 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-9145d07a-0f4c-4552-a3f9-6e145cd9d410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:28.444264 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 931/1842] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:28 2022] DELETE /identity/v3/projects/8c8080e399e24746bd0f01113ec9e20f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:28.449783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671613d-8d26-4c8c-9d0e-f886b9f001ca None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:28.450075 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671613d-8d26-4c8c-9d0e-f886b9f001ca None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:28.450358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671613d-8d26-4c8c-9d0e-f886b9f001ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:28.477879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-8671613d-8d26-4c8c-9d0e-f886b9f001ca None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:28.479714 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-8671613d-8d26-4c8c-9d0e-f886b9f001ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:28.591825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 912/1843] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:28.593008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4b708-8439-4347-aa77-5d47fb9016e0 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:28.593377 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4b708-8439-4347-aa77-5d47fb9016e0 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:28.593584 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4b708-8439-4347-aa77-5d47fb9016e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:28.624204 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-68e4b708-8439-4347-aa77-5d47fb9016e0 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:28.625468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-68e4b708-8439-4347-aa77-5d47fb9016e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:28.635401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 932/1844] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:28.639810 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671613d-8d26-4c8c-9d0e-f886b9f001ca None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:28.652427 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671613d-8d26-4c8c-9d0e-f886b9f001ca None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:28.659082 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bba282-1e4f-4981-8f84-b2ce3c3e4ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:28.659963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bba282-1e4f-4981-8f84-b2ce3c3e4ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:28.660314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bba282-1e4f-4981-8f84-b2ce3c3e4ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:28.660674 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bba282-1e4f-4981-8f84-b2ce3c3e4ba5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:28.661479 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bba282-1e4f-4981-8f84-b2ce3c3e4ba5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:39:28.661852 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bba282-1e4f-4981-8f84-b2ce3c3e4ba5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:28.663897 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bba282-1e4f-4981-8f84-b2ce3c3e4ba5 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:28.673402 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:28.689149 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4b708-8439-4347-aa77-5d47fb9016e0 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:28.693808 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 913/1845] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:39:28.699758 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4b708-8439-4347-aa77-5d47fb9016e0 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:28.705628 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ffe41-29d4-491d-825c-04368d125057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:28.706482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ffe41-29d4-491d-825c-04368d125057 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:28.706770 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ffe41-29d4-491d-825c-04368d125057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:28.707800 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ffe41-29d4-491d-825c-04368d125057 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:28.708671 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ffe41-29d4-491d-825c-04368d125057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:28.710622 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ffe41-29d4-491d-825c-04368d125057 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:28.748186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bba282-1e4f-4981-8f84-b2ce3c3e4ba5 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:28.756620 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 933/1846] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:28 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:28.763131 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bba282-1e4f-4981-8f84-b2ce3c3e4ba5 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:28.908875 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12a2d4-4b69-4a59-9c5e-02247437fcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:28.909823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12a2d4-4b69-4a59-9c5e-02247437fcfb admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:28.909963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12a2d4-4b69-4a59-9c5e-02247437fcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:28.910135 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12a2d4-4b69-4a59-9c5e-02247437fcfb admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:28.910833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12a2d4-4b69-4a59-9c5e-02247437fcfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:28.912821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12a2d4-4b69-4a59-9c5e-02247437fcfb admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:28.966405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 914/1847] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:28 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:28.971240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ffe41-29d4-491d-825c-04368d125057 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:28.987668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ffe41-29d4-491d-825c-04368d125057 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:28.998413 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f36028-069b-4edf-a041-8b81732b9425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:28.999184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f36028-069b-4edf-a041-8b81732b9425 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:28.999500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f36028-069b-4edf-a041-8b81732b9425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:29.000122 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f36028-069b-4edf-a041-8b81732b9425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:29.000520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f36028-069b-4edf-a041-8b81732b9425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:29.002710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f36028-069b-4edf-a041-8b81732b9425 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:29.025154 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 934/1848] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:29.029606 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12a2d4-4b69-4a59-9c5e-02247437fcfb admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:29.051618 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12a2d4-4b69-4a59-9c5e-02247437fcfb admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:29.069124 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3f0cc-21e1-42f4-a67e-b3bb8acf7ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:29.070004 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3f0cc-21e1-42f4-a67e-b3bb8acf7ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:29.070294 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3f0cc-21e1-42f4-a67e-b3bb8acf7ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:29.070576 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3f0cc-21e1-42f4-a67e-b3bb8acf7ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:29.071394 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3f0cc-21e1-42f4-a67e-b3bb8acf7ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:29.073185 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3f0cc-21e1-42f4-a67e-b3bb8acf7ed7 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:29.087015 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 915/1849] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:29.090825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f36028-069b-4edf-a041-8b81732b9425 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:29.105010 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f36028-069b-4edf-a041-8b81732b9425 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:29.112803 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a3ebe-d7ba-4046-8034-a567e8d03d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:29.113864 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a3ebe-d7ba-4046-8034-a567e8d03d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:29.114156 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a3ebe-d7ba-4046-8034-a567e8d03d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:29.114439 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a3ebe-d7ba-4046-8034-a567e8d03d37 admin admin] PATH_INFO: `/v3/projects/416975c7aa93428fb90fb832ee4049ad/users/84cf88078dec4d9592d5d9d2ddd4d64f/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:29.151920 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a3ebe-d7ba-4046-8034-a567e8d03d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=416975c7aa93428fb90fb832ee4049ad, user_id=84cf88078dec4d9592d5d9d2ddd4d64f, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:29.154679 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a3ebe-d7ba-4046-8034-a567e8d03d37 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:29.175409 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 935/1850] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:29 2022] PUT /identity/v3/projects/416975c7aa93428fb90fb832ee4049ad/users/84cf88078dec4d9592d5d9d2ddd4d64f/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:39:29.181601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecb47c-1db9-4131-8c05-e4b39bdc32fb None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:29.183853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecb47c-1db9-4131-8c05-e4b39bdc32fb None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:29.183853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecb47c-1db9-4131-8c05-e4b39bdc32fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:29.223732 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-d8ecb47c-1db9-4131-8c05-e4b39bdc32fb None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:29.225006 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-d8ecb47c-1db9-4131-8c05-e4b39bdc32fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:29.273804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a3ebe-d7ba-4046-8034-a567e8d03d37 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:29.275730 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-fd0a3ebe-d7ba-4046-8034-a567e8d03d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:29.317105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 916/1851] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:29.339669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:29.355827 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecb47c-1db9-4131-8c05-e4b39bdc32fb None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:29.358189 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-d8ecb47c-1db9-4131-8c05-e4b39bdc32fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:29.397782 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a3ebe-d7ba-4046-8034-a567e8d03d37 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:29.408851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a3fb4-5b46-4c4b-a09d-fcea0b5618af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:29.410033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a3fb4-5b46-4c4b-a09d-fcea0b5618af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:29.410326 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a3fb4-5b46-4c4b-a09d-fcea0b5618af admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:29.410674 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a3fb4-5b46-4c4b-a09d-fcea0b5618af admin admin] PATH_INFO: `/v3/projects/008091b03d6e48809bbe2bf9be881f6b` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:29.411952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a3fb4-5b46-4c4b-a09d-fcea0b5618af admin admin] RBAC: Authorizing `identity:delete_project(project_id=008091b03d6e48809bbe2bf9be881f6b)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:29.414386 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a3fb4-5b46-4c4b-a09d-fcea0b5618af admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:29.461537 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecb47c-1db9-4131-8c05-e4b39bdc32fb None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:29.468400 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57067107-42be-409d-b4ea-d2d2b0814871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:29.469200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57067107-42be-409d-b4ea-d2d2b0814871 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:29.470137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57067107-42be-409d-b4ea-d2d2b0814871 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:29.470558 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57067107-42be-409d-b4ea-d2d2b0814871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:29.484643 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57067107-42be-409d-b4ea-d2d2b0814871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:29.486907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57067107-42be-409d-b4ea-d2d2b0814871 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:29.510145 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 917/1852] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:39:29.516320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-c14a3fb4-5b46-4c4b-a09d-fcea0b5618af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '008091b03d6e48809bbe2bf9be881f6b', 'request_id': 'req-c14a3fb4-5b46-4c4b-a09d-fcea0b5618af'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:29.531754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-c14a3fb4-5b46-4c4b-a09d-fcea0b5618af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '008091b03d6e48809bbe2bf9be881f6b', 'request_id': 'req-c14a3fb4-5b46-4c4b-a09d-fcea0b5618af'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:29.538894 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-c14a3fb4-5b46-4c4b-a09d-fcea0b5618af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '008091b03d6e48809bbe2bf9be881f6b', 'request_id': 'req-c14a3fb4-5b46-4c4b-a09d-fcea0b5618af'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:29.554726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-c14a3fb4-5b46-4c4b-a09d-fcea0b5618af admin admin] The token cache is being invalidate because project 008091b03d6e48809bbe2bf9be881f6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:29.554915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-c14a3fb4-5b46-4c4b-a09d-fcea0b5618af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:29.555662 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-c14a3fb4-5b46-4c4b-a09d-fcea0b5618af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:29.557754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 936/1853] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:29 2022] DELETE /identity/v3/projects/008091b03d6e48809bbe2bf9be881f6b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:29.561707 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57067107-42be-409d-b4ea-d2d2b0814871 service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:29.576626 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57067107-42be-409d-b4ea-d2d2b0814871 service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:29.602304 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:29.664253 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a3fb4-5b46-4c4b-a09d-fcea0b5618af admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:29.666072 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-c14a3fb4-5b46-4c4b-a09d-fcea0b5618af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:29.683004 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7e0cb-398d-4ce8-a830-c411aa2b83a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:29.684879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7e0cb-398d-4ce8-a830-c411aa2b83a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:29.685455 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7e0cb-398d-4ce8-a830-c411aa2b83a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:29.687217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7e0cb-398d-4ce8-a830-c411aa2b83a4 admin admin] PATH_INFO: `/v3/users/d1792fe46e4f4e41a5d072fd29ab4402` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:29.691783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7e0cb-398d-4ce8-a830-c411aa2b83a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1792fe46e4f4e41a5d072fd29ab4402)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:29.693856 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7e0cb-398d-4ce8-a830-c411aa2b83a4 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:29.798765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-b0c7e0cb-398d-4ce8-a830-c411aa2b83a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1792fe46e4f4e41a5d072fd29ab4402'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:29.807985 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-b0c7e0cb-398d-4ce8-a830-c411aa2b83a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1792fe46e4f4e41a5d072fd29ab4402'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:29.808384 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a3fb4-5b46-4c4b-a09d-fcea0b5618af admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:29.810395 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-b0c7e0cb-398d-4ce8-a830-c411aa2b83a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1792fe46e4f4e41a5d072fd29ab4402'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:29.819733 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0a5b8-0fc3-43c1-8865-4b27b87fad3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:29.820822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0a5b8-0fc3-43c1-8865-4b27b87fad3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:29.821251 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0a5b8-0fc3-43c1-8865-4b27b87fad3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:29.822511 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0a5b8-0fc3-43c1-8865-4b27b87fad3a admin admin] PATH_INFO: `/v3/projects/b65acc1d0c1b4e9e8ae67337603ea0ec` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:29.824557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f0a5b8-0fc3-43c1-8865-4b27b87fad3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b65acc1d0c1b4e9e8ae67337603ea0ec)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:29.829529 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f0a5b8-0fc3-43c1-8865-4b27b87fad3a admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:29.843187 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-b0c7e0cb-398d-4ce8-a830-c411aa2b83a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1792fe46e4f4e41a5d072fd29ab4402'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:29.855855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-b0c7e0cb-398d-4ce8-a830-c411aa2b83a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1792fe46e4f4e41a5d072fd29ab4402'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:29.867881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 918/1854] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:29 2022] DELETE /identity/v3/users/d1792fe46e4f4e41a5d072fd29ab4402 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:29.924754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e9f0a5b8-0fc3-43c1-8865-4b27b87fad3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b65acc1d0c1b4e9e8ae67337603ea0ec', 'request_id': 'req-e9f0a5b8-0fc3-43c1-8865-4b27b87fad3a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:29.934158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e9f0a5b8-0fc3-43c1-8865-4b27b87fad3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b65acc1d0c1b4e9e8ae67337603ea0ec', 'request_id': 'req-e9f0a5b8-0fc3-43c1-8865-4b27b87fad3a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:29.941120 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:29.944737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e9f0a5b8-0fc3-43c1-8865-4b27b87fad3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b65acc1d0c1b4e9e8ae67337603ea0ec', 'request_id': 'req-e9f0a5b8-0fc3-43c1-8865-4b27b87fad3a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:29.964936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e9f0a5b8-0fc3-43c1-8865-4b27b87fad3a admin admin] The token cache is being invalidate because project b65acc1d0c1b4e9e8ae67337603ea0ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:29.965307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e9f0a5b8-0fc3-43c1-8865-4b27b87fad3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:29.966221 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e9f0a5b8-0fc3-43c1-8865-4b27b87fad3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:29.973108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 937/1855] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:29 2022] DELETE /identity/v3/projects/b65acc1d0c1b4e9e8ae67337603ea0ec => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:39:29.978265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db6ffe-4c3f-4046-ae9b-2ef9bc675eff None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:29.979162 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db6ffe-4c3f-4046-ae9b-2ef9bc675eff None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:29.979724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db6ffe-4c3f-4046-ae9b-2ef9bc675eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:30.010590 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-64db6ffe-4c3f-4046-ae9b-2ef9bc675eff None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:30.013504 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-64db6ffe-4c3f-4046-ae9b-2ef9bc675eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:30.106967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 919/1856] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:30.117521 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611b01a-6528-4fca-b325-e9e1317160d3 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:30.118092 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611b01a-6528-4fca-b325-e9e1317160d3 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:30.118735 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611b01a-6528-4fca-b325-e9e1317160d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:30.145107 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-9611b01a-6528-4fca-b325-e9e1317160d3 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:30.146514 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-9611b01a-6528-4fca-b325-e9e1317160d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:30.158031 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 938/1857] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:30.162383 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db6ffe-4c3f-4046-ae9b-2ef9bc675eff None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:30.176352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db6ffe-4c3f-4046-ae9b-2ef9bc675eff None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:30.182825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d8204-18a9-4733-a08f-5761277a5c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:30.183781 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d8204-18a9-4733-a08f-5761277a5c96 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:30.184087 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d8204-18a9-4733-a08f-5761277a5c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:30.184340 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d8204-18a9-4733-a08f-5761277a5c96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:30.186114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d8204-18a9-4733-a08f-5761277a5c96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:39:30.186515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d8204-18a9-4733-a08f-5761277a5c96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:30.189894 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d8204-18a9-4733-a08f-5761277a5c96 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:30.206958 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 920/1858] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:39:30.211331 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611b01a-6528-4fca-b325-e9e1317160d3 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:30.226318 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611b01a-6528-4fca-b325-e9e1317160d3 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:30.237667 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de974536-c2f6-4907-96b6-9d436c548b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:30.238410 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de974536-c2f6-4907-96b6-9d436c548b42 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:30.238690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de974536-c2f6-4907-96b6-9d436c548b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:30.239141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de974536-c2f6-4907-96b6-9d436c548b42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:30.240324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de974536-c2f6-4907-96b6-9d436c548b42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:30.247897 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de974536-c2f6-4907-96b6-9d436c548b42 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:30.302002 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 939/1859] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:30 2022] POST /identity/v3/projects => generated 369 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:30.306659 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d8204-18a9-4733-a08f-5761277a5c96 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:30.322037 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d8204-18a9-4733-a08f-5761277a5c96 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:30.378419 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:30.431603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de974536-c2f6-4907-96b6-9d436c548b42 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:30.434730 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-de974536-c2f6-4907-96b6-9d436c548b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:30.470983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa652dd9-b27f-4bc9-8a81-f6b6791e2141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:30.471739 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa652dd9-b27f-4bc9-8a81-f6b6791e2141 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:30.472024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa652dd9-b27f-4bc9-8a81-f6b6791e2141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:30.472958 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa652dd9-b27f-4bc9-8a81-f6b6791e2141 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:30.474252 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa652dd9-b27f-4bc9-8a81-f6b6791e2141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:30.477520 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa652dd9-b27f-4bc9-8a81-f6b6791e2141 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:30.513045 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 921/1860] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:30 2022] POST /identity/v3/users => generated 285 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:39:30.517603 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa652dd9-b27f-4bc9-8a81-f6b6791e2141 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:30.541000 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa652dd9-b27f-4bc9-8a81-f6b6791e2141 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:30.545940 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f3000-ef6e-4740-aee9-cef31fbc0011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:30.546620 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f3000-ef6e-4740-aee9-cef31fbc0011 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:30.547258 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f3000-ef6e-4740-aee9-cef31fbc0011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:30.547440 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f3000-ef6e-4740-aee9-cef31fbc0011 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:30.548140 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f3000-ef6e-4740-aee9-cef31fbc0011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:30.550677 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f3000-ef6e-4740-aee9-cef31fbc0011 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:30.566115 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 922/1861] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:30.567626 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f3000-ef6e-4740-aee9-cef31fbc0011 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:30.584599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de974536-c2f6-4907-96b6-9d436c548b42 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:30.589747 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda7d00-254c-4ff4-85b0-1e1b4c7db9d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:30.590434 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda7d00-254c-4ff4-85b0-1e1b4c7db9d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:30.590721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda7d00-254c-4ff4-85b0-1e1b4c7db9d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:30.591002 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda7d00-254c-4ff4-85b0-1e1b4c7db9d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:30.593049 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-4fda7d00-254c-4ff4-85b0-1e1b4c7db9d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:30.594093 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f3000-ef6e-4740-aee9-cef31fbc0011 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:30.611017 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de489d6-2a52-4361-b80e-81bce5f5a343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:30.612761 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de489d6-2a52-4361-b80e-81bce5f5a343 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:30.613459 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de489d6-2a52-4361-b80e-81bce5f5a343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:30.613719 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de489d6-2a52-4361-b80e-81bce5f5a343 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:30.616768 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de489d6-2a52-4361-b80e-81bce5f5a343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:30.620048 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de489d6-2a52-4361-b80e-81bce5f5a343 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:30.635055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 923/1862] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:30.640649 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de489d6-2a52-4361-b80e-81bce5f5a343 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:30.653393 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de489d6-2a52-4361-b80e-81bce5f5a343 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:30.663239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ae440-cb87-45e0-a1f3-9c63b2fbc393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:30.671942 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ae440-cb87-45e0-a1f3-9c63b2fbc393 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:30.672304 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ae440-cb87-45e0-a1f3-9c63b2fbc393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:30.672658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ae440-cb87-45e0-a1f3-9c63b2fbc393 admin admin] PATH_INFO: `/v3/projects/e3fca5941b104f56af053793a6f749c1/users/5ae1b1a298e448a0acc198201d79dd71/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:30.712165 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda7d00-254c-4ff4-85b0-1e1b4c7db9d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:30.714074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda7d00-254c-4ff4-85b0-1e1b4c7db9d6 service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:30.716594 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ae440-cb87-45e0-a1f3-9c63b2fbc393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3fca5941b104f56af053793a6f749c1, user_id=5ae1b1a298e448a0acc198201d79dd71, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:30.728506 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ae440-cb87-45e0-a1f3-9c63b2fbc393 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:30.733130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 940/1863] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:30.746840 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 924/1864] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:30 2022] PUT /identity/v3/projects/e3fca5941b104f56af053793a6f749c1/users/5ae1b1a298e448a0acc198201d79dd71/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:30.761983 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbff89-5e9d-4f9a-9b59-d00c7cf2ff80 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:30.762283 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbff89-5e9d-4f9a-9b59-d00c7cf2ff80 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:30.762571 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbff89-5e9d-4f9a-9b59-d00c7cf2ff80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:30.763413 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c59c8-9b99-4e51-a85d-43e72439415a None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:30.764843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c59c8-9b99-4e51-a85d-43e72439415a None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:30.765427 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c59c8-9b99-4e51-a85d-43e72439415a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:30.850308 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-cf7c59c8-9b99-4e51-a85d-43e72439415a None None] MFA Rules not processed for user `5ae1b1a298e448a0acc198201d79dd71`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:30.852887 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-cf7c59c8-9b99-4e51-a85d-43e72439415a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:30.855728 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-b2bbff89-5e9d-4f9a-9b59-d00c7cf2ff80 None None] MFA Rules not processed for user `84cf88078dec4d9592d5d9d2ddd4d64f`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:30.857150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-b2bbff89-5e9d-4f9a-9b59-d00c7cf2ff80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:31.007088 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 925/1865] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:31.008878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c59c8-9b99-4e51-a85d-43e72439415a None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:31.010616 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-cf7c59c8-9b99-4e51-a85d-43e72439415a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:31.043372 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 941/1866] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:31.044174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bbff89-5e9d-4f9a-9b59-d00c7cf2ff80 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:31.057304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:31.152522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c59c8-9b99-4e51-a85d-43e72439415a None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:31.158450 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3998cf-9b89-45e9-8393-bd8d3ce5c1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:31.159721 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3998cf-9b89-45e9-8393-bd8d3ce5c1b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:31.160019 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3998cf-9b89-45e9-8393-bd8d3ce5c1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:31.160305 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3998cf-9b89-45e9-8393-bd8d3ce5c1b5 admin admin] PATH_INFO: `/v3/projects/64972e5f58ae4896bc96e504a432f232` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:31.161533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3998cf-9b89-45e9-8393-bd8d3ce5c1b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64972e5f58ae4896bc96e504a432f232)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:31.163510 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3998cf-9b89-45e9-8393-bd8d3ce5c1b5 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:31.165262 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:31.179505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bbff89-5e9d-4f9a-9b59-d00c7cf2ff80 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:31.186836 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364df1d-e527-46b5-9eee-da931abb9894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:31.187917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364df1d-e527-46b5-9eee-da931abb9894 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:31.188535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364df1d-e527-46b5-9eee-da931abb9894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:31.189658 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364df1d-e527-46b5-9eee-da931abb9894 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:31.190984 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364df1d-e527-46b5-9eee-da931abb9894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:31.193223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364df1d-e527-46b5-9eee-da931abb9894 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:31.242843 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 942/1867] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:31 2022] POST /identity/v3/projects => generated 367 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:31.242843 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364df1d-e527-46b5-9eee-da931abb9894 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:31.243547 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-5364df1d-e527-46b5-9eee-da931abb9894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:31.255920 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-2e3998cf-9b89-45e9-8393-bd8d3ce5c1b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64972e5f58ae4896bc96e504a432f232', 'request_id': 'req-2e3998cf-9b89-45e9-8393-bd8d3ce5c1b5'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:31.299099 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-2e3998cf-9b89-45e9-8393-bd8d3ce5c1b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64972e5f58ae4896bc96e504a432f232', 'request_id': 'req-2e3998cf-9b89-45e9-8393-bd8d3ce5c1b5'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:31.306270 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-2e3998cf-9b89-45e9-8393-bd8d3ce5c1b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64972e5f58ae4896bc96e504a432f232', 'request_id': 'req-2e3998cf-9b89-45e9-8393-bd8d3ce5c1b5'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:31.335144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-2e3998cf-9b89-45e9-8393-bd8d3ce5c1b5 admin admin] The token cache is being invalidate because project 64972e5f58ae4896bc96e504a432f232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:31.335491 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-2e3998cf-9b89-45e9-8393-bd8d3ce5c1b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:31.343189 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-2e3998cf-9b89-45e9-8393-bd8d3ce5c1b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:31.343850 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364df1d-e527-46b5-9eee-da931abb9894 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:31.344944 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 926/1868] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:31 2022] DELETE /identity/v3/projects/64972e5f58ae4896bc96e504a432f232 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:31.349783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3998cf-9b89-45e9-8393-bd8d3ce5c1b5 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:31.351177 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-2e3998cf-9b89-45e9-8393-bd8d3ce5c1b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:31.353491 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fdc9a-bd7e-43b4-ab73-96cef070962c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:31.354295 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fdc9a-bd7e-43b4-ab73-96cef070962c admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:31.354608 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fdc9a-bd7e-43b4-ab73-96cef070962c admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:31.354898 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fdc9a-bd7e-43b4-ab73-96cef070962c admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:31.355727 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007fdc9a-bd7e-43b4-ab73-96cef070962c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:31.358543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007fdc9a-bd7e-43b4-ab73-96cef070962c admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:31.402051 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 943/1869] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:31 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:31.402051 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945fba0-2b4f-437f-9158-eb7fe9d4f4e3 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:31.402051 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945fba0-2b4f-437f-9158-eb7fe9d4f4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:31.402051 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945fba0-2b4f-437f-9158-eb7fe9d4f4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:31.430461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-e945fba0-2b4f-437f-9158-eb7fe9d4f4e3 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:31.431881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-e945fba0-2b4f-437f-9158-eb7fe9d4f4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:31.443477 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3998cf-9b89-45e9-8393-bd8d3ce5c1b5 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:31.531870 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fb60c-a268-4365-a04a-06efc8dc1afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:31.532817 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fb60c-a268-4365-a04a-06efc8dc1afd admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:31.533842 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fb60c-a268-4365-a04a-06efc8dc1afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:31.534295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fb60c-a268-4365-a04a-06efc8dc1afd admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:31.535665 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fb60c-a268-4365-a04a-06efc8dc1afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:31.539838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fb60c-a268-4365-a04a-06efc8dc1afd admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:31.556085 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 944/1870] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:31.560377 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945fba0-2b4f-437f-9158-eb7fe9d4f4e3 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:31.562077 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-e945fba0-2b4f-437f-9158-eb7fe9d4f4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:31.578003 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 927/1871] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:31 2022] POST /identity/v3/users => generated 290 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:31.587406 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945fba0-2b4f-437f-9158-eb7fe9d4f4e3 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:31.587564 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342c519-5463-46c2-9ced-d8c512476aff None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:31.587564 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342c519-5463-46c2-9ced-d8c512476aff None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:31.587564 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342c519-5463-46c2-9ced-d8c512476aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:31.592389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d965cee-382a-4569-af0d-62457b1fcb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:31.593152 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d965cee-382a-4569-af0d-62457b1fcb2f admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:31.593522 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d965cee-382a-4569-af0d-62457b1fcb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:31.593857 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d965cee-382a-4569-af0d-62457b1fcb2f admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:31.594619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d965cee-382a-4569-af0d-62457b1fcb2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:31.596693 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d965cee-382a-4569-af0d-62457b1fcb2f admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:31.606212 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-d342c519-5463-46c2-9ced-d8c512476aff None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:31.607969 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-d342c519-5463-46c2-9ced-d8c512476aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:31.614706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:31.617295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 928/1872] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:31.617295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342c519-5463-46c2-9ced-d8c512476aff None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:31.626184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 945/1873] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:31 2022] POST /identity/v3/users => generated 292 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:31.627656 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d965cee-382a-4569-af0d-62457b1fcb2f admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:31.628867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342c519-5463-46c2-9ced-d8c512476aff None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:31.633941 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2d0f1-9f4c-4d2a-849a-11c3d99a1e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:31.634444 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2d0f1-9f4c-4d2a-849a-11c3d99a1e2d admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:31.634792 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2d0f1-9f4c-4d2a-849a-11c3d99a1e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:31.635133 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2d0f1-9f4c-4d2a-849a-11c3d99a1e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:31.636070 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2d0f1-9f4c-4d2a-849a-11c3d99a1e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:31.637714 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2d0f1-9f4c-4d2a-849a-11c3d99a1e2d admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:31.638315 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d965cee-382a-4569-af0d-62457b1fcb2f admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:31.645787 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc650b1-a642-418d-8041-caf31f0b08e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:31.646453 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc650b1-a642-418d-8041-caf31f0b08e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:31.646733 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc650b1-a642-418d-8041-caf31f0b08e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:31.647012 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc650b1-a642-418d-8041-caf31f0b08e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:31.647865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc650b1-a642-418d-8041-caf31f0b08e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:39:31.648180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc650b1-a642-418d-8041-caf31f0b08e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:31.649721 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 929/1874] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:31.649832 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc650b1-a642-418d-8041-caf31f0b08e3 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:31.650526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2d0f1-9f4c-4d2a-849a-11c3d99a1e2d admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:31.661927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2d0f1-9f4c-4d2a-849a-11c3d99a1e2d admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:31.667609 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 946/1875] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:39:31.667609 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc650b1-a642-418d-8041-caf31f0b08e3 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:31.673391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028ed70-7c50-4e52-87af-154c15e4cf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:31.674881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028ed70-7c50-4e52-87af-154c15e4cf6c admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:31.675041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028ed70-7c50-4e52-87af-154c15e4cf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:31.675348 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028ed70-7c50-4e52-87af-154c15e4cf6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:31.676151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028ed70-7c50-4e52-87af-154c15e4cf6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:31.677638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028ed70-7c50-4e52-87af-154c15e4cf6c admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:31.677955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc650b1-a642-418d-8041-caf31f0b08e3 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:31.680423 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:31.684900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43727b13-53ba-495b-97f5-3c8d276fa760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:31.685945 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43727b13-53ba-495b-97f5-3c8d276fa760 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:31.686386 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43727b13-53ba-495b-97f5-3c8d276fa760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:31.687124 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43727b13-53ba-495b-97f5-3c8d276fa760 admin admin] PATH_INFO: `/v3/projects/7e5350489a5447a8b9680ea9ae533de8/users/b63cb15e3d6e4f86ae2f5c8801d093c2/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:31.692475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 930/1876] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:31.693176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028ed70-7c50-4e52-87af-154c15e4cf6c admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:31.705303 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43727b13-53ba-495b-97f5-3c8d276fa760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e5350489a5447a8b9680ea9ae533de8, user_id=b63cb15e3d6e4f86ae2f5c8801d093c2, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:31.706262 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028ed70-7c50-4e52-87af-154c15e4cf6c admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:31.709077 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43727b13-53ba-495b-97f5-3c8d276fa760 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:31.711197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51997fb-8e99-476e-8ff3-86b895d8b0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:31.711955 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51997fb-8e99-476e-8ff3-86b895d8b0bb admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:31.712434 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51997fb-8e99-476e-8ff3-86b895d8b0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:31.712779 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51997fb-8e99-476e-8ff3-86b895d8b0bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:31.713468 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51997fb-8e99-476e-8ff3-86b895d8b0bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:31.715444 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51997fb-8e99-476e-8ff3-86b895d8b0bb admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:31.726381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 947/1877] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:31 2022] PUT /identity/v3/projects/7e5350489a5447a8b9680ea9ae533de8/users/b63cb15e3d6e4f86ae2f5c8801d093c2/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:31.726381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43727b13-53ba-495b-97f5-3c8d276fa760 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:31.753123 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 931/1878] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:31 2022] POST /identity/v3/projects => generated 409 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:31.753123 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51997fb-8e99-476e-8ff3-86b895d8b0bb admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:31.803492 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43727b13-53ba-495b-97f5-3c8d276fa760 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:31.825251 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51997fb-8e99-476e-8ff3-86b895d8b0bb admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:31.831090 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2c79a-39db-42f2-9ecb-27ac6d804203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:31.831898 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2c79a-39db-42f2-9ecb-27ac6d804203 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:31.832263 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2c79a-39db-42f2-9ecb-27ac6d804203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:31.832543 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2c79a-39db-42f2-9ecb-27ac6d804203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:31.833273 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2c79a-39db-42f2-9ecb-27ac6d804203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:31.834964 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2c79a-39db-42f2-9ecb-27ac6d804203 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:31.855058 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 932/1879] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:31.855058 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2c79a-39db-42f2-9ecb-27ac6d804203 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:31.869870 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2c79a-39db-42f2-9ecb-27ac6d804203 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:31.875881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff01fc-9e94-429f-b2f1-1174c4f49d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:31.876598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff01fc-9e94-429f-b2f1-1174c4f49d2f admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:31.876893 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff01fc-9e94-429f-b2f1-1174c4f49d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:31.877176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff01fc-9e94-429f-b2f1-1174c4f49d2f admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:31.877873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff01fc-9e94-429f-b2f1-1174c4f49d2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:31.879909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff01fc-9e94-429f-b2f1-1174c4f49d2f admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:31.888457 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815520c9-6a1f-4b2e-8333-1b130bce75a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:31.889939 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815520c9-6a1f-4b2e-8333-1b130bce75a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:31.890521 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815520c9-6a1f-4b2e-8333-1b130bce75a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:31.890945 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815520c9-6a1f-4b2e-8333-1b130bce75a0 admin admin] PATH_INFO: `/v3/projects/439700b1395545398b371ec43a8ab9cf/users/a86b787bd3c24382aecb536b6340ca6b/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:31.906924 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 933/1880] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:31 2022] POST /identity/v3/users => generated 305 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:31.907436 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815520c9-6a1f-4b2e-8333-1b130bce75a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=439700b1395545398b371ec43a8ab9cf, user_id=a86b787bd3c24382aecb536b6340ca6b, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:31.908464 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff01fc-9e94-429f-b2f1-1174c4f49d2f admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:31.910955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815520c9-6a1f-4b2e-8333-1b130bce75a0 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:31.919190 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff01fc-9e94-429f-b2f1-1174c4f49d2f admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:31.925037 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ed378-0525-4b9b-9b25-201e0adb88fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:31.926073 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ed378-0525-4b9b-9b25-201e0adb88fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:31.926372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ed378-0525-4b9b-9b25-201e0adb88fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:31.926728 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ed378-0525-4b9b-9b25-201e0adb88fa admin admin] PATH_INFO: `/v3/projects/7e5350489a5447a8b9680ea9ae533de8/users/b63cb15e3d6e4f86ae2f5c8801d093c2/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:31.928847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 948/1881] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:31 2022] PUT /identity/v3/projects/439700b1395545398b371ec43a8ab9cf/users/a86b787bd3c24382aecb536b6340ca6b/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:31.928964 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ed378-0525-4b9b-9b25-201e0adb88fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e5350489a5447a8b9680ea9ae533de8, user_id=b63cb15e3d6e4f86ae2f5c8801d093c2, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:31.929754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815520c9-6a1f-4b2e-8333-1b130bce75a0 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:31.931902 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ed378-0525-4b9b-9b25-201e0adb88fa admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:31.945724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 934/1882] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:31 2022] PUT /identity/v3/projects/7e5350489a5447a8b9680ea9ae533de8/users/b63cb15e3d6e4f86ae2f5c8801d093c2/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:31.952045 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ed378-0525-4b9b-9b25-201e0adb88fa admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:31.993180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:32.005612 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815520c9-6a1f-4b2e-8333-1b130bce75a0 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:32.020201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ed378-0525-4b9b-9b25-201e0adb88fa admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:32.025568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ab9ac-bc3d-45a2-8a63-8643b6308a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:32.026240 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ab9ac-bc3d-45a2-8a63-8643b6308a1d admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:32.026521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ab9ac-bc3d-45a2-8a63-8643b6308a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:32.026795 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ab9ac-bc3d-45a2-8a63-8643b6308a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:32.027548 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ab9ac-bc3d-45a2-8a63-8643b6308a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:32.029133 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ab9ac-bc3d-45a2-8a63-8643b6308a1d admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:32.040402 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 935/1883] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:32.042375 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dd231-1169-4caa-96be-c9845145afc3 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:32.042671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dd231-1169-4caa-96be-c9845145afc3 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:32.042952 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dd231-1169-4caa-96be-c9845145afc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:32.072974 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-f24dd231-1169-4caa-96be-c9845145afc3 None None] MFA Rules not processed for user `b63cb15e3d6e4f86ae2f5c8801d093c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:32.074239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f24dd231-1169-4caa-96be-c9845145afc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:32.076847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0f9d0-b894-46d2-baeb-4f1eb5a7cd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:32.077527 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0f9d0-b894-46d2-baeb-4f1eb5a7cd54 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:32.077810 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0f9d0-b894-46d2-baeb-4f1eb5a7cd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:32.078073 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0f9d0-b894-46d2-baeb-4f1eb5a7cd54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:32.078853 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0f9d0-b894-46d2-baeb-4f1eb5a7cd54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:32.080540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0f9d0-b894-46d2-baeb-4f1eb5a7cd54 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:32.094253 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 949/1884] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:32.094253 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0f9d0-b894-46d2-baeb-4f1eb5a7cd54 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:32.102720 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:32.103682 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0f9d0-b894-46d2-baeb-4f1eb5a7cd54 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:32.108722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edbf50-8b1a-4a76-a65d-4aa36bff8f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:32.109727 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edbf50-8b1a-4a76-a65d-4aa36bff8f91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:32.110011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edbf50-8b1a-4a76-a65d-4aa36bff8f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:32.110288 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edbf50-8b1a-4a76-a65d-4aa36bff8f91 admin admin] PATH_INFO: `/v3/projects/439700b1395545398b371ec43a8ab9cf/users/a86b787bd3c24382aecb536b6340ca6b/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:32.112847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edbf50-8b1a-4a76-a65d-4aa36bff8f91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=439700b1395545398b371ec43a8ab9cf, user_id=a86b787bd3c24382aecb536b6340ca6b, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:32.115558 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edbf50-8b1a-4a76-a65d-4aa36bff8f91 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:32.130507 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 950/1885] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:32 2022] PUT /identity/v3/projects/439700b1395545398b371ec43a8ab9cf/users/a86b787bd3c24382aecb536b6340ca6b/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:32.131486 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edbf50-8b1a-4a76-a65d-4aa36bff8f91 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:32.168446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 936/1886] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:32 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:32.182801 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24dd231-1169-4caa-96be-c9845145afc3 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:32.184522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f24dd231-1169-4caa-96be-c9845145afc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:32.217921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edbf50-8b1a-4a76-a65d-4aa36bff8f91 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:32.225811 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdffcbc-f3fa-43d1-af55-cea6b960dacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:32.227353 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdffcbc-f3fa-43d1-af55-cea6b960dacd admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:32.228067 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdffcbc-f3fa-43d1-af55-cea6b960dacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:32.228067 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdffcbc-f3fa-43d1-af55-cea6b960dacd admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:32.229652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdffcbc-f3fa-43d1-af55-cea6b960dacd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:32.230307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdffcbc-f3fa-43d1-af55-cea6b960dacd admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:32.249054 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 951/1887] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:32.250083 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdffcbc-f3fa-43d1-af55-cea6b960dacd admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:32.263663 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdffcbc-f3fa-43d1-af55-cea6b960dacd admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:32.269933 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92e482-e289-4282-9db1-3ec8289dcc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:32.270927 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92e482-e289-4282-9db1-3ec8289dcc9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:32.271336 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92e482-e289-4282-9db1-3ec8289dcc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:32.271790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92e482-e289-4282-9db1-3ec8289dcc9c admin admin] PATH_INFO: `/v3/projects/896c1262241241e9bb6c328be7704f6e/users/feb1cf144fd04b85a0764cc03214a77a/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:32.272767 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24dd231-1169-4caa-96be-c9845145afc3 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:32.289849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92e482-e289-4282-9db1-3ec8289dcc9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=896c1262241241e9bb6c328be7704f6e, user_id=feb1cf144fd04b85a0764cc03214a77a, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:32.295215 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92e482-e289-4282-9db1-3ec8289dcc9c admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:32.326226 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 952/1888] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:32 2022] PUT /identity/v3/projects/896c1262241241e9bb6c328be7704f6e/users/feb1cf144fd04b85a0764cc03214a77a/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:32.327878 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24bd0a-7bce-471a-8603-7a8d56728297 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:32.328475 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24bd0a-7bce-471a-8603-7a8d56728297 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:32.328475 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24bd0a-7bce-471a-8603-7a8d56728297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:32.348180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af8072-bebd-4b04-85fa-4741d4e9ce36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:32.349496 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af8072-bebd-4b04-85fa-4741d4e9ce36 service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:32.349862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af8072-bebd-4b04-85fa-4741d4e9ce36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:32.350214 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af8072-bebd-4b04-85fa-4741d4e9ce36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:32.382171 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-cb24bd0a-7bce-471a-8603-7a8d56728297 None None] MFA Rules not processed for user `feb1cf144fd04b85a0764cc03214a77a`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:32.383727 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-cb24bd0a-7bce-471a-8603-7a8d56728297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:32.438599 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af8072-bebd-4b04-85fa-4741d4e9ce36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:32.440328 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af8072-bebd-4b04-85fa-4741d4e9ce36 service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:32.460335 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 937/1889] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:32 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:39:32.478347 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:32.534087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 953/1890] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:32 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:32.539247 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af8072-bebd-4b04-85fa-4741d4e9ce36 service cinder] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:32.554620 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af8072-bebd-4b04-85fa-4741d4e9ce36 service cinder] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:32.592441 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:32.632716 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef875b-9922-4f39-a3e3-444686418422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:32.633399 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef875b-9922-4f39-a3e3-444686418422 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:32.633681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef875b-9922-4f39-a3e3-444686418422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:32.634119 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef875b-9922-4f39-a3e3-444686418422 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:32.634883 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef875b-9922-4f39-a3e3-444686418422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:32.637540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef875b-9922-4f39-a3e3-444686418422 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:32.687831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 938/1891] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:32 2022] POST /identity/v3/projects => generated 407 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:32.690091 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24bd0a-7bce-471a-8603-7a8d56728297 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:32.710069 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24bd0a-7bce-471a-8603-7a8d56728297 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:32.853416 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f876803-93c1-47b8-bfe1-f951b342f233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:32.855465 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f876803-93c1-47b8-bfe1-f951b342f233 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:32.857255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f876803-93c1-47b8-bfe1-f951b342f233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:32.858171 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f876803-93c1-47b8-bfe1-f951b342f233 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:32.860464 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f876803-93c1-47b8-bfe1-f951b342f233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:32.865863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f876803-93c1-47b8-bfe1-f951b342f233 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:32.913262 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 954/1892] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:32 2022] POST /identity/v3/users => generated 310 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:32.917285 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef875b-9922-4f39-a3e3-444686418422 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:32.931059 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef875b-9922-4f39-a3e3-444686418422 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:32.939565 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ff87f-02be-438f-a286-5684b1992b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:32.940406 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ff87f-02be-438f-a286-5684b1992b6a admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:32.940748 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ff87f-02be-438f-a286-5684b1992b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:32.942376 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ff87f-02be-438f-a286-5684b1992b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:32.942840 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ff87f-02be-438f-a286-5684b1992b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:32.944483 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ff87f-02be-438f-a286-5684b1992b6a admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:32.976184 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 939/1893] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:32.980456 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f876803-93c1-47b8-bfe1-f951b342f233 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:32.998699 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f876803-93c1-47b8-bfe1-f951b342f233 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:33.008021 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc55fec-d2b2-44ee-8e66-f58099d59901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:33.009610 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc55fec-d2b2-44ee-8e66-f58099d59901 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:33.009904 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc55fec-d2b2-44ee-8e66-f58099d59901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:33.010190 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc55fec-d2b2-44ee-8e66-f58099d59901 admin admin] PATH_INFO: `/v3/projects/b1eeb21cdfe24ee88429cf67adb682c0/users/a90c3df79db74b4dac977e809587e46a/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:33.052850 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc55fec-d2b2-44ee-8e66-f58099d59901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1eeb21cdfe24ee88429cf67adb682c0, user_id=a90c3df79db74b4dac977e809587e46a, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:33.055613 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc55fec-d2b2-44ee-8e66-f58099d59901 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:33.101023 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ff87f-02be-438f-a286-5684b1992b6a admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:33.101574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 955/1894] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:32 2022] PUT /identity/v3/projects/b1eeb21cdfe24ee88429cf67adb682c0/users/a90c3df79db74b4dac977e809587e46a/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:33.118270 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ff87f-02be-438f-a286-5684b1992b6a admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:33.220861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc7b4f-e0f2-40d3-83d8-6eed4640b794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:33.221770 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc7b4f-e0f2-40d3-83d8-6eed4640b794 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:33.226613 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc7b4f-e0f2-40d3-83d8-6eed4640b794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:33.227046 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc7b4f-e0f2-40d3-83d8-6eed4640b794 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:33.228932 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc7b4f-e0f2-40d3-83d8-6eed4640b794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:33.231221 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc7b4f-e0f2-40d3-83d8-6eed4640b794 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:33.246002 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 940/1895] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:33.250904 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc55fec-d2b2-44ee-8e66-f58099d59901 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:33.263900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc55fec-d2b2-44ee-8e66-f58099d59901 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:33.270257 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e17bf-3574-4481-9e3d-e293fbaab825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:33.271528 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e17bf-3574-4481-9e3d-e293fbaab825 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:33.271919 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e17bf-3574-4481-9e3d-e293fbaab825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:33.272299 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e17bf-3574-4481-9e3d-e293fbaab825 admin admin] PATH_INFO: `/v3/projects/b1eeb21cdfe24ee88429cf67adb682c0/users/a90c3df79db74b4dac977e809587e46a/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:33.274976 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e17bf-3574-4481-9e3d-e293fbaab825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1eeb21cdfe24ee88429cf67adb682c0, user_id=a90c3df79db74b4dac977e809587e46a, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:33.281931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e17bf-3574-4481-9e3d-e293fbaab825 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:33.296050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 956/1896] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:33 2022] PUT /identity/v3/projects/b1eeb21cdfe24ee88429cf67adb682c0/users/a90c3df79db74b4dac977e809587e46a/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:33.307654 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aca6d-c1c5-4dab-9065-47fb0fc286ff None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:33.308059 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aca6d-c1c5-4dab-9065-47fb0fc286ff None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:33.308439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aca6d-c1c5-4dab-9065-47fb0fc286ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:33.362444 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-7f8aca6d-c1c5-4dab-9065-47fb0fc286ff None None] MFA Rules not processed for user `a90c3df79db74b4dac977e809587e46a`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:33.364687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-7f8aca6d-c1c5-4dab-9065-47fb0fc286ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:33.485195 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 941/1897] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:33 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:33.523353 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e17bf-3574-4481-9e3d-e293fbaab825 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:33.624357 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba91317-3391-4865-8957-9535694032a0 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:33.624682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba91317-3391-4865-8957-9535694032a0 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:33.624973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba91317-3391-4865-8957-9535694032a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:33.655066 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e17bf-3574-4481-9e3d-e293fbaab825 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:33.663044 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ae6fa-259b-4384-ba1f-6cc3080b924d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:33.664954 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ae6fa-259b-4384-ba1f-6cc3080b924d service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:33.666719 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ae6fa-259b-4384-ba1f-6cc3080b924d service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:33.667027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ae6fa-259b-4384-ba1f-6cc3080b924d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:33.684807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-fba91317-3391-4865-8957-9535694032a0 None None] MFA Rules not processed for user `a86b787bd3c24382aecb536b6340ca6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:33.686557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-fba91317-3391-4865-8957-9535694032a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:33.704475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:33.717411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ae6fa-259b-4384-ba1f-6cc3080b924d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:33.721429 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ae6fa-259b-4384-ba1f-6cc3080b924d service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:33.749442 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 957/1898] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:33 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:33.870502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 942/1899] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:33 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:33.930692 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ae6fa-259b-4384-ba1f-6cc3080b924d service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:33.940263 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ae6fa-259b-4384-ba1f-6cc3080b924d service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:33.945619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5974d-5533-4513-acff-1a0e537664c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:33.946252 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5974d-5533-4513-acff-1a0e537664c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:33.946543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5974d-5533-4513-acff-1a0e537664c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:33.946828 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5974d-5533-4513-acff-1a0e537664c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:33.949435 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-2cc5974d-5533-4513-acff-1a0e537664c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:33.996955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:34.033542 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5974d-5533-4513-acff-1a0e537664c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:34.036359 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5974d-5533-4513-acff-1a0e537664c3 service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:34.050333 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 958/1900] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:34.186068 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba91317-3391-4865-8957-9535694032a0 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:34.188127 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-fba91317-3391-4865-8957-9535694032a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:34.190770 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5974d-5533-4513-acff-1a0e537664c3 service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:34.193240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-2cc5974d-5533-4513-acff-1a0e537664c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:34.208759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5974d-5533-4513-acff-1a0e537664c3 service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:34.214248 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55516c56-0935-47cb-bc7f-52249e6758e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:34.215167 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55516c56-0935-47cb-bc7f-52249e6758e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:34.215592 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55516c56-0935-47cb-bc7f-52249e6758e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:34.216006 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55516c56-0935-47cb-bc7f-52249e6758e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:34.323732 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55516c56-0935-47cb-bc7f-52249e6758e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:34.325659 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55516c56-0935-47cb-bc7f-52249e6758e0 service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:34.342787 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 959/1901] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:34 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:34.374024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba91317-3391-4865-8957-9535694032a0 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:34.383598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1b152-8b72-4325-a6a9-82b1e578c371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:34.384639 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1b152-8b72-4325-a6a9-82b1e578c371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:34.384920 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1b152-8b72-4325-a6a9-82b1e578c371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:34.387522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1b152-8b72-4325-a6a9-82b1e578c371 admin admin] PATH_INFO: `/v3/users/093204e519ac41ee959323324216cc2d` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:34.388994 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1b152-8b72-4325-a6a9-82b1e578c371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=093204e519ac41ee959323324216cc2d)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:34.392683 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1b152-8b72-4325-a6a9-82b1e578c371 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:34.568710 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ddb1b152-8b72-4325-a6a9-82b1e578c371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093204e519ac41ee959323324216cc2d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:34.587227 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ddb1b152-8b72-4325-a6a9-82b1e578c371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093204e519ac41ee959323324216cc2d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:34.589380 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ddb1b152-8b72-4325-a6a9-82b1e578c371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093204e519ac41ee959323324216cc2d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:34.631473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ddb1b152-8b72-4325-a6a9-82b1e578c371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093204e519ac41ee959323324216cc2d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:34.646627 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ddb1b152-8b72-4325-a6a9-82b1e578c371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093204e519ac41ee959323324216cc2d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:34.662967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 943/1902] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:34 2022] DELETE /identity/v3/users/093204e519ac41ee959323324216cc2d => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:34.668269 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcccd0-4b18-4524-bc4a-4ab5286fb6e8 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:34.668575 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcccd0-4b18-4524-bc4a-4ab5286fb6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:34.668788 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcccd0-4b18-4524-bc4a-4ab5286fb6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:34.721199 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-9adcccd0-4b18-4524-bc4a-4ab5286fb6e8 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:34.722466 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-9adcccd0-4b18-4524-bc4a-4ab5286fb6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:34.910653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 960/1903] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:34.936184 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1b152-8b72-4325-a6a9-82b1e578c371 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:34.938388 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-ddb1b152-8b72-4325-a6a9-82b1e578c371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:35.008905 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:35.059409 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1b152-8b72-4325-a6a9-82b1e578c371 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:35.069198 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c03bb-fae9-40b0-be43-ba0c1ee0f05b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:35.069974 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c03bb-fae9-40b0-be43-ba0c1ee0f05b service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:35.070375 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c03bb-fae9-40b0-be43-ba0c1ee0f05b service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:35.070839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c03bb-fae9-40b0-be43-ba0c1ee0f05b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:35.111952 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c03bb-fae9-40b0-be43-ba0c1ee0f05b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:35.117352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c03bb-fae9-40b0-be43-ba0c1ee0f05b service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:35.149174 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 944/1904] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:35.916297 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adcccd0-4b18-4524-bc4a-4ab5286fb6e8 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:35.917906 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-9adcccd0-4b18-4524-bc4a-4ab5286fb6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:36.053846 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c03bb-fae9-40b0-be43-ba0c1ee0f05b service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:36.055528 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-014c03bb-fae9-40b0-be43-ba0c1ee0f05b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:36.060354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adcccd0-4b18-4524-bc4a-4ab5286fb6e8 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:36.067944 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571c566-87a9-4fa4-a0da-d9182d50df25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:36.069372 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571c566-87a9-4fa4-a0da-d9182d50df25 service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:36.069797 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571c566-87a9-4fa4-a0da-d9182d50df25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:36.070228 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571c566-87a9-4fa4-a0da-d9182d50df25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:36.075550 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-9571c566-87a9-4fa4-a0da-d9182d50df25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:36.096949 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c03bb-fae9-40b0-be43-ba0c1ee0f05b service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:36.121621 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11747826-2de5-4976-8de1-ac53fb99c7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:36.124281 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:36.126984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11747826-2de5-4976-8de1-ac53fb99c7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:36.128077 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11747826-2de5-4976-8de1-ac53fb99c7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:36.128443 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11747826-2de5-4976-8de1-ac53fb99c7f1 admin admin] PATH_INFO: `/v3/projects/d68224014d9848deafa04447c90a83b6` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:36.129834 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11747826-2de5-4976-8de1-ac53fb99c7f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d68224014d9848deafa04447c90a83b6)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:36.131802 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11747826-2de5-4976-8de1-ac53fb99c7f1 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:36.177157 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571c566-87a9-4fa4-a0da-d9182d50df25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:36.178740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571c566-87a9-4fa4-a0da-d9182d50df25 service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:36.200516 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 961/1905] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:35 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:36.294479 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-11747826-2de5-4976-8de1-ac53fb99c7f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd68224014d9848deafa04447c90a83b6', 'request_id': 'req-11747826-2de5-4976-8de1-ac53fb99c7f1'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:36.312731 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-11747826-2de5-4976-8de1-ac53fb99c7f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd68224014d9848deafa04447c90a83b6', 'request_id': 'req-11747826-2de5-4976-8de1-ac53fb99c7f1'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:36.328778 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-11747826-2de5-4976-8de1-ac53fb99c7f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd68224014d9848deafa04447c90a83b6', 'request_id': 'req-11747826-2de5-4976-8de1-ac53fb99c7f1'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:36.356843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-11747826-2de5-4976-8de1-ac53fb99c7f1 admin admin] The token cache is being invalidate because project d68224014d9848deafa04447c90a83b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:36.357148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-11747826-2de5-4976-8de1-ac53fb99c7f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:36.357881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-11747826-2de5-4976-8de1-ac53fb99c7f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:36.360079 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 945/1906] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:36 2022] DELETE /identity/v3/projects/d68224014d9848deafa04447c90a83b6 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:36.364135 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571c566-87a9-4fa4-a0da-d9182d50df25 service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:36.380372 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571c566-87a9-4fa4-a0da-d9182d50df25 service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:36.417413 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11747826-2de5-4976-8de1-ac53fb99c7f1 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:36.423774 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-11747826-2de5-4976-8de1-ac53fb99c7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:36.468898 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0da53-5bca-419c-a792-a4c0f0057492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:36.470053 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0da53-5bca-419c-a792-a4c0f0057492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:36.470556 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0da53-5bca-419c-a792-a4c0f0057492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:36.471008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0da53-5bca-419c-a792-a4c0f0057492 admin admin] PATH_INFO: `/v3/users/e4366d64c4be4d4cab1586c8a6969dde` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:36.472982 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0da53-5bca-419c-a792-a4c0f0057492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4366d64c4be4d4cab1586c8a6969dde)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:36.475826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0da53-5bca-419c-a792-a4c0f0057492 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:36.534706 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11747826-2de5-4976-8de1-ac53fb99c7f1 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:36.539710 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a476b70-51de-48a3-8857-ce7ad9eba248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:36.540601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a476b70-51de-48a3-8857-ce7ad9eba248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:36.540888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a476b70-51de-48a3-8857-ce7ad9eba248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:36.541168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a476b70-51de-48a3-8857-ce7ad9eba248 admin admin] PATH_INFO: `/v3/users/5ae1b1a298e448a0acc198201d79dd71` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:36.542376 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a476b70-51de-48a3-8857-ce7ad9eba248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ae1b1a298e448a0acc198201d79dd71)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:36.545004 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a476b70-51de-48a3-8857-ce7ad9eba248 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:36.549257 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-d9a0da53-5bca-419c-a792-a4c0f0057492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4366d64c4be4d4cab1586c8a6969dde'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:36.549977 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-d9a0da53-5bca-419c-a792-a4c0f0057492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4366d64c4be4d4cab1586c8a6969dde'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:36.557936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-d9a0da53-5bca-419c-a792-a4c0f0057492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4366d64c4be4d4cab1586c8a6969dde'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:36.558607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-d9a0da53-5bca-419c-a792-a4c0f0057492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4366d64c4be4d4cab1586c8a6969dde'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:36.577413 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-d9a0da53-5bca-419c-a792-a4c0f0057492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4366d64c4be4d4cab1586c8a6969dde'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:36.593666 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 962/1907] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:36 2022] DELETE /identity/v3/users/e4366d64c4be4d4cab1586c8a6969dde => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:36.609317 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-7a476b70-51de-48a3-8857-ce7ad9eba248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ae1b1a298e448a0acc198201d79dd71'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:36.616339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-7a476b70-51de-48a3-8857-ce7ad9eba248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ae1b1a298e448a0acc198201d79dd71'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:36.617064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-7a476b70-51de-48a3-8857-ce7ad9eba248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ae1b1a298e448a0acc198201d79dd71'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:36.618208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:36.633995 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-7a476b70-51de-48a3-8857-ce7ad9eba248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ae1b1a298e448a0acc198201d79dd71'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:36.641450 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-7a476b70-51de-48a3-8857-ce7ad9eba248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ae1b1a298e448a0acc198201d79dd71'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:36.649270 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 946/1908] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:36 2022] DELETE /identity/v3/users/5ae1b1a298e448a0acc198201d79dd71 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:39:36.653993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912be24-3dd8-4711-8085-dced3f83c975 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:36.654293 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912be24-3dd8-4711-8085-dced3f83c975 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:36.654579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912be24-3dd8-4711-8085-dced3f83c975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:36.673003 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-e912be24-3dd8-4711-8085-dced3f83c975 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:36.674255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-e912be24-3dd8-4711-8085-dced3f83c975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:36.716033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:36.747945 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 963/1909] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:36.759361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a476b70-51de-48a3-8857-ce7ad9eba248 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:36.760951 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-7a476b70-51de-48a3-8857-ce7ad9eba248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:36.837164 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a476b70-51de-48a3-8857-ce7ad9eba248 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:36.842080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaceb74-2609-430b-a0ef-3b501685b60a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:36.842743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaceb74-2609-430b-a0ef-3b501685b60a service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:36.843025 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaceb74-2609-430b-a0ef-3b501685b60a service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:36.843383 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaceb74-2609-430b-a0ef-3b501685b60a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:36.855461 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaceb74-2609-430b-a0ef-3b501685b60a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:36.856900 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaceb74-2609-430b-a0ef-3b501685b60a service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:36.867349 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 947/1910] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:36.925455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912be24-3dd8-4711-8085-dced3f83c975 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:36.927238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-e912be24-3dd8-4711-8085-dced3f83c975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:36.943123 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912be24-3dd8-4711-8085-dced3f83c975 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:36.953471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371150e-a4e5-4b75-af3c-18ba358fac90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:36.955563 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371150e-a4e5-4b75-af3c-18ba358fac90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:36.955958 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371150e-a4e5-4b75-af3c-18ba358fac90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:36.956590 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371150e-a4e5-4b75-af3c-18ba358fac90 admin admin] PATH_INFO: `/v3/projects/08ad6eb1944c4ba0943718886ae363ca` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:36.958178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371150e-a4e5-4b75-af3c-18ba358fac90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08ad6eb1944c4ba0943718886ae363ca)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:36.961066 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371150e-a4e5-4b75-af3c-18ba358fac90 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:37.051152 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e371150e-a4e5-4b75-af3c-18ba358fac90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08ad6eb1944c4ba0943718886ae363ca', 'request_id': 'req-e371150e-a4e5-4b75-af3c-18ba358fac90'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:37.066861 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e371150e-a4e5-4b75-af3c-18ba358fac90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08ad6eb1944c4ba0943718886ae363ca', 'request_id': 'req-e371150e-a4e5-4b75-af3c-18ba358fac90'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:37.078541 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e371150e-a4e5-4b75-af3c-18ba358fac90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08ad6eb1944c4ba0943718886ae363ca', 'request_id': 'req-e371150e-a4e5-4b75-af3c-18ba358fac90'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:37.091689 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e371150e-a4e5-4b75-af3c-18ba358fac90 admin admin] The token cache is being invalidate because project 08ad6eb1944c4ba0943718886ae363ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:37.092060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e371150e-a4e5-4b75-af3c-18ba358fac90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:37.092830 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e371150e-a4e5-4b75-af3c-18ba358fac90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:37.094770 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 964/1911] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:36 2022] DELETE /identity/v3/projects/08ad6eb1944c4ba0943718886ae363ca => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:37.099196 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaceb74-2609-430b-a0ef-3b501685b60a service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:37.112116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaceb74-2609-430b-a0ef-3b501685b60a service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:37.188439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1e272-2a0b-4a45-830a-bca9990e1d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:37.189545 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1e272-2a0b-4a45-830a-bca9990e1d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:37.189909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1e272-2a0b-4a45-830a-bca9990e1d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:37.190263 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1e272-2a0b-4a45-830a-bca9990e1d1e admin admin] PATH_INFO: `/v3/users/5079cebe9f044f508d5f22cca18181f2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:37.191966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1e272-2a0b-4a45-830a-bca9990e1d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5079cebe9f044f508d5f22cca18181f2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:37.196724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1e272-2a0b-4a45-830a-bca9990e1d1e admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:37.299743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-5be1e272-2a0b-4a45-830a-bca9990e1d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5079cebe9f044f508d5f22cca18181f2'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:37.306440 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371150e-a4e5-4b75-af3c-18ba358fac90 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:37.308601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-e371150e-a4e5-4b75-af3c-18ba358fac90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:37.311760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-5be1e272-2a0b-4a45-830a-bca9990e1d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5079cebe9f044f508d5f22cca18181f2'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:37.312614 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-5be1e272-2a0b-4a45-830a-bca9990e1d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5079cebe9f044f508d5f22cca18181f2'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:37.333181 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-5be1e272-2a0b-4a45-830a-bca9990e1d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5079cebe9f044f508d5f22cca18181f2'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:37.336566 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:37.342349 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371150e-a4e5-4b75-af3c-18ba358fac90 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:37.346947 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-5be1e272-2a0b-4a45-830a-bca9990e1d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5079cebe9f044f508d5f22cca18181f2'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:37.353813 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e0ec6-4494-4260-95eb-afa2eef219ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:37.355801 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e0ec6-4494-4260-95eb-afa2eef219ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:37.356020 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e0ec6-4494-4260-95eb-afa2eef219ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:37.356388 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e0ec6-4494-4260-95eb-afa2eef219ae admin admin] PATH_INFO: `/v3/projects/e3fca5941b104f56af053793a6f749c1` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:37.358408 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 948/1912] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:37 2022] DELETE /identity/v3/users/5079cebe9f044f508d5f22cca18181f2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:37.358672 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e0ec6-4494-4260-95eb-afa2eef219ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3fca5941b104f56af053793a6f749c1)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:37.360432 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e0ec6-4494-4260-95eb-afa2eef219ae admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:37.422590 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-8f7e0ec6-4494-4260-95eb-afa2eef219ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3fca5941b104f56af053793a6f749c1', 'request_id': 'req-8f7e0ec6-4494-4260-95eb-afa2eef219ae'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:37.436318 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-8f7e0ec6-4494-4260-95eb-afa2eef219ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3fca5941b104f56af053793a6f749c1', 'request_id': 'req-8f7e0ec6-4494-4260-95eb-afa2eef219ae'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:37.446536 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-8f7e0ec6-4494-4260-95eb-afa2eef219ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3fca5941b104f56af053793a6f749c1', 'request_id': 'req-8f7e0ec6-4494-4260-95eb-afa2eef219ae'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:37.459888 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-8f7e0ec6-4494-4260-95eb-afa2eef219ae admin admin] The token cache is being invalidate because project e3fca5941b104f56af053793a6f749c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:37.471782 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-8f7e0ec6-4494-4260-95eb-afa2eef219ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:37.472879 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-8f7e0ec6-4494-4260-95eb-afa2eef219ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:37.475978 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 965/1913] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:37 2022] DELETE /identity/v3/projects/e3fca5941b104f56af053793a6f749c1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:37.480171 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1e272-2a0b-4a45-830a-bca9990e1d1e admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:37.482936 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-5be1e272-2a0b-4a45-830a-bca9990e1d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:37.580246 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1e272-2a0b-4a45-830a-bca9990e1d1e admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:37.659126 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ea37c-281e-4517-be48-0a7d68658188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:37.660176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ea37c-281e-4517-be48-0a7d68658188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:37.661002 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ea37c-281e-4517-be48-0a7d68658188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:37.661002 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ea37c-281e-4517-be48-0a7d68658188 admin admin] PATH_INFO: `/v3/users/b63cb15e3d6e4f86ae2f5c8801d093c2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:37.662054 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ea37c-281e-4517-be48-0a7d68658188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b63cb15e3d6e4f86ae2f5c8801d093c2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:37.664096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ea37c-281e-4517-be48-0a7d68658188 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:37.744308 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-094ea37c-281e-4517-be48-0a7d68658188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b63cb15e3d6e4f86ae2f5c8801d093c2'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:37.757872 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-094ea37c-281e-4517-be48-0a7d68658188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b63cb15e3d6e4f86ae2f5c8801d093c2'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:37.760742 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-094ea37c-281e-4517-be48-0a7d68658188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b63cb15e3d6e4f86ae2f5c8801d093c2'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:37.790994 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-094ea37c-281e-4517-be48-0a7d68658188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b63cb15e3d6e4f86ae2f5c8801d093c2'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:37.800978 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-094ea37c-281e-4517-be48-0a7d68658188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b63cb15e3d6e4f86ae2f5c8801d093c2'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:37.812380 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 949/1914] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:37 2022] DELETE /identity/v3/users/b63cb15e3d6e4f86ae2f5c8801d093c2 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:37.969265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e0ec6-4494-4260-95eb-afa2eef219ae admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:37.973894 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-8f7e0ec6-4494-4260-95eb-afa2eef219ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:38.003083 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e0ec6-4494-4260-95eb-afa2eef219ae admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:38.064893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:38.081068 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38b19b-2576-441c-b9b1-02efa0350484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:38.082498 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38b19b-2576-441c-b9b1-02efa0350484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:38.083040 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38b19b-2576-441c-b9b1-02efa0350484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:38.083362 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38b19b-2576-441c-b9b1-02efa0350484 admin admin] PATH_INFO: `/v3/projects/bcb5fbcaf531462ea208cc319f2f54b7` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:38.085389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38b19b-2576-441c-b9b1-02efa0350484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcb5fbcaf531462ea208cc319f2f54b7)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:38.087385 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38b19b-2576-441c-b9b1-02efa0350484 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:38.172843 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ca38b19b-2576-441c-b9b1-02efa0350484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcb5fbcaf531462ea208cc319f2f54b7', 'request_id': 'req-ca38b19b-2576-441c-b9b1-02efa0350484'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:38.183028 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ca38b19b-2576-441c-b9b1-02efa0350484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcb5fbcaf531462ea208cc319f2f54b7', 'request_id': 'req-ca38b19b-2576-441c-b9b1-02efa0350484'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:38.193916 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ca38b19b-2576-441c-b9b1-02efa0350484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcb5fbcaf531462ea208cc319f2f54b7', 'request_id': 'req-ca38b19b-2576-441c-b9b1-02efa0350484'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:38.211062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ca38b19b-2576-441c-b9b1-02efa0350484 admin admin] The token cache is being invalidate because project bcb5fbcaf531462ea208cc319f2f54b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:38.211470 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ca38b19b-2576-441c-b9b1-02efa0350484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:38.212139 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ca38b19b-2576-441c-b9b1-02efa0350484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:38.217675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 966/1915] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:37 2022] DELETE /identity/v3/projects/bcb5fbcaf531462ea208cc319f2f54b7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:38.220269 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95afc71-64dc-475d-965c-e2b45080e676 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:38.220728 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95afc71-64dc-475d-965c-e2b45080e676 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:38.220819 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95afc71-64dc-475d-965c-e2b45080e676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:38.240399 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-e95afc71-64dc-475d-965c-e2b45080e676 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:38.241799 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e95afc71-64dc-475d-965c-e2b45080e676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:38.266377 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38b19b-2576-441c-b9b1-02efa0350484 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:38.268025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-ca38b19b-2576-441c-b9b1-02efa0350484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:38.276414 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:38.326498 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 950/1916] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:38.336840 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72a9f0-a545-4bcc-b6b6-cbfdee4334b1 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:38.337763 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72a9f0-a545-4bcc-b6b6-cbfdee4334b1 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:38.338104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72a9f0-a545-4bcc-b6b6-cbfdee4334b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:38.358219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-3b72a9f0-a545-4bcc-b6b6-cbfdee4334b1 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:38.359380 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-3b72a9f0-a545-4bcc-b6b6-cbfdee4334b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:38.361553 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38b19b-2576-441c-b9b1-02efa0350484 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:38.366276 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758c99e-1a38-46ff-b106-de5c9b8e8f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:38.367158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758c99e-1a38-46ff-b106-de5c9b8e8f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:38.367481 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758c99e-1a38-46ff-b106-de5c9b8e8f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:38.367763 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758c99e-1a38-46ff-b106-de5c9b8e8f0c admin admin] PATH_INFO: `/v3/projects/7e5350489a5447a8b9680ea9ae533de8` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:38.368953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758c99e-1a38-46ff-b106-de5c9b8e8f0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e5350489a5447a8b9680ea9ae533de8)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:38.369585 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 951/1917] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:38.370894 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758c99e-1a38-46ff-b106-de5c9b8e8f0c admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:38.373671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72a9f0-a545-4bcc-b6b6-cbfdee4334b1 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:38.386059 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72a9f0-a545-4bcc-b6b6-cbfdee4334b1 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:38.392294 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2c370-f322-4f72-a706-53c9c47ed031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:38.393253 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2c370-f322-4f72-a706-53c9c47ed031 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:38.393608 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2c370-f322-4f72-a706-53c9c47ed031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:38.393960 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2c370-f322-4f72-a706-53c9c47ed031 admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:38.394759 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2c370-f322-4f72-a706-53c9c47ed031 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:39:38.395140 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2c370-f322-4f72-a706-53c9c47ed031 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:38.396842 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2c370-f322-4f72-a706-53c9c47ed031 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:38.414825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 952/1918] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:39:38.415819 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2c370-f322-4f72-a706-53c9c47ed031 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:38.429093 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2c370-f322-4f72-a706-53c9c47ed031 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:38.432359 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-1758c99e-1a38-46ff-b106-de5c9b8e8f0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e5350489a5447a8b9680ea9ae533de8', 'request_id': 'req-1758c99e-1a38-46ff-b106-de5c9b8e8f0c'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:38.441198 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-1758c99e-1a38-46ff-b106-de5c9b8e8f0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e5350489a5447a8b9680ea9ae533de8', 'request_id': 'req-1758c99e-1a38-46ff-b106-de5c9b8e8f0c'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:38.447002 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-1758c99e-1a38-46ff-b106-de5c9b8e8f0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e5350489a5447a8b9680ea9ae533de8', 'request_id': 'req-1758c99e-1a38-46ff-b106-de5c9b8e8f0c'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:38.458756 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-1758c99e-1a38-46ff-b106-de5c9b8e8f0c admin admin] The token cache is being invalidate because project 7e5350489a5447a8b9680ea9ae533de8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:38.459086 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-1758c99e-1a38-46ff-b106-de5c9b8e8f0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:38.459832 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-1758c99e-1a38-46ff-b106-de5c9b8e8f0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:38.461402 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 967/1919] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:38 2022] DELETE /identity/v3/projects/7e5350489a5447a8b9680ea9ae533de8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:38.466070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a129a-774d-4502-96c0-dc6e3d058adb None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:38.466368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a129a-774d-4502-96c0-dc6e3d058adb None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:38.466648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a129a-774d-4502-96c0-dc6e3d058adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:38.487347 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-944a129a-774d-4502-96c0-dc6e3d058adb None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:38.488049 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c589f-f30e-47bb-bdf6-5edea88d24cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:38.488586 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-944a129a-774d-4502-96c0-dc6e3d058adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:38.488698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c589f-f30e-47bb-bdf6-5edea88d24cd admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:38.488989 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c589f-f30e-47bb-bdf6-5edea88d24cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:38.489268 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c589f-f30e-47bb-bdf6-5edea88d24cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:38.489949 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c589f-f30e-47bb-bdf6-5edea88d24cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:38.491888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c589f-f30e-47bb-bdf6-5edea88d24cd admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:38.496715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 968/1920] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:38.505010 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825b60b-d3fd-4b34-9eb0-9c38b0ff9172 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:38.505302 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825b60b-d3fd-4b34-9eb0-9c38b0ff9172 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:38.505582 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825b60b-d3fd-4b34-9eb0-9c38b0ff9172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:38.520389 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 953/1921] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:38 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:38.524881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c589f-f30e-47bb-bdf6-5edea88d24cd admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:38.527463 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-0c2c589f-f30e-47bb-bdf6-5edea88d24cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:38.527819 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:38.544311 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-d825b60b-d3fd-4b34-9eb0-9c38b0ff9172 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:38.545615 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d825b60b-d3fd-4b34-9eb0-9c38b0ff9172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:38.601897 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c589f-f30e-47bb-bdf6-5edea88d24cd admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:38.607919 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5954728-bab0-4196-9cf8-eda97d6fc253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:38.609320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5954728-bab0-4196-9cf8-eda97d6fc253 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:38.609523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5954728-bab0-4196-9cf8-eda97d6fc253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:38.609793 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5954728-bab0-4196-9cf8-eda97d6fc253 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:38.610511 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5954728-bab0-4196-9cf8-eda97d6fc253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:38.613074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5954728-bab0-4196-9cf8-eda97d6fc253 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:38.618084 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 969/1922] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:38.622257 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825b60b-d3fd-4b34-9eb0-9c38b0ff9172 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:38.631634 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825b60b-d3fd-4b34-9eb0-9c38b0ff9172 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:38.636578 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f0dcd-9ea4-43e4-a1ef-1b12c5a8d082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:38.637307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f0dcd-9ea4-43e4-a1ef-1b12c5a8d082 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:38.637592 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f0dcd-9ea4-43e4-a1ef-1b12c5a8d082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:38.637873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f0dcd-9ea4-43e4-a1ef-1b12c5a8d082 admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:38.638626 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f0dcd-9ea4-43e4-a1ef-1b12c5a8d082 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:39:38.638936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f0dcd-9ea4-43e4-a1ef-1b12c5a8d082 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:38.643245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 954/1923] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:38 2022] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:38.643409 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f0dcd-9ea4-43e4-a1ef-1b12c5a8d082 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:38.644551 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5954728-bab0-4196-9cf8-eda97d6fc253 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:38.657126 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 970/1924] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:39:38.657296 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5954728-bab0-4196-9cf8-eda97d6fc253 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:38.658730 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f0dcd-9ea4-43e4-a1ef-1b12c5a8d082 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:38.660576 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75104bf7-884b-431a-ba46-018f240804d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:38.661241 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75104bf7-884b-431a-ba46-018f240804d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:38.661523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75104bf7-884b-431a-ba46-018f240804d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:38.661825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75104bf7-884b-431a-ba46-018f240804d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:38.662546 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75104bf7-884b-431a-ba46-018f240804d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:38.664168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75104bf7-884b-431a-ba46-018f240804d5 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:38.669804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f0dcd-9ea4-43e4-a1ef-1b12c5a8d082 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:38.678320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 955/1925] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:38.678464 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4167d1-5117-4210-b722-1e24dd42ed77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:38.678464 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4167d1-5117-4210-b722-1e24dd42ed77 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:38.678464 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4167d1-5117-4210-b722-1e24dd42ed77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:38.678464 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4167d1-5117-4210-b722-1e24dd42ed77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:38.678746 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4167d1-5117-4210-b722-1e24dd42ed77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:38.679739 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75104bf7-884b-431a-ba46-018f240804d5 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:38.680065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4167d1-5117-4210-b722-1e24dd42ed77 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:38.689895 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75104bf7-884b-431a-ba46-018f240804d5 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:38.694901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4ab6b-a826-40a4-947f-642b7f68fab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:38.695681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4ab6b-a826-40a4-947f-642b7f68fab5 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:38.695964 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4ab6b-a826-40a4-947f-642b7f68fab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:38.696239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4ab6b-a826-40a4-947f-642b7f68fab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:38.696957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4ab6b-a826-40a4-947f-642b7f68fab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:38.698529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4ab6b-a826-40a4-947f-642b7f68fab5 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:38.700510 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:38.710557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 971/1926] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:38 2022] POST /identity/v3/projects => generated 397 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:38.713954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 956/1927] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:39:38.714628 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4ab6b-a826-40a4-947f-642b7f68fab5 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:38.714903 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4167d1-5117-4210-b722-1e24dd42ed77 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:38.727319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4ab6b-a826-40a4-947f-642b7f68fab5 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:38.782011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4167d1-5117-4210-b722-1e24dd42ed77 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:38.787141 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0677b0-506f-4a39-a3dc-d61f6dfed9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:38.787336 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784e150-1d7c-4d20-9e8f-550521a4462b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:38.787850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0677b0-506f-4a39-a3dc-d61f6dfed9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:38.788137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0677b0-506f-4a39-a3dc-d61f6dfed9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:38.788235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784e150-1d7c-4d20-9e8f-550521a4462b admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:38.788439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0677b0-506f-4a39-a3dc-d61f6dfed9d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:38.788571 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784e150-1d7c-4d20-9e8f-550521a4462b admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:38.788780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784e150-1d7c-4d20-9e8f-550521a4462b admin admin] PATH_INFO: `/v3/projects/6c35de7a11534cf38481721fa614b23e/users/60ddeee0f99843bf84bd9398358f7d28/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:38.789122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0677b0-506f-4a39-a3dc-d61f6dfed9d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:38.791042 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0677b0-506f-4a39-a3dc-d61f6dfed9d5 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:38.804765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784e150-1d7c-4d20-9e8f-550521a4462b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c35de7a11534cf38481721fa614b23e, user_id=60ddeee0f99843bf84bd9398358f7d28, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:38.807755 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784e150-1d7c-4d20-9e8f-550521a4462b admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:38.815392 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 957/1928] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:38 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:38.816365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0677b0-506f-4a39-a3dc-d61f6dfed9d5 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:38.822113 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 972/1929] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:38 2022] PUT /identity/v3/projects/6c35de7a11534cf38481721fa614b23e/users/60ddeee0f99843bf84bd9398358f7d28/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:39:38.831453 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0677b0-506f-4a39-a3dc-d61f6dfed9d5 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:38.834208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82eee8-ab59-40da-b7e3-a370c11f81bf None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:38.834543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82eee8-ab59-40da-b7e3-a370c11f81bf None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:38.834835 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82eee8-ab59-40da-b7e3-a370c11f81bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:38.862808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-7c82eee8-ab59-40da-b7e3-a370c11f81bf None None] MFA Rules not processed for user `60ddeee0f99843bf84bd9398358f7d28`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:38.863974 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-7c82eee8-ab59-40da-b7e3-a370c11f81bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:38.888260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc8e4c-aed8-4df1-85d3-9fc79c05c094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:38.888942 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc8e4c-aed8-4df1-85d3-9fc79c05c094 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:38.889227 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc8e4c-aed8-4df1-85d3-9fc79c05c094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:38.889503 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc8e4c-aed8-4df1-85d3-9fc79c05c094 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:38.890221 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc8e4c-aed8-4df1-85d3-9fc79c05c094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:38.891898 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc8e4c-aed8-4df1-85d3-9fc79c05c094 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:38.903316 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 958/1930] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:38.906021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc8e4c-aed8-4df1-85d3-9fc79c05c094 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:38.906149 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:38.916915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc8e4c-aed8-4df1-85d3-9fc79c05c094 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:38.921666 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839a70d-e500-4dee-9b1c-5fb6055ab91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:38.922366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839a70d-e500-4dee-9b1c-5fb6055ab91b admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:38.922618 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839a70d-e500-4dee-9b1c-5fb6055ab91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:38.922899 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839a70d-e500-4dee-9b1c-5fb6055ab91b admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:38.924207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839a70d-e500-4dee-9b1c-5fb6055ab91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:38.925808 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839a70d-e500-4dee-9b1c-5fb6055ab91b admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:38.935977 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 973/1931] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:38.939515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 959/1932] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:39:38.940381 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839a70d-e500-4dee-9b1c-5fb6055ab91b admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:38.941670 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82eee8-ab59-40da-b7e3-a370c11f81bf None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:38.952892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839a70d-e500-4dee-9b1c-5fb6055ab91b admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:38.954143 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82eee8-ab59-40da-b7e3-a370c11f81bf None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:38.957909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ce588-03bc-4640-ad7a-699ee13da5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:38.958881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ce588-03bc-4640-ad7a-699ee13da5a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:38.959095 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ce588-03bc-4640-ad7a-699ee13da5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:38.959436 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ce588-03bc-4640-ad7a-699ee13da5a1 admin admin] PATH_INFO: `/v3/projects/66e188d840e24e009a6b8ebaa7f872a6/users/edb049487ecb405aa7d6e71897749e24/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:38.960566 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f211f7-642f-47a1-a960-3dc5010758ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:38.961459 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f211f7-642f-47a1-a960-3dc5010758ea admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:38.961945 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f211f7-642f-47a1-a960-3dc5010758ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:38.962444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f211f7-642f-47a1-a960-3dc5010758ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:38.963589 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f211f7-642f-47a1-a960-3dc5010758ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:38.965719 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f211f7-642f-47a1-a960-3dc5010758ea admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:38.980336 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ce588-03bc-4640-ad7a-699ee13da5a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e188d840e24e009a6b8ebaa7f872a6, user_id=edb049487ecb405aa7d6e71897749e24, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:38.983116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ce588-03bc-4640-ad7a-699ee13da5a1 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:38.995411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 974/1933] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:38 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:38.999328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f211f7-642f-47a1-a960-3dc5010758ea admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:39.000551 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 960/1934] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:38 2022] PUT /identity/v3/projects/66e188d840e24e009a6b8ebaa7f872a6/users/edb049487ecb405aa7d6e71897749e24/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:39.011606 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dc070-a92e-457c-83a4-a9764f46b37f None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:39.011900 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dc070-a92e-457c-83a4-a9764f46b37f None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:39.012179 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dc070-a92e-457c-83a4-a9764f46b37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:39.041918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-8b9dc070-a92e-457c-83a4-a9764f46b37f None None] MFA Rules not processed for user `edb049487ecb405aa7d6e71897749e24`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:39.043338 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-8b9dc070-a92e-457c-83a4-a9764f46b37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:39.081286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f211f7-642f-47a1-a960-3dc5010758ea admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:39.087364 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def63fa9-5b0e-466c-a28d-e5753e49d477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:39.088077 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def63fa9-5b0e-466c-a28d-e5753e49d477 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:39.088200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:39.088419 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def63fa9-5b0e-466c-a28d-e5753e49d477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:39.088702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def63fa9-5b0e-466c-a28d-e5753e49d477 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:39.089602 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def63fa9-5b0e-466c-a28d-e5753e49d477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:39.091686 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def63fa9-5b0e-466c-a28d-e5753e49d477 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:39.120701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 975/1935] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:38 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:39.122186 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def63fa9-5b0e-466c-a28d-e5753e49d477 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:39.127031 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 961/1936] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:39.131504 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dc070-a92e-457c-83a4-a9764f46b37f None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:39.135952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def63fa9-5b0e-466c-a28d-e5753e49d477 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:39.140825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d9807-353e-44af-8e3c-6e072f8e2bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:39.141505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d9807-353e-44af-8e3c-6e072f8e2bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:39.141789 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d9807-353e-44af-8e3c-6e072f8e2bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:39.142599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d9807-353e-44af-8e3c-6e072f8e2bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:39.143106 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dc070-a92e-457c-83a4-a9764f46b37f None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:39.143355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d9807-353e-44af-8e3c-6e072f8e2bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:39.144991 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d9807-353e-44af-8e3c-6e072f8e2bd4 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:39.147872 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb853e-5fe8-4b67-9a8f-a716db38fdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:39.148514 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb853e-5fe8-4b67-9a8f-a716db38fdd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:39.148798 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb853e-5fe8-4b67-9a8f-a716db38fdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:39.149073 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb853e-5fe8-4b67-9a8f-a716db38fdd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:39.149785 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb853e-5fe8-4b67-9a8f-a716db38fdd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:39.151754 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb853e-5fe8-4b67-9a8f-a716db38fdd6 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:39.154954 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 976/1937] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:39.160093 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d9807-353e-44af-8e3c-6e072f8e2bd4 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:39.169303 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d9807-353e-44af-8e3c-6e072f8e2bd4 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:39.174349 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2e65a-90a9-4c4d-8c08-689aebd3b997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:39.175247 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2e65a-90a9-4c4d-8c08-689aebd3b997 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:39.175564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2e65a-90a9-4c4d-8c08-689aebd3b997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:39.175847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2e65a-90a9-4c4d-8c08-689aebd3b997 admin admin] PATH_INFO: `/v3/projects/ecb823d61db7474d9f69ea112526de19/users/c382e6a9706e4df28115286b8ae7a06f/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:39.182154 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 962/1938] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:39 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:39.186278 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb853e-5fe8-4b67-9a8f-a716db38fdd6 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:39.190771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2e65a-90a9-4c4d-8c08-689aebd3b997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb823d61db7474d9f69ea112526de19, user_id=c382e6a9706e4df28115286b8ae7a06f, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:39.193521 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2e65a-90a9-4c4d-8c08-689aebd3b997 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:39.207063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 977/1939] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:39 2022] PUT /identity/v3/projects/ecb823d61db7474d9f69ea112526de19/users/c382e6a9706e4df28115286b8ae7a06f/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:39:39.210575 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2e65a-90a9-4c4d-8c08-689aebd3b997 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:39.250184 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb853e-5fe8-4b67-9a8f-a716db38fdd6 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:39.271802 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2e65a-90a9-4c4d-8c08-689aebd3b997 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:39.276524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6af801-d8a8-4f1f-abb8-8dd12fd3ae60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:39.277114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6af801-d8a8-4f1f-abb8-8dd12fd3ae60 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:39.277489 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6af801-d8a8-4f1f-abb8-8dd12fd3ae60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:39.277761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6af801-d8a8-4f1f-abb8-8dd12fd3ae60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:39.278481 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6af801-d8a8-4f1f-abb8-8dd12fd3ae60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:39.280111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6af801-d8a8-4f1f-abb8-8dd12fd3ae60 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:39.290369 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 978/1940] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:39:39.294396 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6af801-d8a8-4f1f-abb8-8dd12fd3ae60 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:39.304117 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6af801-d8a8-4f1f-abb8-8dd12fd3ae60 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:39.308526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048998a9-aa31-45c9-94ac-453cb7724547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:39.308708 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe22742-aaef-461a-82f0-9eab79508933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:39.309202 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048998a9-aa31-45c9-94ac-453cb7724547 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:39.309490 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048998a9-aa31-45c9-94ac-453cb7724547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:39.309609 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe22742-aaef-461a-82f0-9eab79508933 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:39.309767 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048998a9-aa31-45c9-94ac-453cb7724547 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:39.309883 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe22742-aaef-461a-82f0-9eab79508933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:39.310149 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe22742-aaef-461a-82f0-9eab79508933 admin admin] PATH_INFO: `/v3/projects/ecb823d61db7474d9f69ea112526de19/users/c382e6a9706e4df28115286b8ae7a06f/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:39.310447 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048998a9-aa31-45c9-94ac-453cb7724547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:39.312187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe22742-aaef-461a-82f0-9eab79508933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb823d61db7474d9f69ea112526de19, user_id=c382e6a9706e4df28115286b8ae7a06f, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:39.312407 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048998a9-aa31-45c9-94ac-453cb7724547 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:39.314866 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe22742-aaef-461a-82f0-9eab79508933 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:39.320732 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:39.328110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 979/1941] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:39 2022] PUT /identity/v3/projects/ecb823d61db7474d9f69ea112526de19/users/c382e6a9706e4df28115286b8ae7a06f/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:39:39.338115 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 963/1942] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:39 2022] POST /identity/v3/users => generated 306 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:39:39.338735 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301cd91-b03d-4474-952a-90211e4c5830 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:39.339087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301cd91-b03d-4474-952a-90211e4c5830 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:39.339185 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048998a9-aa31-45c9-94ac-453cb7724547 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:39.339506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301cd91-b03d-4474-952a-90211e4c5830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:39.349622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048998a9-aa31-45c9-94ac-453cb7724547 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:39.367101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-6301cd91-b03d-4474-952a-90211e4c5830 None None] MFA Rules not processed for user `c382e6a9706e4df28115286b8ae7a06f`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:39.368291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-6301cd91-b03d-4474-952a-90211e4c5830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:39.399997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:39.411238 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb2f43-a681-4394-baa0-acd7ef5edb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:39.412062 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb2f43-a681-4394-baa0-acd7ef5edb66 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:39.412348 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb2f43-a681-4394-baa0-acd7ef5edb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:39.412622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb2f43-a681-4394-baa0-acd7ef5edb66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:39.413338 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb2f43-a681-4394-baa0-acd7ef5edb66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:39.414948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb2f43-a681-4394-baa0-acd7ef5edb66 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:39.426146 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 964/1943] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:39:39.435358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb2f43-a681-4394-baa0-acd7ef5edb66 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:39.437746 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 980/1944] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:39.448871 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301cd91-b03d-4474-952a-90211e4c5830 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:39.450259 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-6301cd91-b03d-4474-952a-90211e4c5830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:39.452368 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb2f43-a681-4394-baa0-acd7ef5edb66 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:39.457755 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa18780-179b-4562-a724-701105b34325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:39.458769 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa18780-179b-4562-a724-701105b34325 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:39.459058 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa18780-179b-4562-a724-701105b34325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:39.459372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa18780-179b-4562-a724-701105b34325 admin admin] PATH_INFO: `/v3/projects/87a3c97fd889483e92ae638c69104cc1/users/4e2ca74264124e33adcc5311b9f33a46/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:39.475231 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa18780-179b-4562-a724-701105b34325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87a3c97fd889483e92ae638c69104cc1, user_id=4e2ca74264124e33adcc5311b9f33a46, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:39.477922 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa18780-179b-4562-a724-701105b34325 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:39.492865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 965/1945] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:39 2022] PUT /identity/v3/projects/87a3c97fd889483e92ae638c69104cc1/users/4e2ca74264124e33adcc5311b9f33a46/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:39.497286 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa18780-179b-4562-a724-701105b34325 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:39.520371 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301cd91-b03d-4474-952a-90211e4c5830 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:39.590801 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa18780-179b-4562-a724-701105b34325 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:39.592720 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a231e32-363b-4aad-af03-b3669f267ea5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:39.593386 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a231e32-363b-4aad-af03-b3669f267ea5 service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:39.593671 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a231e32-363b-4aad-af03-b3669f267ea5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:39.593954 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a231e32-363b-4aad-af03-b3669f267ea5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:39.596001 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b37af-2e92-4a16-ac86-ebe974dd798d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:39.596612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b37af-2e92-4a16-ac86-ebe974dd798d admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:39.596979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b37af-2e92-4a16-ac86-ebe974dd798d admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:39.597800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b37af-2e92-4a16-ac86-ebe974dd798d admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:39.598121 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b37af-2e92-4a16-ac86-ebe974dd798d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:39.599895 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b37af-2e92-4a16-ac86-ebe974dd798d admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:39.614687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 966/1946] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:39:39.615812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b37af-2e92-4a16-ac86-ebe974dd798d admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:39.628387 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b37af-2e92-4a16-ac86-ebe974dd798d admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:39.634210 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973ad4e-8bf5-4f6b-94e1-48b2cb15b8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:39.635586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973ad4e-8bf5-4f6b-94e1-48b2cb15b8af admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:39.636007 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973ad4e-8bf5-4f6b-94e1-48b2cb15b8af admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:39.636428 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973ad4e-8bf5-4f6b-94e1-48b2cb15b8af admin admin] PATH_INFO: `/v3/projects/87a3c97fd889483e92ae638c69104cc1/users/4e2ca74264124e33adcc5311b9f33a46/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:39.639355 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973ad4e-8bf5-4f6b-94e1-48b2cb15b8af admin admin] RBAC: Authorizing `identity:create_grant(project_id=87a3c97fd889483e92ae638c69104cc1, user_id=4e2ca74264124e33adcc5311b9f33a46, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:39.642646 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973ad4e-8bf5-4f6b-94e1-48b2cb15b8af admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:39.653399 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 967/1947] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:39 2022] PUT /identity/v3/projects/87a3c97fd889483e92ae638c69104cc1/users/4e2ca74264124e33adcc5311b9f33a46/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:39:39.653557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:39.664253 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc244ee-6455-441e-975c-f74e1d595981 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:39.664540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc244ee-6455-441e-975c-f74e1d595981 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:39.664820 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc244ee-6455-441e-975c-f74e1d595981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:39.670221 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a231e32-363b-4aad-af03-b3669f267ea5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:39.671796 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a231e32-363b-4aad-af03-b3669f267ea5 service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:39.681587 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 981/1948] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:39.692915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-5cc244ee-6455-441e-975c-f74e1d595981 None None] MFA Rules not processed for user `4e2ca74264124e33adcc5311b9f33a46`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:39.694113 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-5cc244ee-6455-441e-975c-f74e1d595981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:39.771660 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 968/1949] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:39 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:39.781904 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a231e32-363b-4aad-af03-b3669f267ea5 service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:39.793453 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a231e32-363b-4aad-af03-b3669f267ea5 service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:39.865572 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4e21e-3ce4-4eed-86f3-e3f7a2f25968 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:39.866259 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4e21e-3ce4-4eed-86f3-e3f7a2f25968 service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:39.866535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4e21e-3ce4-4eed-86f3-e3f7a2f25968 service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:39.866825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4e21e-3ce4-4eed-86f3-e3f7a2f25968 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:39.879530 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4e21e-3ce4-4eed-86f3-e3f7a2f25968 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:39.880930 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4e21e-3ce4-4eed-86f3-e3f7a2f25968 service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:39.893079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 982/1950] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:39 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:39.982369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc244ee-6455-441e-975c-f74e1d595981 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:39.992812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc244ee-6455-441e-975c-f74e1d595981 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:39.996399 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f40f5-787c-46bf-bb28-15bba3f71b18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:39.997035 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f40f5-787c-46bf-bb28-15bba3f71b18 service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:39.997320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f40f5-787c-46bf-bb28-15bba3f71b18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:39.997598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f40f5-787c-46bf-bb28-15bba3f71b18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:40.027686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:40.059535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f40f5-787c-46bf-bb28-15bba3f71b18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:40.060993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f40f5-787c-46bf-bb28-15bba3f71b18 service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:40.070885 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 969/1951] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:39 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:40.110425 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4e21e-3ce4-4eed-86f3-e3f7a2f25968 service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:40.179829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4e21e-3ce4-4eed-86f3-e3f7a2f25968 service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:40.185036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59e923-a4f7-411d-8258-b377829a8aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:40.185681 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59e923-a4f7-411d-8258-b377829a8aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:40.186042 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59e923-a4f7-411d-8258-b377829a8aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:40.186317 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59e923-a4f7-411d-8258-b377829a8aad admin admin] PATH_INFO: `/v3/users/60ddeee0f99843bf84bd9398358f7d28` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:40.187713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59e923-a4f7-411d-8258-b377829a8aad admin admin] RBAC: Authorizing `identity:delete_user(user_id=60ddeee0f99843bf84bd9398358f7d28)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:40.189877 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59e923-a4f7-411d-8258-b377829a8aad admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:40.253752 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4f59e923-a4f7-411d-8258-b377829a8aad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60ddeee0f99843bf84bd9398358f7d28'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:40.254433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4f59e923-a4f7-411d-8258-b377829a8aad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60ddeee0f99843bf84bd9398358f7d28'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:40.263044 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4f59e923-a4f7-411d-8258-b377829a8aad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60ddeee0f99843bf84bd9398358f7d28'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:40.263803 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4f59e923-a4f7-411d-8258-b377829a8aad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60ddeee0f99843bf84bd9398358f7d28'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:40.281655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4f59e923-a4f7-411d-8258-b377829a8aad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60ddeee0f99843bf84bd9398358f7d28'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:40.299610 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 983/1952] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:40 2022] DELETE /identity/v3/users/60ddeee0f99843bf84bd9398358f7d28 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:40.304080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fa08c-4a6d-4996-9c7d-e3663ae5c590 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:40.304600 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fa08c-4a6d-4996-9c7d-e3663ae5c590 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:40.304705 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fa08c-4a6d-4996-9c7d-e3663ae5c590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:40.322320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-fe3fa08c-4a6d-4996-9c7d-e3663ae5c590 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:40.323542 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-fe3fa08c-4a6d-4996-9c7d-e3663ae5c590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:40.391760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 970/1953] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:40.404250 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59e923-a4f7-411d-8258-b377829a8aad admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:40.406618 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-4f59e923-a4f7-411d-8258-b377829a8aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:40.421287 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:40.467162 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59e923-a4f7-411d-8258-b377829a8aad admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:40.470764 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0d7d3-b64d-4a49-8bab-e5cd438eded3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:40.471466 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0d7d3-b64d-4a49-8bab-e5cd438eded3 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:40.471755 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0d7d3-b64d-4a49-8bab-e5cd438eded3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:40.472032 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0d7d3-b64d-4a49-8bab-e5cd438eded3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:40.481351 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0d7d3-b64d-4a49-8bab-e5cd438eded3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:40.482829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0d7d3-b64d-4a49-8bab-e5cd438eded3 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:40.492798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 984/1954] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:40.838508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fa08c-4a6d-4996-9c7d-e3663ae5c590 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:40.839946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-fe3fa08c-4a6d-4996-9c7d-e3663ae5c590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:40.852694 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fa08c-4a6d-4996-9c7d-e3663ae5c590 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:40.857450 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65557d29-e1ac-4528-a80f-6ce33c13a7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:40.858347 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65557d29-e1ac-4528-a80f-6ce33c13a7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:40.858630 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65557d29-e1ac-4528-a80f-6ce33c13a7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:40.858906 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65557d29-e1ac-4528-a80f-6ce33c13a7e5 admin admin] PATH_INFO: `/v3/projects/6c35de7a11534cf38481721fa614b23e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:40.860118 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65557d29-e1ac-4528-a80f-6ce33c13a7e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c35de7a11534cf38481721fa614b23e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:40.862824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65557d29-e1ac-4528-a80f-6ce33c13a7e5 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:40.908169 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-65557d29-e1ac-4528-a80f-6ce33c13a7e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c35de7a11534cf38481721fa614b23e', 'request_id': 'req-65557d29-e1ac-4528-a80f-6ce33c13a7e5'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:40.915583 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-65557d29-e1ac-4528-a80f-6ce33c13a7e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c35de7a11534cf38481721fa614b23e', 'request_id': 'req-65557d29-e1ac-4528-a80f-6ce33c13a7e5'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:40.922984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-65557d29-e1ac-4528-a80f-6ce33c13a7e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c35de7a11534cf38481721fa614b23e', 'request_id': 'req-65557d29-e1ac-4528-a80f-6ce33c13a7e5'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:40.933810 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-65557d29-e1ac-4528-a80f-6ce33c13a7e5 admin admin] The token cache is being invalidate because project 6c35de7a11534cf38481721fa614b23e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:40.934083 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-65557d29-e1ac-4528-a80f-6ce33c13a7e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:40.934720 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-65557d29-e1ac-4528-a80f-6ce33c13a7e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:40.936279 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 971/1955] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:40 2022] DELETE /identity/v3/projects/6c35de7a11534cf38481721fa614b23e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:40.940193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0d7d3-b64d-4a49-8bab-e5cd438eded3 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:40.949824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0d7d3-b64d-4a49-8bab-e5cd438eded3 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:41.010029 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6229b8ee-c301-4c48-b4c6-39c0b4d5ec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:41.010901 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229b8ee-c301-4c48-b4c6-39c0b4d5ec6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:41.011178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229b8ee-c301-4c48-b4c6-39c0b4d5ec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:41.011496 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229b8ee-c301-4c48-b4c6-39c0b4d5ec6e admin admin] PATH_INFO: `/v3/users/c382e6a9706e4df28115286b8ae7a06f` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:41.012678 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6229b8ee-c301-4c48-b4c6-39c0b4d5ec6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c382e6a9706e4df28115286b8ae7a06f)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:41.014616 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6229b8ee-c301-4c48-b4c6-39c0b4d5ec6e admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:41.068482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6229b8ee-c301-4c48-b4c6-39c0b4d5ec6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c382e6a9706e4df28115286b8ae7a06f'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:41.069196 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6229b8ee-c301-4c48-b4c6-39c0b4d5ec6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c382e6a9706e4df28115286b8ae7a06f'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:41.076840 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6229b8ee-c301-4c48-b4c6-39c0b4d5ec6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c382e6a9706e4df28115286b8ae7a06f'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:41.079689 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6229b8ee-c301-4c48-b4c6-39c0b4d5ec6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c382e6a9706e4df28115286b8ae7a06f'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:41.095964 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6229b8ee-c301-4c48-b4c6-39c0b4d5ec6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c382e6a9706e4df28115286b8ae7a06f'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:41.108771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 985/1956] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:40 2022] DELETE /identity/v3/users/c382e6a9706e4df28115286b8ae7a06f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:39:41.372120 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65557d29-e1ac-4528-a80f-6ce33c13a7e5 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:41.373767 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-65557d29-e1ac-4528-a80f-6ce33c13a7e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:41.389520 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65557d29-e1ac-4528-a80f-6ce33c13a7e5 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:41.446038 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:41.456917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d06138-e9a4-4389-9b60-05aae9bc9000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:41.457872 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d06138-e9a4-4389-9b60-05aae9bc9000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:41.458158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d06138-e9a4-4389-9b60-05aae9bc9000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:41.458431 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d06138-e9a4-4389-9b60-05aae9bc9000 admin admin] PATH_INFO: `/v3/projects/ecb823d61db7474d9f69ea112526de19` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:41.459660 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d06138-e9a4-4389-9b60-05aae9bc9000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecb823d61db7474d9f69ea112526de19)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:41.461569 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d06138-e9a4-4389-9b60-05aae9bc9000 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:41.510570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f1d06138-e9a4-4389-9b60-05aae9bc9000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecb823d61db7474d9f69ea112526de19', 'request_id': 'req-f1d06138-e9a4-4389-9b60-05aae9bc9000'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:41.517530 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f1d06138-e9a4-4389-9b60-05aae9bc9000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecb823d61db7474d9f69ea112526de19', 'request_id': 'req-f1d06138-e9a4-4389-9b60-05aae9bc9000'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:41.523909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f1d06138-e9a4-4389-9b60-05aae9bc9000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecb823d61db7474d9f69ea112526de19', 'request_id': 'req-f1d06138-e9a4-4389-9b60-05aae9bc9000'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:41.534114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f1d06138-e9a4-4389-9b60-05aae9bc9000 admin admin] The token cache is being invalidate because project ecb823d61db7474d9f69ea112526de19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:41.534404 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f1d06138-e9a4-4389-9b60-05aae9bc9000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:41.535035 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f1d06138-e9a4-4389-9b60-05aae9bc9000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:41.536599 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 972/1957] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:41 2022] DELETE /identity/v3/projects/ecb823d61db7474d9f69ea112526de19 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:41.541543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bcd09-6fce-4509-9c9f-12aaa3554c04 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:41.541999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bcd09-6fce-4509-9c9f-12aaa3554c04 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:41.542107 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bcd09-6fce-4509-9c9f-12aaa3554c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:41.559791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-da6bcd09-6fce-4509-9c9f-12aaa3554c04 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:41.561007 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-da6bcd09-6fce-4509-9c9f-12aaa3554c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:41.590361 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:41.624048 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 986/1958] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:41.631776 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06609172-dcb3-4288-9fee-c16e1ad70331 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:41.632071 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06609172-dcb3-4288-9fee-c16e1ad70331 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:41.632353 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06609172-dcb3-4288-9fee-c16e1ad70331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:41.650542 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-06609172-dcb3-4288-9fee-c16e1ad70331 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:41.651810 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-06609172-dcb3-4288-9fee-c16e1ad70331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:41.660180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 973/1959] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:41.664292 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bcd09-6fce-4509-9c9f-12aaa3554c04 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:41.674594 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bcd09-6fce-4509-9c9f-12aaa3554c04 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:41.679179 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fa08f-2a76-409c-991c-60a45b3f2adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:41.679876 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fa08f-2a76-409c-991c-60a45b3f2adc admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:41.680161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fa08f-2a76-409c-991c-60a45b3f2adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:41.680441 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fa08f-2a76-409c-991c-60a45b3f2adc admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:41.681167 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fa08f-2a76-409c-991c-60a45b3f2adc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:39:41.681477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fa08f-2a76-409c-991c-60a45b3f2adc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:41.683086 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fa08f-2a76-409c-991c-60a45b3f2adc admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:41.694642 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 987/1960] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:39:41.698742 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06609172-dcb3-4288-9fee-c16e1ad70331 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:41.708128 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06609172-dcb3-4288-9fee-c16e1ad70331 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:41.712734 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e226eb-689c-41e6-98ab-73ac039987e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:41.713403 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e226eb-689c-41e6-98ab-73ac039987e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:41.713671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e226eb-689c-41e6-98ab-73ac039987e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:41.713948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e226eb-689c-41e6-98ab-73ac039987e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:41.714648 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e226eb-689c-41e6-98ab-73ac039987e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:41.716568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e226eb-689c-41e6-98ab-73ac039987e9 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:41.751050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 974/1961] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:41 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:39:41.756447 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fa08f-2a76-409c-991c-60a45b3f2adc admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:41.768103 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fa08f-2a76-409c-991c-60a45b3f2adc admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:41.859197 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3f8b1-f1d5-441c-9f60-c6c38a137597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:41.860202 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3f8b1-f1d5-441c-9f60-c6c38a137597 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:41.860495 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3f8b1-f1d5-441c-9f60-c6c38a137597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:41.861003 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3f8b1-f1d5-441c-9f60-c6c38a137597 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:41.861896 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3f8b1-f1d5-441c-9f60-c6c38a137597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:41.864041 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3f8b1-f1d5-441c-9f60-c6c38a137597 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:41.889192 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 988/1962] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:41 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:41.894321 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e226eb-689c-41e6-98ab-73ac039987e9 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:41.908081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e226eb-689c-41e6-98ab-73ac039987e9 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:41.914350 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf761d3-602c-40f7-8ab2-3895c9f4d67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:41.916516 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf761d3-602c-40f7-8ab2-3895c9f4d67f admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:41.916811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf761d3-602c-40f7-8ab2-3895c9f4d67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:41.917130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf761d3-602c-40f7-8ab2-3895c9f4d67f admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:41.917881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf761d3-602c-40f7-8ab2-3895c9f4d67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:41.919690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf761d3-602c-40f7-8ab2-3895c9f4d67f admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:41.934487 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 975/1963] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:41.938312 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3f8b1-f1d5-441c-9f60-c6c38a137597 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:41.949245 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3f8b1-f1d5-441c-9f60-c6c38a137597 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:41.955627 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f78919-bfb9-4ecb-808d-692aa6d19e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:41.956400 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f78919-bfb9-4ecb-808d-692aa6d19e3c admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:41.956747 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f78919-bfb9-4ecb-808d-692aa6d19e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:41.957068 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f78919-bfb9-4ecb-808d-692aa6d19e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:41.957975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f78919-bfb9-4ecb-808d-692aa6d19e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:41.959710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f78919-bfb9-4ecb-808d-692aa6d19e3c admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:41.971296 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 989/1964] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:41.977683 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf761d3-602c-40f7-8ab2-3895c9f4d67f admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:41.991679 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf761d3-602c-40f7-8ab2-3895c9f4d67f admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:42.003944 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde20ddf-0fac-4b89-b25e-07ebec1deef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:42.005615 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde20ddf-0fac-4b89-b25e-07ebec1deef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:42.005935 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde20ddf-0fac-4b89-b25e-07ebec1deef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:42.006293 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde20ddf-0fac-4b89-b25e-07ebec1deef7 admin admin] PATH_INFO: `/v3/projects/63324a2575e64f83bc3ed01d727cbbdf/users/d20e885aedf14060b37b7575e2531e7e/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:42.034903 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde20ddf-0fac-4b89-b25e-07ebec1deef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63324a2575e64f83bc3ed01d727cbbdf, user_id=d20e885aedf14060b37b7575e2531e7e, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:42.039723 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde20ddf-0fac-4b89-b25e-07ebec1deef7 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:42.072513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be426e62-6a61-4461-a930-407598da3e47 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:42.072814 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be426e62-6a61-4461-a930-407598da3e47 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:42.073105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be426e62-6a61-4461-a930-407598da3e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:42.074480 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 976/1965] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:41 2022] PUT /identity/v3/projects/63324a2575e64f83bc3ed01d727cbbdf/users/d20e885aedf14060b37b7575e2531e7e/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:39:42.113247 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-be426e62-6a61-4461-a930-407598da3e47 None None] MFA Rules not processed for user `d20e885aedf14060b37b7575e2531e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:42.115067 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-be426e62-6a61-4461-a930-407598da3e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:42.203111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 990/1966] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:42.207740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde20ddf-0fac-4b89-b25e-07ebec1deef7 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:42.274354 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde20ddf-0fac-4b89-b25e-07ebec1deef7 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:42.279478 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844c154-fa41-473f-9809-f3ecb4de9c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:42.280213 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844c154-fa41-473f-9809-f3ecb4de9c05 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:42.280425 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844c154-fa41-473f-9809-f3ecb4de9c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:42.284234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844c154-fa41-473f-9809-f3ecb4de9c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:42.284234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844c154-fa41-473f-9809-f3ecb4de9c05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:42.285330 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844c154-fa41-473f-9809-f3ecb4de9c05 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:42.313263 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 977/1967] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:42 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:42.318141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be426e62-6a61-4461-a930-407598da3e47 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:42.332130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be426e62-6a61-4461-a930-407598da3e47 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:42.371517 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:42.414022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ef971-1abb-4635-8b54-7664d67b46a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:42.414701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ef971-1abb-4635-8b54-7664d67b46a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:42.414990 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ef971-1abb-4635-8b54-7664d67b46a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:42.415288 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ef971-1abb-4635-8b54-7664d67b46a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:42.415991 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ef971-1abb-4635-8b54-7664d67b46a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:42.417925 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ef971-1abb-4635-8b54-7664d67b46a7 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:42.438104 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 991/1968] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:42 2022] POST /identity/v3/users => generated 298 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:42.442149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844c154-fa41-473f-9809-f3ecb4de9c05 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:42.449782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:42.454004 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844c154-fa41-473f-9809-f3ecb4de9c05 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:42.461564 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d165b1d-47a4-41fa-8c0e-fa705f656b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:42.462227 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d165b1d-47a4-41fa-8c0e-fa705f656b81 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:42.462509 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d165b1d-47a4-41fa-8c0e-fa705f656b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:42.462785 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d165b1d-47a4-41fa-8c0e-fa705f656b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:42.463529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d165b1d-47a4-41fa-8c0e-fa705f656b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:42.465174 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d165b1d-47a4-41fa-8c0e-fa705f656b81 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:42.477908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 978/1969] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:42.482086 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ef971-1abb-4635-8b54-7664d67b46a7 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:42.493338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ef971-1abb-4635-8b54-7664d67b46a7 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:42.498188 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714711c5-9bf3-4f15-84c6-0e40b01c8a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:42.499145 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714711c5-9bf3-4f15-84c6-0e40b01c8a9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:42.499372 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714711c5-9bf3-4f15-84c6-0e40b01c8a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:42.499651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714711c5-9bf3-4f15-84c6-0e40b01c8a9c admin admin] PATH_INFO: `/v3/projects/2e94f328cd494053842228de64bbd0ec/users/1041479fbba04b12bc9dc3cb2227ba2d/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:42.515992 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714711c5-9bf3-4f15-84c6-0e40b01c8a9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e94f328cd494053842228de64bbd0ec, user_id=1041479fbba04b12bc9dc3cb2227ba2d, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:42.518783 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714711c5-9bf3-4f15-84c6-0e40b01c8a9c admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:42.534048 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 992/1970] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:42 2022] PUT /identity/v3/projects/2e94f328cd494053842228de64bbd0ec/users/1041479fbba04b12bc9dc3cb2227ba2d/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:42.537998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d165b1d-47a4-41fa-8c0e-fa705f656b81 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:42.548880 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d165b1d-47a4-41fa-8c0e-fa705f656b81 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:42.620303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de593f65-1203-424d-b219-7ff1dc0564f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:42.620990 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de593f65-1203-424d-b219-7ff1dc0564f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:42.621640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de593f65-1203-424d-b219-7ff1dc0564f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:42.621640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de593f65-1203-424d-b219-7ff1dc0564f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:42.622574 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de593f65-1203-424d-b219-7ff1dc0564f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:42.624204 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de593f65-1203-424d-b219-7ff1dc0564f3 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:42.641980 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 979/1971] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:42.646141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714711c5-9bf3-4f15-84c6-0e40b01c8a9c admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:42.667117 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714711c5-9bf3-4f15-84c6-0e40b01c8a9c admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:42.677600 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0371ed4-4fef-4ad6-92f0-27641d197804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:42.678709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0371ed4-4fef-4ad6-92f0-27641d197804 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:42.679068 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0371ed4-4fef-4ad6-92f0-27641d197804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:42.679378 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0371ed4-4fef-4ad6-92f0-27641d197804 admin admin] PATH_INFO: `/v3/projects/2e94f328cd494053842228de64bbd0ec/users/1041479fbba04b12bc9dc3cb2227ba2d/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:42.681605 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0371ed4-4fef-4ad6-92f0-27641d197804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e94f328cd494053842228de64bbd0ec, user_id=1041479fbba04b12bc9dc3cb2227ba2d, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:42.686147 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0371ed4-4fef-4ad6-92f0-27641d197804 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:42.698037 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 993/1972] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:42 2022] PUT /identity/v3/projects/2e94f328cd494053842228de64bbd0ec/users/1041479fbba04b12bc9dc3cb2227ba2d/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:42.709454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87172ae6-9151-40fd-ae20-6a666bd96c40 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:42.709756 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87172ae6-9151-40fd-ae20-6a666bd96c40 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:42.710042 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87172ae6-9151-40fd-ae20-6a666bd96c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:42.740515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-87172ae6-9151-40fd-ae20-6a666bd96c40 None None] MFA Rules not processed for user `1041479fbba04b12bc9dc3cb2227ba2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:42.742586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-87172ae6-9151-40fd-ae20-6a666bd96c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:42.831341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 980/1973] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:42.843852 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0371ed4-4fef-4ad6-92f0-27641d197804 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:42.845770 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-c0371ed4-4fef-4ad6-92f0-27641d197804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:42.910132 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0371ed4-4fef-4ad6-92f0-27641d197804 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:42.914836 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709f45a-343c-40b7-9db0-51ba79e978e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:42.915555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709f45a-343c-40b7-9db0-51ba79e978e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:42.915830 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709f45a-343c-40b7-9db0-51ba79e978e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:42.916118 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709f45a-343c-40b7-9db0-51ba79e978e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:42.928176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709f45a-343c-40b7-9db0-51ba79e978e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:42.931009 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709f45a-343c-40b7-9db0-51ba79e978e9 service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:42.945426 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 994/1974] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:43.035556 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87172ae6-9151-40fd-ae20-6a666bd96c40 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:43.044978 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87172ae6-9151-40fd-ae20-6a666bd96c40 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:43.049570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a1a3f-3a86-41bb-8287-c3b42b55bc90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:43.050229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a1a3f-3a86-41bb-8287-c3b42b55bc90 service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:43.050511 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a1a3f-3a86-41bb-8287-c3b42b55bc90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:43.050812 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a1a3f-3a86-41bb-8287-c3b42b55bc90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:43.111826 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a1a3f-3a86-41bb-8287-c3b42b55bc90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:43.113263 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a1a3f-3a86-41bb-8287-c3b42b55bc90 service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:43.122291 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 981/1975] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:43.388627 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709f45a-343c-40b7-9db0-51ba79e978e9 service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:43.480079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709f45a-343c-40b7-9db0-51ba79e978e9 service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:43.484634 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991cd19-9510-4b88-9d80-a0de8f8d5275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:43.486342 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991cd19-9510-4b88-9d80-a0de8f8d5275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:43.486635 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991cd19-9510-4b88-9d80-a0de8f8d5275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:43.486915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991cd19-9510-4b88-9d80-a0de8f8d5275 admin admin] PATH_INFO: `/v3/users/d20e885aedf14060b37b7575e2531e7e` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:43.488167 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991cd19-9510-4b88-9d80-a0de8f8d5275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d20e885aedf14060b37b7575e2531e7e)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:43.490136 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991cd19-9510-4b88-9d80-a0de8f8d5275 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:43.525196 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:43.556682 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3991cd19-9510-4b88-9d80-a0de8f8d5275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd20e885aedf14060b37b7575e2531e7e'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:43.557351 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3991cd19-9510-4b88-9d80-a0de8f8d5275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd20e885aedf14060b37b7575e2531e7e'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:43.564970 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3991cd19-9510-4b88-9d80-a0de8f8d5275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd20e885aedf14060b37b7575e2531e7e'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:43.565618 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3991cd19-9510-4b88-9d80-a0de8f8d5275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd20e885aedf14060b37b7575e2531e7e'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:43.577656 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3991cd19-9510-4b88-9d80-a0de8f8d5275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd20e885aedf14060b37b7575e2531e7e'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:43.602504 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 995/1976] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:43 2022] DELETE /identity/v3/users/d20e885aedf14060b37b7575e2531e7e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:39:43.606949 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19864d8f-fd52-4ce4-9183-093a7865bb81 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:43.607460 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19864d8f-fd52-4ce4-9183-093a7865bb81 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:43.607611 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19864d8f-fd52-4ce4-9183-093a7865bb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:43.624631 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-19864d8f-fd52-4ce4-9183-093a7865bb81 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:43.625834 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-19864d8f-fd52-4ce4-9183-093a7865bb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:43.634453 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:43.688509 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 982/1977] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:43.698971 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991cd19-9510-4b88-9d80-a0de8f8d5275 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:43.700512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-3991cd19-9510-4b88-9d80-a0de8f8d5275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:43.760889 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991cd19-9510-4b88-9d80-a0de8f8d5275 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:43.764527 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f3419-0b9c-44bc-8218-796822882af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:43.765181 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f3419-0b9c-44bc-8218-796822882af7 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:43.765468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f3419-0b9c-44bc-8218-796822882af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:43.765753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f3419-0b9c-44bc-8218-796822882af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:43.778848 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f3419-0b9c-44bc-8218-796822882af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:43.780345 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f3419-0b9c-44bc-8218-796822882af7 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:43.792394 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 996/1978] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:44.253582 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19864d8f-fd52-4ce4-9183-093a7865bb81 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:44.255355 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-19864d8f-fd52-4ce4-9183-093a7865bb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:44.269158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19864d8f-fd52-4ce4-9183-093a7865bb81 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:44.275200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57e331-5849-406e-a55f-9846406fe936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:44.276161 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57e331-5849-406e-a55f-9846406fe936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:44.276444 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57e331-5849-406e-a55f-9846406fe936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:44.276722 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57e331-5849-406e-a55f-9846406fe936 admin admin] PATH_INFO: `/v3/projects/63324a2575e64f83bc3ed01d727cbbdf` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:44.277902 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57e331-5849-406e-a55f-9846406fe936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63324a2575e64f83bc3ed01d727cbbdf)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:44.279914 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57e331-5849-406e-a55f-9846406fe936 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:44.332921 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ec57e331-5849-406e-a55f-9846406fe936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63324a2575e64f83bc3ed01d727cbbdf', 'request_id': 'req-ec57e331-5849-406e-a55f-9846406fe936'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:44.339742 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ec57e331-5849-406e-a55f-9846406fe936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63324a2575e64f83bc3ed01d727cbbdf', 'request_id': 'req-ec57e331-5849-406e-a55f-9846406fe936'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:44.345884 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ec57e331-5849-406e-a55f-9846406fe936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63324a2575e64f83bc3ed01d727cbbdf', 'request_id': 'req-ec57e331-5849-406e-a55f-9846406fe936'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:44.356279 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ec57e331-5849-406e-a55f-9846406fe936 admin admin] The token cache is being invalidate because project 63324a2575e64f83bc3ed01d727cbbdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:44.356559 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ec57e331-5849-406e-a55f-9846406fe936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:44.357178 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ec57e331-5849-406e-a55f-9846406fe936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:44.358700 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 983/1979] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:44 2022] DELETE /identity/v3/projects/63324a2575e64f83bc3ed01d727cbbdf => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:44.363227 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f3419-0b9c-44bc-8218-796822882af7 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:44.372617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f3419-0b9c-44bc-8218-796822882af7 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:44.431829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bd3a1-2a1c-4d51-a655-9de17e2bbb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:44.432730 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bd3a1-2a1c-4d51-a655-9de17e2bbb99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:44.433008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bd3a1-2a1c-4d51-a655-9de17e2bbb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:44.433282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bd3a1-2a1c-4d51-a655-9de17e2bbb99 admin admin] PATH_INFO: `/v3/users/1041479fbba04b12bc9dc3cb2227ba2d` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:44.434666 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bd3a1-2a1c-4d51-a655-9de17e2bbb99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1041479fbba04b12bc9dc3cb2227ba2d)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:44.436755 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bd3a1-2a1c-4d51-a655-9de17e2bbb99 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:44.487107 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-f36bd3a1-2a1c-4d51-a655-9de17e2bbb99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1041479fbba04b12bc9dc3cb2227ba2d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:44.487910 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-f36bd3a1-2a1c-4d51-a655-9de17e2bbb99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1041479fbba04b12bc9dc3cb2227ba2d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:44.489996 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:44.496021 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-f36bd3a1-2a1c-4d51-a655-9de17e2bbb99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1041479fbba04b12bc9dc3cb2227ba2d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:44.497041 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-f36bd3a1-2a1c-4d51-a655-9de17e2bbb99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1041479fbba04b12bc9dc3cb2227ba2d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:44.514565 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-f36bd3a1-2a1c-4d51-a655-9de17e2bbb99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1041479fbba04b12bc9dc3cb2227ba2d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:44.533972 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 997/1980] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:44 2022] DELETE /identity/v3/users/1041479fbba04b12bc9dc3cb2227ba2d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:44.938829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57e331-5849-406e-a55f-9846406fe936 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:44.940990 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-ec57e331-5849-406e-a55f-9846406fe936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:44.968287 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57e331-5849-406e-a55f-9846406fe936 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:45.108848 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba8a52-7d37-4712-8c69-cf10b300f17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:45.109673 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba8a52-7d37-4712-8c69-cf10b300f17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:45.110555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba8a52-7d37-4712-8c69-cf10b300f17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:45.110841 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba8a52-7d37-4712-8c69-cf10b300f17c admin admin] PATH_INFO: `/v3/projects/2e94f328cd494053842228de64bbd0ec` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:45.112090 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba8a52-7d37-4712-8c69-cf10b300f17c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e94f328cd494053842228de64bbd0ec)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:45.122457 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba8a52-7d37-4712-8c69-cf10b300f17c admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:45.168178 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:45.178568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-04ba8a52-7d37-4712-8c69-cf10b300f17c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e94f328cd494053842228de64bbd0ec', 'request_id': 'req-04ba8a52-7d37-4712-8c69-cf10b300f17c'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:45.186564 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-04ba8a52-7d37-4712-8c69-cf10b300f17c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e94f328cd494053842228de64bbd0ec', 'request_id': 'req-04ba8a52-7d37-4712-8c69-cf10b300f17c'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:45.197945 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-04ba8a52-7d37-4712-8c69-cf10b300f17c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e94f328cd494053842228de64bbd0ec', 'request_id': 'req-04ba8a52-7d37-4712-8c69-cf10b300f17c'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:45.211311 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-04ba8a52-7d37-4712-8c69-cf10b300f17c admin admin] The token cache is being invalidate because project 2e94f328cd494053842228de64bbd0ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:45.211311 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-04ba8a52-7d37-4712-8c69-cf10b300f17c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:45.211543 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-04ba8a52-7d37-4712-8c69-cf10b300f17c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:45.212997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 984/1981] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:44 2022] DELETE /identity/v3/projects/2e94f328cd494053842228de64bbd0ec => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:45.217758 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f71070-1175-425a-89c5-69d0d13b383d None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:45.218243 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f71070-1175-425a-89c5-69d0d13b383d None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:45.218318 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f71070-1175-425a-89c5-69d0d13b383d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:45.237168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-66f71070-1175-425a-89c5-69d0d13b383d None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:45.238405 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-66f71070-1175-425a-89c5-69d0d13b383d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:45.342885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 998/1982] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:45.360801 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc7cb9-7420-4282-942c-a160422b3e01 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:45.360801 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc7cb9-7420-4282-942c-a160422b3e01 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:45.360801 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc7cb9-7420-4282-942c-a160422b3e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:45.375626 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-bacc7cb9-7420-4282-942c-a160422b3e01 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:45.377491 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-bacc7cb9-7420-4282-942c-a160422b3e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:45.386022 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 985/1983] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:45.390150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f71070-1175-425a-89c5-69d0d13b383d None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:45.401208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f71070-1175-425a-89c5-69d0d13b383d None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:45.406089 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115728f7-9041-4987-9da7-b456e4049474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:45.406778 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115728f7-9041-4987-9da7-b456e4049474 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:45.407067 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115728f7-9041-4987-9da7-b456e4049474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:45.407393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115728f7-9041-4987-9da7-b456e4049474 admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:45.408149 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115728f7-9041-4987-9da7-b456e4049474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:39:45.408466 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115728f7-9041-4987-9da7-b456e4049474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:45.410109 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115728f7-9041-4987-9da7-b456e4049474 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:45.423205 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 999/1984] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:39:45.427814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc7cb9-7420-4282-942c-a160422b3e01 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:45.437783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc7cb9-7420-4282-942c-a160422b3e01 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:45.443081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbb44c-4ac8-4ace-8135-fece9fb3b668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:45.443808 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbb44c-4ac8-4ace-8135-fece9fb3b668 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:45.444096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbb44c-4ac8-4ace-8135-fece9fb3b668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:45.444377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbb44c-4ac8-4ace-8135-fece9fb3b668 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:45.445090 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbb44c-4ac8-4ace-8135-fece9fb3b668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:45.447022 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbb44c-4ac8-4ace-8135-fece9fb3b668 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:45.476725 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 986/1985] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:45 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:45.480991 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115728f7-9041-4987-9da7-b456e4049474 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:45.492393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115728f7-9041-4987-9da7-b456e4049474 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:45.552232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558aa8d-aa79-41ef-9735-57c035a9144a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:45.552908 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558aa8d-aa79-41ef-9735-57c035a9144a admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:45.553192 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558aa8d-aa79-41ef-9735-57c035a9144a admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:45.553467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558aa8d-aa79-41ef-9735-57c035a9144a admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:45.554156 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558aa8d-aa79-41ef-9735-57c035a9144a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:45.556112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558aa8d-aa79-41ef-9735-57c035a9144a admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:45.580722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1000/1986] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:45 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:45.585644 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbb44c-4ac8-4ace-8135-fece9fb3b668 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:45.608902 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbb44c-4ac8-4ace-8135-fece9fb3b668 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:45.614859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e3f22-8bde-4944-b20a-9ef1c61caddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:45.615554 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e3f22-8bde-4944-b20a-9ef1c61caddb admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:45.615862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e3f22-8bde-4944-b20a-9ef1c61caddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:45.616137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e3f22-8bde-4944-b20a-9ef1c61caddb admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:45.616868 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e3f22-8bde-4944-b20a-9ef1c61caddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:45.618552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e3f22-8bde-4944-b20a-9ef1c61caddb admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:45.634141 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 987/1987] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:39:45.635402 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558aa8d-aa79-41ef-9735-57c035a9144a admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:45.646943 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558aa8d-aa79-41ef-9735-57c035a9144a admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:45.657104 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1c7f7-ccbf-47bf-87a7-0681e6480f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:45.657373 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1c7f7-ccbf-47bf-87a7-0681e6480f7f admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:45.657666 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1c7f7-ccbf-47bf-87a7-0681e6480f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:45.657947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1c7f7-ccbf-47bf-87a7-0681e6480f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:45.658869 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1c7f7-ccbf-47bf-87a7-0681e6480f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:45.660634 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1c7f7-ccbf-47bf-87a7-0681e6480f7f admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:45.672092 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1001/1988] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:45.676492 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e3f22-8bde-4944-b20a-9ef1c61caddb admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:45.687955 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e3f22-8bde-4944-b20a-9ef1c61caddb admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:45.694321 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abca152-dd82-48f4-b505-9f86a047fbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:45.695467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abca152-dd82-48f4-b505-9f86a047fbb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:45.695783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abca152-dd82-48f4-b505-9f86a047fbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:45.696024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abca152-dd82-48f4-b505-9f86a047fbb3 admin admin] PATH_INFO: `/v3/projects/a05e273048cc4c77abf8747d23b0fa1a/users/371fb41ee2d840f7a8e26c42f76ad030/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:45.712983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abca152-dd82-48f4-b505-9f86a047fbb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a05e273048cc4c77abf8747d23b0fa1a, user_id=371fb41ee2d840f7a8e26c42f76ad030, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:45.715847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abca152-dd82-48f4-b505-9f86a047fbb3 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:45.732866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 988/1989] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:45 2022] PUT /identity/v3/projects/a05e273048cc4c77abf8747d23b0fa1a/users/371fb41ee2d840f7a8e26c42f76ad030/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:45.743155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930b9a8-c09b-4838-a83c-ee317545cee6 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:45.743473 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930b9a8-c09b-4838-a83c-ee317545cee6 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:45.743751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930b9a8-c09b-4838-a83c-ee317545cee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:45.774157 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-6930b9a8-c09b-4838-a83c-ee317545cee6 None None] MFA Rules not processed for user `371fb41ee2d840f7a8e26c42f76ad030`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:45.775513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-6930b9a8-c09b-4838-a83c-ee317545cee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:45.797048 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:45.848876 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1002/1990] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:45.859561 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abca152-dd82-48f4-b505-9f86a047fbb3 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:45.861830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-2abca152-dd82-48f4-b505-9f86a047fbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:45.920595 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abca152-dd82-48f4-b505-9f86a047fbb3 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:45.925158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b9740-b628-4f04-9b9b-cd711fcc45cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e04575437341df8127860a5e5abc50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:45.925821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b9740-b628-4f04-9b9b-cd711fcc45cd service glance] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:45.926093 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b9740-b628-4f04-9b9b-cd711fcc45cd service glance] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:45.926366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b9740-b628-4f04-9b9b-cd711fcc45cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:45.936969 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b9740-b628-4f04-9b9b-cd711fcc45cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:45.939484 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b9740-b628-4f04-9b9b-cd711fcc45cd service glance] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:45.951383 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 989/1991] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:46.598893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930b9a8-c09b-4838-a83c-ee317545cee6 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:46.600407 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-6930b9a8-c09b-4838-a83c-ee317545cee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:46.667978 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930b9a8-c09b-4838-a83c-ee317545cee6 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:46.673551 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701cddd-29f2-4ce3-8f72-805b97d17f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:46.674468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701cddd-29f2-4ce3-8f72-805b97d17f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:46.674748 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701cddd-29f2-4ce3-8f72-805b97d17f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:46.675051 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701cddd-29f2-4ce3-8f72-805b97d17f51 admin admin] PATH_INFO: `/v3/users/feb1cf144fd04b85a0764cc03214a77a` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:46.676294 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701cddd-29f2-4ce3-8f72-805b97d17f51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feb1cf144fd04b85a0764cc03214a77a)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:46.678251 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701cddd-29f2-4ce3-8f72-805b97d17f51 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:46.731501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-a701cddd-29f2-4ce3-8f72-805b97d17f51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feb1cf144fd04b85a0764cc03214a77a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:46.732168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-a701cddd-29f2-4ce3-8f72-805b97d17f51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feb1cf144fd04b85a0764cc03214a77a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:46.741011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-a701cddd-29f2-4ce3-8f72-805b97d17f51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feb1cf144fd04b85a0764cc03214a77a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:46.741767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-a701cddd-29f2-4ce3-8f72-805b97d17f51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feb1cf144fd04b85a0764cc03214a77a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:46.756699 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-a701cddd-29f2-4ce3-8f72-805b97d17f51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feb1cf144fd04b85a0764cc03214a77a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:46.778448 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1003/1992] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:46 2022] DELETE /identity/v3/users/feb1cf144fd04b85a0764cc03214a77a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:46.783100 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc14c0-999e-41df-b871-bb70530d37ee None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:46.783436 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc14c0-999e-41df-b871-bb70530d37ee None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:46.783722 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc14c0-999e-41df-b871-bb70530d37ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:46.809974 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-7ddc14c0-999e-41df-b871-bb70530d37ee None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:46.811618 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-7ddc14c0-999e-41df-b871-bb70530d37ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:46.884274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 990/1993] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:46.894394 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701cddd-29f2-4ce3-8f72-805b97d17f51 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:46.895902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-a701cddd-29f2-4ce3-8f72-805b97d17f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:46.941295 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:46.960971 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701cddd-29f2-4ce3-8f72-805b97d17f51 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:46.964886 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc9905-0151-4b91-a934-e16a647a28c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:46.965539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc9905-0151-4b91-a934-e16a647a28c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:46.965823 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc9905-0151-4b91-a934-e16a647a28c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:46.966099 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc9905-0151-4b91-a934-e16a647a28c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:46.976461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc9905-0151-4b91-a934-e16a647a28c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:46.977909 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc9905-0151-4b91-a934-e16a647a28c1 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:46.988048 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1004/1994] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:47.293112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc14c0-999e-41df-b871-bb70530d37ee None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:47.294686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-7ddc14c0-999e-41df-b871-bb70530d37ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:47.322113 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc14c0-999e-41df-b871-bb70530d37ee None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:47.326975 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea3896-b0a3-4701-a850-64bbdd7f894b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:47.327896 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea3896-b0a3-4701-a850-64bbdd7f894b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:47.328242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea3896-b0a3-4701-a850-64bbdd7f894b admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:47.328445 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea3896-b0a3-4701-a850-64bbdd7f894b admin admin] PATH_INFO: `/v3/projects/896c1262241241e9bb6c328be7704f6e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:47.329829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea3896-b0a3-4701-a850-64bbdd7f894b admin admin] RBAC: Authorizing `identity:delete_project(project_id=896c1262241241e9bb6c328be7704f6e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:47.331878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea3896-b0a3-4701-a850-64bbdd7f894b admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:47.333651 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:47.393984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-80ea3896-b0a3-4701-a850-64bbdd7f894b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '896c1262241241e9bb6c328be7704f6e', 'request_id': 'req-80ea3896-b0a3-4701-a850-64bbdd7f894b'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:47.401997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-80ea3896-b0a3-4701-a850-64bbdd7f894b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '896c1262241241e9bb6c328be7704f6e', 'request_id': 'req-80ea3896-b0a3-4701-a850-64bbdd7f894b'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:47.410793 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-80ea3896-b0a3-4701-a850-64bbdd7f894b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '896c1262241241e9bb6c328be7704f6e', 'request_id': 'req-80ea3896-b0a3-4701-a850-64bbdd7f894b'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:47.423513 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-80ea3896-b0a3-4701-a850-64bbdd7f894b admin admin] The token cache is being invalidate because project 896c1262241241e9bb6c328be7704f6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:47.423805 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-80ea3896-b0a3-4701-a850-64bbdd7f894b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:47.424673 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-80ea3896-b0a3-4701-a850-64bbdd7f894b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:47.426237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 991/1995] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:47 2022] DELETE /identity/v3/projects/896c1262241241e9bb6c328be7704f6e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:47.430721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc9905-0151-4b91-a934-e16a647a28c1 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:47.442214 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc9905-0151-4b91-a934-e16a647a28c1 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:47.532249 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796da9e-8dbf-4c77-8afa-5e410bc3a560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:47.533263 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796da9e-8dbf-4c77-8afa-5e410bc3a560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:47.533648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796da9e-8dbf-4c77-8afa-5e410bc3a560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:47.534025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796da9e-8dbf-4c77-8afa-5e410bc3a560 admin admin] PATH_INFO: `/v3/users/a90c3df79db74b4dac977e809587e46a` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:47.535542 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796da9e-8dbf-4c77-8afa-5e410bc3a560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a90c3df79db74b4dac977e809587e46a)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:47.537697 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796da9e-8dbf-4c77-8afa-5e410bc3a560 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:47.631627 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6796da9e-8dbf-4c77-8afa-5e410bc3a560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a90c3df79db74b4dac977e809587e46a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:47.633472 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6796da9e-8dbf-4c77-8afa-5e410bc3a560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a90c3df79db74b4dac977e809587e46a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:47.646378 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6796da9e-8dbf-4c77-8afa-5e410bc3a560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a90c3df79db74b4dac977e809587e46a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:47.647477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6796da9e-8dbf-4c77-8afa-5e410bc3a560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a90c3df79db74b4dac977e809587e46a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:47.671028 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6796da9e-8dbf-4c77-8afa-5e410bc3a560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a90c3df79db74b4dac977e809587e46a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:47.690425 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1005/1996] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:47 2022] DELETE /identity/v3/users/a90c3df79db74b4dac977e809587e46a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:47.734109 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea3896-b0a3-4701-a850-64bbdd7f894b admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:47.736166 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-80ea3896-b0a3-4701-a850-64bbdd7f894b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:47.749852 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea3896-b0a3-4701-a850-64bbdd7f894b admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:47.811764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6134f3c-8868-4c38-a554-c1d4527630f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:47.812746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6134f3c-8868-4c38-a554-c1d4527630f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:47.813023 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6134f3c-8868-4c38-a554-c1d4527630f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:47.813781 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6134f3c-8868-4c38-a554-c1d4527630f2 admin admin] PATH_INFO: `/v3/users/edb049487ecb405aa7d6e71897749e24` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:47.815044 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6134f3c-8868-4c38-a554-c1d4527630f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edb049487ecb405aa7d6e71897749e24)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:47.816991 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6134f3c-8868-4c38-a554-c1d4527630f2 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:47.912569 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f6134f3c-8868-4c38-a554-c1d4527630f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edb049487ecb405aa7d6e71897749e24'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:47.920811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f6134f3c-8868-4c38-a554-c1d4527630f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edb049487ecb405aa7d6e71897749e24'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:47.921510 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f6134f3c-8868-4c38-a554-c1d4527630f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edb049487ecb405aa7d6e71897749e24'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:47.937117 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f6134f3c-8868-4c38-a554-c1d4527630f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edb049487ecb405aa7d6e71897749e24'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:47.946424 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f6134f3c-8868-4c38-a554-c1d4527630f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edb049487ecb405aa7d6e71897749e24'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:47.954889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 992/1997] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:47 2022] DELETE /identity/v3/users/edb049487ecb405aa7d6e71897749e24 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:47.962294 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b07fd0-8d37-4883-b9ae-99941d5d9fc1 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:47.962786 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b07fd0-8d37-4883-b9ae-99941d5d9fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:47.963092 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b07fd0-8d37-4883-b9ae-99941d5d9fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:47.982434 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-26b07fd0-8d37-4883-b9ae-99941d5d9fc1 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:47.983799 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-26b07fd0-8d37-4883-b9ae-99941d5d9fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:48.038280 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6134f3c-8868-4c38-a554-c1d4527630f2 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:48.040238 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f6134f3c-8868-4c38-a554-c1d4527630f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:48.056128 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:48.106652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1006/1998] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:48.120599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b07fd0-8d37-4883-b9ae-99941d5d9fc1 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:48.122834 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-26b07fd0-8d37-4883-b9ae-99941d5d9fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:48.128260 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:48.145524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6134f3c-8868-4c38-a554-c1d4527630f2 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:48.152301 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ecc0e-dcc6-4176-86a3-6f045c89cf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:48.153255 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ecc0e-dcc6-4176-86a3-6f045c89cf14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:48.153541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ecc0e-dcc6-4176-86a3-6f045c89cf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:48.153887 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ecc0e-dcc6-4176-86a3-6f045c89cf14 admin admin] PATH_INFO: `/v3/projects/b1eeb21cdfe24ee88429cf67adb682c0` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:48.155461 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ecc0e-dcc6-4176-86a3-6f045c89cf14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1eeb21cdfe24ee88429cf67adb682c0)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:48.158444 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ecc0e-dcc6-4176-86a3-6f045c89cf14 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:48.193185 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b07fd0-8d37-4883-b9ae-99941d5d9fc1 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:48.197046 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da92f8-5732-4918-8456-f0be13a33780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:48.197851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da92f8-5732-4918-8456-f0be13a33780 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:48.198141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da92f8-5732-4918-8456-f0be13a33780 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:48.198489 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da92f8-5732-4918-8456-f0be13a33780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:48.211955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da92f8-5732-4918-8456-f0be13a33780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:48.213337 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da92f8-5732-4918-8456-f0be13a33780 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:48.217502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c37ecc0e-dcc6-4176-86a3-6f045c89cf14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1eeb21cdfe24ee88429cf67adb682c0', 'request_id': 'req-c37ecc0e-dcc6-4176-86a3-6f045c89cf14'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:48.226394 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1007/1999] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:39:48.227833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c37ecc0e-dcc6-4176-86a3-6f045c89cf14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1eeb21cdfe24ee88429cf67adb682c0', 'request_id': 'req-c37ecc0e-dcc6-4176-86a3-6f045c89cf14'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:48.235751 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c37ecc0e-dcc6-4176-86a3-6f045c89cf14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1eeb21cdfe24ee88429cf67adb682c0', 'request_id': 'req-c37ecc0e-dcc6-4176-86a3-6f045c89cf14'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:48.246619 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c37ecc0e-dcc6-4176-86a3-6f045c89cf14 admin admin] The token cache is being invalidate because project b1eeb21cdfe24ee88429cf67adb682c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:48.246906 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c37ecc0e-dcc6-4176-86a3-6f045c89cf14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:48.249832 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c37ecc0e-dcc6-4176-86a3-6f045c89cf14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:48.257360 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 993/2000] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:48 2022] DELETE /identity/v3/projects/b1eeb21cdfe24ee88429cf67adb682c0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:48.257572 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2632f-645a-41c9-81a1-b53386ff84af None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:48.257572 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2632f-645a-41c9-81a1-b53386ff84af None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:48.257754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2632f-645a-41c9-81a1-b53386ff84af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:48.290535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-53b2632f-645a-41c9-81a1-b53386ff84af None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:48.291865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-53b2632f-645a-41c9-81a1-b53386ff84af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:48.382274 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1008/2001] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:48.387743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a04627-c471-4fe6-b734-fd9cd4389a0e None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:48.388569 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a04627-c471-4fe6-b734-fd9cd4389a0e None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:48.389007 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a04627-c471-4fe6-b734-fd9cd4389a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:48.416958 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-f1a04627-c471-4fe6-b734-fd9cd4389a0e None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:48.418173 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f1a04627-c471-4fe6-b734-fd9cd4389a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:48.426113 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 994/2002] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:48.430319 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2632f-645a-41c9-81a1-b53386ff84af None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:48.440529 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2632f-645a-41c9-81a1-b53386ff84af None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:48.445392 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2003d-54cf-4fad-a05f-4de8a969dd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:48.449173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2003d-54cf-4fad-a05f-4de8a969dd41 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:48.449475 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2003d-54cf-4fad-a05f-4de8a969dd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:48.449762 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2003d-54cf-4fad-a05f-4de8a969dd41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:48.450538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2003d-54cf-4fad-a05f-4de8a969dd41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:39:48.450854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2003d-54cf-4fad-a05f-4de8a969dd41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:48.452543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2003d-54cf-4fad-a05f-4de8a969dd41 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:48.467320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1009/2003] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:39:48.469054 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a04627-c471-4fe6-b734-fd9cd4389a0e None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:48.479240 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a04627-c471-4fe6-b734-fd9cd4389a0e None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:48.483981 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a74d4-07c5-4f19-8372-2be9d3af4c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:48.484639 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a74d4-07c5-4f19-8372-2be9d3af4c94 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:48.484919 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a74d4-07c5-4f19-8372-2be9d3af4c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:48.485191 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a74d4-07c5-4f19-8372-2be9d3af4c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:48.486511 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a74d4-07c5-4f19-8372-2be9d3af4c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:48.488496 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a74d4-07c5-4f19-8372-2be9d3af4c94 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:48.514628 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 995/2004] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:48 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:48.518899 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2003d-54cf-4fad-a05f-4de8a969dd41 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:48.529807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a74d4-07c5-4f19-8372-2be9d3af4c94 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:48.532159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2003d-54cf-4fad-a05f-4de8a969dd41 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:48.533179 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-1a1a74d4-07c5-4f19-8372-2be9d3af4c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:48.607937 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad63184-6ad0-405b-9a51-16bd7453d42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:48.608712 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad63184-6ad0-405b-9a51-16bd7453d42d admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:48.609139 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad63184-6ad0-405b-9a51-16bd7453d42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:48.609594 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad63184-6ad0-405b-9a51-16bd7453d42d admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:48.618661 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad63184-6ad0-405b-9a51-16bd7453d42d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:48.618661 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad63184-6ad0-405b-9a51-16bd7453d42d admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:48.618906 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a74d4-07c5-4f19-8372-2be9d3af4c94 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:48.627216 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374fbae-4f7b-4472-aed3-e4c7dc2b877a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:48.628196 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374fbae-4f7b-4472-aed3-e4c7dc2b877a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:48.628554 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374fbae-4f7b-4472-aed3-e4c7dc2b877a admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:48.628898 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374fbae-4f7b-4472-aed3-e4c7dc2b877a admin admin] PATH_INFO: `/v3/projects/66e188d840e24e009a6b8ebaa7f872a6` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:48.630486 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374fbae-4f7b-4472-aed3-e4c7dc2b877a admin admin] RBAC: Authorizing `identity:delete_project(project_id=66e188d840e24e009a6b8ebaa7f872a6)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:48.632645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374fbae-4f7b-4472-aed3-e4c7dc2b877a admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:48.643998 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1010/2005] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:48 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:39:48.648004 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad63184-6ad0-405b-9a51-16bd7453d42d admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:48.650695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:48.659677 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad63184-6ad0-405b-9a51-16bd7453d42d admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:48.665710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e86d6-15e6-4b0e-950b-5a872967f0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:48.666615 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e86d6-15e6-4b0e-950b-5a872967f0cd admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:48.667376 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e86d6-15e6-4b0e-950b-5a872967f0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:48.668104 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e86d6-15e6-4b0e-950b-5a872967f0cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:48.669283 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e86d6-15e6-4b0e-950b-5a872967f0cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:48.673312 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e86d6-15e6-4b0e-950b-5a872967f0cd admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:48.686159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1011/2006] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:48.691621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e86d6-15e6-4b0e-950b-5a872967f0cd admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:48.703029 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-6374fbae-4f7b-4472-aed3-e4c7dc2b877a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66e188d840e24e009a6b8ebaa7f872a6', 'request_id': 'req-6374fbae-4f7b-4472-aed3-e4c7dc2b877a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:48.709457 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e86d6-15e6-4b0e-950b-5a872967f0cd admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:48.723722 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-6374fbae-4f7b-4472-aed3-e4c7dc2b877a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66e188d840e24e009a6b8ebaa7f872a6', 'request_id': 'req-6374fbae-4f7b-4472-aed3-e4c7dc2b877a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:48.726289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:48.732147 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-6374fbae-4f7b-4472-aed3-e4c7dc2b877a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66e188d840e24e009a6b8ebaa7f872a6', 'request_id': 'req-6374fbae-4f7b-4472-aed3-e4c7dc2b877a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:48.748878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-6374fbae-4f7b-4472-aed3-e4c7dc2b877a admin admin] The token cache is being invalidate because project 66e188d840e24e009a6b8ebaa7f872a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:48.749391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-6374fbae-4f7b-4472-aed3-e4c7dc2b877a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:48.750441 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-6374fbae-4f7b-4472-aed3-e4c7dc2b877a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:48.752889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 996/2007] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:48 2022] DELETE /identity/v3/projects/66e188d840e24e009a6b8ebaa7f872a6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:48.756592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374fbae-4f7b-4472-aed3-e4c7dc2b877a admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:48.757966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-6374fbae-4f7b-4472-aed3-e4c7dc2b877a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:48.792848 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30733130-c6a0-4ff2-94a5-e2c8a707555a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:48.793773 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30733130-c6a0-4ff2-94a5-e2c8a707555a admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:48.794055 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30733130-c6a0-4ff2-94a5-e2c8a707555a admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:48.794358 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30733130-c6a0-4ff2-94a5-e2c8a707555a admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:48.795094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30733130-c6a0-4ff2-94a5-e2c8a707555a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:48.800973 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30733130-c6a0-4ff2-94a5-e2c8a707555a admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:48.815182 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1012/2008] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:48.819301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30733130-c6a0-4ff2-94a5-e2c8a707555a admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:48.821362 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-30733130-c6a0-4ff2-94a5-e2c8a707555a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:48.842512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30733130-c6a0-4ff2-94a5-e2c8a707555a admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:48.844511 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374fbae-4f7b-4472-aed3-e4c7dc2b877a admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:48.850125 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb6bd6-c6d4-4747-8440-aa12c426fe79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:48.851036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb6bd6-c6d4-4747-8440-aa12c426fe79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:48.851355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb6bd6-c6d4-4747-8440-aa12c426fe79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:48.851785 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb6bd6-c6d4-4747-8440-aa12c426fe79 admin admin] PATH_INFO: `/v3/projects/d73362b239f84ce0bb784f4891f49002/users/d7f0ee99256e4f0f93478c77896bbe21/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:48.861156 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80295dfd-2576-477a-9128-047555300f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:48.864660 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80295dfd-2576-477a-9128-047555300f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:48.866418 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80295dfd-2576-477a-9128-047555300f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:48.866637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80295dfd-2576-477a-9128-047555300f92 admin admin] PATH_INFO: `/v3/users/4e2ca74264124e33adcc5311b9f33a46` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:48.868587 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80295dfd-2576-477a-9128-047555300f92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e2ca74264124e33adcc5311b9f33a46)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:48.870559 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80295dfd-2576-477a-9128-047555300f92 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:48.872357 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb6bd6-c6d4-4747-8440-aa12c426fe79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73362b239f84ce0bb784f4891f49002, user_id=d7f0ee99256e4f0f93478c77896bbe21, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:48.875366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb6bd6-c6d4-4747-8440-aa12c426fe79 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:48.889199 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1013/2009] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:48 2022] PUT /identity/v3/projects/d73362b239f84ce0bb784f4891f49002/users/d7f0ee99256e4f0f93478c77896bbe21/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:39:48.899960 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c122360-80e7-41a7-aaae-016d45dbd333 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:48.900325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c122360-80e7-41a7-aaae-016d45dbd333 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:48.900738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c122360-80e7-41a7-aaae-016d45dbd333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:48.929451 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-5c122360-80e7-41a7-aaae-016d45dbd333 None None] MFA Rules not processed for user `d7f0ee99256e4f0f93478c77896bbe21`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:48.930094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-80295dfd-2576-477a-9128-047555300f92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e2ca74264124e33adcc5311b9f33a46'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:48.930575 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-5c122360-80e7-41a7-aaae-016d45dbd333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:48.937248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-80295dfd-2576-477a-9128-047555300f92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e2ca74264124e33adcc5311b9f33a46'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:48.937920 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-80295dfd-2576-477a-9128-047555300f92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e2ca74264124e33adcc5311b9f33a46'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:48.951115 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-80295dfd-2576-477a-9128-047555300f92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e2ca74264124e33adcc5311b9f33a46'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:48.959817 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-80295dfd-2576-477a-9128-047555300f92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e2ca74264124e33adcc5311b9f33a46'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:48.966026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 997/2010] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:48 2022] DELETE /identity/v3/users/4e2ca74264124e33adcc5311b9f33a46 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:48.997056 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1014/2011] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:49.001579 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80295dfd-2576-477a-9128-047555300f92 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:49.003073 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-80295dfd-2576-477a-9128-047555300f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:49.027006 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:49.095694 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80295dfd-2576-477a-9128-047555300f92 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:49.100717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe2575-8f7c-44d0-be82-729f06b744e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:49.101387 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe2575-8f7c-44d0-be82-729f06b744e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:49.101667 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe2575-8f7c-44d0-be82-729f06b744e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:49.101940 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe2575-8f7c-44d0-be82-729f06b744e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:49.102647 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe2575-8f7c-44d0-be82-729f06b744e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:49.104670 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe2575-8f7c-44d0-be82-729f06b744e9 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:49.146155 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 998/2012] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:49 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:49.146825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c122360-80e7-41a7-aaae-016d45dbd333 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:49.253624 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c122360-80e7-41a7-aaae-016d45dbd333 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:49.286172 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:49.305257 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe2575-8f7c-44d0-be82-729f06b744e9 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:49.309186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-1dbe2575-8f7c-44d0-be82-729f06b744e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:49.365997 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b6a6a-11b6-42ad-9ea8-d3f8b30f4db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:49.366955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b6a6a-11b6-42ad-9ea8-d3f8b30f4db2 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:49.367365 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b6a6a-11b6-42ad-9ea8-d3f8b30f4db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:49.367699 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b6a6a-11b6-42ad-9ea8-d3f8b30f4db2 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:49.368598 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b6a6a-11b6-42ad-9ea8-d3f8b30f4db2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:49.371957 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b6a6a-11b6-42ad-9ea8-d3f8b30f4db2 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:49.394337 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe2575-8f7c-44d0-be82-729f06b744e9 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:49.396757 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1015/2013] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:49 2022] POST /identity/v3/users => generated 290 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:39:49.399693 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3f6b4-f5e9-49ca-ae61-99d4e3efd94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:49.400404 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b6a6a-11b6-42ad-9ea8-d3f8b30f4db2 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:49.400711 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3f6b4-f5e9-49ca-ae61-99d4e3efd94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:49.401002 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3f6b4-f5e9-49ca-ae61-99d4e3efd94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:49.401293 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3f6b4-f5e9-49ca-ae61-99d4e3efd94b admin admin] PATH_INFO: `/v3/projects/87a3c97fd889483e92ae638c69104cc1` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:49.402516 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3f6b4-f5e9-49ca-ae61-99d4e3efd94b admin admin] RBAC: Authorizing `identity:delete_project(project_id=87a3c97fd889483e92ae638c69104cc1)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:49.404573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3f6b4-f5e9-49ca-ae61-99d4e3efd94b admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:49.414226 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b6a6a-11b6-42ad-9ea8-d3f8b30f4db2 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:49.419679 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ac2b4-cd13-419b-a530-7bc813e03434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:49.420653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ac2b4-cd13-419b-a530-7bc813e03434 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:49.420957 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ac2b4-cd13-419b-a530-7bc813e03434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:49.421323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ac2b4-cd13-419b-a530-7bc813e03434 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:49.422147 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ac2b4-cd13-419b-a530-7bc813e03434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:49.424468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ac2b4-cd13-419b-a530-7bc813e03434 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:49.436518 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1016/2014] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:49.441272 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ac2b4-cd13-419b-a530-7bc813e03434 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:49.451863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ac2b4-cd13-419b-a530-7bc813e03434 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:49.460910 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f1d3f6b4-f5e9-49ca-ae61-99d4e3efd94b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87a3c97fd889483e92ae638c69104cc1', 'request_id': 'req-f1d3f6b4-f5e9-49ca-ae61-99d4e3efd94b'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:49.469378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f1d3f6b4-f5e9-49ca-ae61-99d4e3efd94b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87a3c97fd889483e92ae638c69104cc1', 'request_id': 'req-f1d3f6b4-f5e9-49ca-ae61-99d4e3efd94b'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:49.479310 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f1d3f6b4-f5e9-49ca-ae61-99d4e3efd94b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87a3c97fd889483e92ae638c69104cc1', 'request_id': 'req-f1d3f6b4-f5e9-49ca-ae61-99d4e3efd94b'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:49.491688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f1d3f6b4-f5e9-49ca-ae61-99d4e3efd94b admin admin] The token cache is being invalidate because project 87a3c97fd889483e92ae638c69104cc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:49.492115 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f1d3f6b4-f5e9-49ca-ae61-99d4e3efd94b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:49.492879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f1d3f6b4-f5e9-49ca-ae61-99d4e3efd94b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:49.494832 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 999/2015] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:49 2022] DELETE /identity/v3/projects/87a3c97fd889483e92ae638c69104cc1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:49.499606 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82389b89-cec5-4a78-9a93-03c0f12d263d None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:49.500008 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82389b89-cec5-4a78-9a93-03c0f12d263d None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:49.500399 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82389b89-cec5-4a78-9a93-03c0f12d263d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:49.520295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-82389b89-cec5-4a78-9a93-03c0f12d263d None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:49.521680 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-82389b89-cec5-4a78-9a93-03c0f12d263d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:49.525111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b38c5-b79f-4564-8c12-d90b41351dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:49.525911 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b38c5-b79f-4564-8c12-d90b41351dfb admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:49.526584 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b38c5-b79f-4564-8c12-d90b41351dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:49.526584 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b38c5-b79f-4564-8c12-d90b41351dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:49.527220 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b38c5-b79f-4564-8c12-d90b41351dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:49.528835 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b38c5-b79f-4564-8c12-d90b41351dfb admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:49.535806 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1000/2016] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:49.539243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3479667-d03e-4db1-820f-cb39bef479ec None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:49.539555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3479667-d03e-4db1-820f-cb39bef479ec None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:49.539828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3479667-d03e-4db1-820f-cb39bef479ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:49.545669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1017/2017] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:49.547267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b38c5-b79f-4564-8c12-d90b41351dfb admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:49.550212 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-839b38c5-b79f-4564-8c12-d90b41351dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:49.563127 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-d3479667-d03e-4db1-820f-cb39bef479ec None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:49.564372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-d3479667-d03e-4db1-820f-cb39bef479ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:49.567577 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b38c5-b79f-4564-8c12-d90b41351dfb admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:49.572195 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef1952-3e0d-4aba-85f4-549732a13e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:49.572642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1001/2018] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:49.573158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef1952-3e0d-4aba-85f4-549732a13e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:49.573514 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef1952-3e0d-4aba-85f4-549732a13e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:49.573804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef1952-3e0d-4aba-85f4-549732a13e99 admin admin] PATH_INFO: `/v3/projects/20596f5049774f8fb15f5801891efec8/users/90a598ddf22f4fe9a75f42d4b3b879cc/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:49.576702 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3479667-d03e-4db1-820f-cb39bef479ec None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:49.586320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3479667-d03e-4db1-820f-cb39bef479ec None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:49.591401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef1952-3e0d-4aba-85f4-549732a13e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20596f5049774f8fb15f5801891efec8, user_id=90a598ddf22f4fe9a75f42d4b3b879cc, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:49.591555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c6bac-a524-4e2e-9e5a-03c6bf1193d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:49.592109 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c6bac-a524-4e2e-9e5a-03c6bf1193d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:49.592396 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c6bac-a524-4e2e-9e5a-03c6bf1193d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:49.592677 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c6bac-a524-4e2e-9e5a-03c6bf1193d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:49.593410 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c6bac-a524-4e2e-9e5a-03c6bf1193d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:39:49.593717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c6bac-a524-4e2e-9e5a-03c6bf1193d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:49.594128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef1952-3e0d-4aba-85f4-549732a13e99 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:49.595925 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c6bac-a524-4e2e-9e5a-03c6bf1193d1 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:49.612386 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1002/2019] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:39:49.612585 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1018/2020] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:49 2022] PUT /identity/v3/projects/20596f5049774f8fb15f5801891efec8/users/90a598ddf22f4fe9a75f42d4b3b879cc/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:49.616419 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c6bac-a524-4e2e-9e5a-03c6bf1193d1 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:49.619684 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a306c2-a375-4d4f-bd01-3afea7f1758d None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:49.620156 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a306c2-a375-4d4f-bd01-3afea7f1758d None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:49.620490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a306c2-a375-4d4f-bd01-3afea7f1758d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:49.627344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c6bac-a524-4e2e-9e5a-03c6bf1193d1 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:49.632477 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:49.650728 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-85a306c2-a375-4d4f-bd01-3afea7f1758d None None] MFA Rules not processed for user `90a598ddf22f4fe9a75f42d4b3b879cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:49.651965 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-85a306c2-a375-4d4f-bd01-3afea7f1758d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:49.699915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b60555-e3b5-4365-8c65-075e72fb873f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:49.700507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b60555-e3b5-4365-8c65-075e72fb873f admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:49.700870 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b60555-e3b5-4365-8c65-075e72fb873f admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:49.701151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b60555-e3b5-4365-8c65-075e72fb873f admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:49.701874 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b60555-e3b5-4365-8c65-075e72fb873f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:49.703787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b60555-e3b5-4365-8c65-075e72fb873f admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:49.724342 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:49.735472 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1003/2021] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:49 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:39:49.736268 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b60555-e3b5-4365-8c65-075e72fb873f admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:49.739229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1019/2022] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:49.743322 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a306c2-a375-4d4f-bd01-3afea7f1758d None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:49.756902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a306c2-a375-4d4f-bd01-3afea7f1758d None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:49.819099 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b60555-e3b5-4365-8c65-075e72fb873f admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:49.825980 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b47028-e0d4-4a31-8d5a-e56a99f62748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:49.827085 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b47028-e0d4-4a31-8d5a-e56a99f62748 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:49.827563 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b47028-e0d4-4a31-8d5a-e56a99f62748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:49.827860 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b47028-e0d4-4a31-8d5a-e56a99f62748 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:49.828143 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdee115-d426-4b9e-9e6b-966de38bf457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:49.828567 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b47028-e0d4-4a31-8d5a-e56a99f62748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:49.828826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdee115-d426-4b9e-9e6b-966de38bf457 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:49.829643 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdee115-d426-4b9e-9e6b-966de38bf457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:49.829930 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdee115-d426-4b9e-9e6b-966de38bf457 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:49.830629 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdee115-d426-4b9e-9e6b-966de38bf457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:49.831029 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b47028-e0d4-4a31-8d5a-e56a99f62748 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:49.833939 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdee115-d426-4b9e-9e6b-966de38bf457 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:49.859092 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1004/2023] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:49 2022] POST /identity/v3/users => generated 284 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:39:49.860465 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b47028-e0d4-4a31-8d5a-e56a99f62748 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:49.866559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1020/2024] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:49 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:39:49.870940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdee115-d426-4b9e-9e6b-966de38bf457 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:49.874750 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b47028-e0d4-4a31-8d5a-e56a99f62748 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:49.947910 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdee115-d426-4b9e-9e6b-966de38bf457 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:49.948105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e565875-29a7-4ae4-8b48-9e79830b0316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:49.948800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e565875-29a7-4ae4-8b48-9e79830b0316 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:49.949253 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e565875-29a7-4ae4-8b48-9e79830b0316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:49.949589 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e565875-29a7-4ae4-8b48-9e79830b0316 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:49.950547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e565875-29a7-4ae4-8b48-9e79830b0316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:49.955463 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e565875-29a7-4ae4-8b48-9e79830b0316 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:49.958922 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9c573-09e9-4b5a-a000-206474544202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:49.959925 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9c573-09e9-4b5a-a000-206474544202 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:49.960329 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9c573-09e9-4b5a-a000-206474544202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:49.960835 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9c573-09e9-4b5a-a000-206474544202 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:49.961669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9c573-09e9-4b5a-a000-206474544202 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:49.963720 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9c573-09e9-4b5a-a000-206474544202 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:49.967449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1005/2025] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:49.971018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e565875-29a7-4ae4-8b48-9e79830b0316 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:49.984162 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e565875-29a7-4ae4-8b48-9e79830b0316 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:49.994045 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df311716-94db-410a-9c82-06518df14e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:49.994962 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df311716-94db-410a-9c82-06518df14e49 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:49.995467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df311716-94db-410a-9c82-06518df14e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:49.995849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df311716-94db-410a-9c82-06518df14e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:49.996984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df311716-94db-410a-9c82-06518df14e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:49.999088 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df311716-94db-410a-9c82-06518df14e49 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:50.003359 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1021/2026] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:49 2022] POST /identity/v3/users => generated 295 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:39:50.004291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9c573-09e9-4b5a-a000-206474544202 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:50.013311 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1006/2027] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:39:50.017993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9c573-09e9-4b5a-a000-206474544202 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:50.018418 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df311716-94db-410a-9c82-06518df14e49 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:50.022774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e556c-5c07-47d4-be9c-25e0404153be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:50.023475 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e556c-5c07-47d4-be9c-25e0404153be admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:50.023759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e556c-5c07-47d4-be9c-25e0404153be admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:50.024031 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e556c-5c07-47d4-be9c-25e0404153be admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:50.024775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e556c-5c07-47d4-be9c-25e0404153be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:50.026349 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e556c-5c07-47d4-be9c-25e0404153be admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:50.029792 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df311716-94db-410a-9c82-06518df14e49 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:50.035072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdccaa-1941-4de2-a1db-1a50a5d42243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:50.036029 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdccaa-1941-4de2-a1db-1a50a5d42243 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:50.036294 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdccaa-1941-4de2-a1db-1a50a5d42243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:50.036572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdccaa-1941-4de2-a1db-1a50a5d42243 admin admin] PATH_INFO: `/v3/projects/42646af387cd45c39089f7a1ae32f668/users/3abd8721ca704f55a600e27c711a751d/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:50.049398 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1022/2028] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:39:50.050097 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:50.050743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e556c-5c07-47d4-be9c-25e0404153be admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:50.059971 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdccaa-1941-4de2-a1db-1a50a5d42243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42646af387cd45c39089f7a1ae32f668, user_id=3abd8721ca704f55a600e27c711a751d, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:50.060852 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e556c-5c07-47d4-be9c-25e0404153be admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:50.062843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdccaa-1941-4de2-a1db-1a50a5d42243 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:50.066003 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d7b72-4831-4532-b196-dc4899cc49c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:50.066901 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d7b72-4831-4532-b196-dc4899cc49c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:50.067189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d7b72-4831-4532-b196-dc4899cc49c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:50.067502 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d7b72-4831-4532-b196-dc4899cc49c4 admin admin] PATH_INFO: `/v3/projects/32c7cf0810ac49a7837a8e297cfe8932/users/a489bde5b73a46249ad0718554e4bcc0/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:50.085215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1007/2029] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:50 2022] PUT /identity/v3/projects/42646af387cd45c39089f7a1ae32f668/users/3abd8721ca704f55a600e27c711a751d/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:50.088482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d7b72-4831-4532-b196-dc4899cc49c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c7cf0810ac49a7837a8e297cfe8932, user_id=a489bde5b73a46249ad0718554e4bcc0, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:50.091321 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d7b72-4831-4532-b196-dc4899cc49c4 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:50.099390 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816da46-b02c-4d39-a850-2e3b017e5a0a None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:50.099595 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816da46-b02c-4d39-a850-2e3b017e5a0a None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:50.099866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816da46-b02c-4d39-a850-2e3b017e5a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:50.110647 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1023/2030] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:50 2022] PUT /identity/v3/projects/32c7cf0810ac49a7837a8e297cfe8932/users/a489bde5b73a46249ad0718554e4bcc0/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:50.112916 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d7b72-4831-4532-b196-dc4899cc49c4 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:50.137816 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-4816da46-b02c-4d39-a850-2e3b017e5a0a None None] MFA Rules not processed for user `3abd8721ca704f55a600e27c711a751d`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:50.139572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-4816da46-b02c-4d39-a850-2e3b017e5a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:50.164376 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:50.194975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d7b72-4831-4532-b196-dc4899cc49c4 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:50.200349 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc214b58-3d7f-499f-850d-cd700a52212b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:50.200975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc214b58-3d7f-499f-850d-cd700a52212b admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:50.201263 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc214b58-3d7f-499f-850d-cd700a52212b admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:50.201538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc214b58-3d7f-499f-850d-cd700a52212b admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:50.202266 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc214b58-3d7f-499f-850d-cd700a52212b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:50.203915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc214b58-3d7f-499f-850d-cd700a52212b admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:50.215232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1024/2031] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:39:50.219506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc214b58-3d7f-499f-850d-cd700a52212b admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:50.228686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1008/2032] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:50.234542 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816da46-b02c-4d39-a850-2e3b017e5a0a None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:50.237570 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc214b58-3d7f-499f-850d-cd700a52212b admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:50.242647 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef4784-315b-4e5b-8328-cc1aaf906a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:50.243732 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef4784-315b-4e5b-8328-cc1aaf906a32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:50.244019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef4784-315b-4e5b-8328-cc1aaf906a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:50.244409 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef4784-315b-4e5b-8328-cc1aaf906a32 admin admin] PATH_INFO: `/v3/projects/32c7cf0810ac49a7837a8e297cfe8932/users/a489bde5b73a46249ad0718554e4bcc0/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:50.246413 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef4784-315b-4e5b-8328-cc1aaf906a32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c7cf0810ac49a7837a8e297cfe8932, user_id=a489bde5b73a46249ad0718554e4bcc0, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:50.249968 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816da46-b02c-4d39-a850-2e3b017e5a0a None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:50.255616 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef4784-315b-4e5b-8328-cc1aaf906a32 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:50.256014 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9e24e-7eb3-4f2a-881f-da7217005d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:50.256864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9e24e-7eb3-4f2a-881f-da7217005d31 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:50.257159 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9e24e-7eb3-4f2a-881f-da7217005d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:50.257433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9e24e-7eb3-4f2a-881f-da7217005d31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:50.258241 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9e24e-7eb3-4f2a-881f-da7217005d31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:50.260452 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9e24e-7eb3-4f2a-881f-da7217005d31 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:50.277544 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1025/2033] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:50 2022] PUT /identity/v3/projects/32c7cf0810ac49a7837a8e297cfe8932/users/a489bde5b73a46249ad0718554e4bcc0/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:39:50.293189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fc76b-8e40-4955-ab80-55dab9786f22 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:50.293479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fc76b-8e40-4955-ab80-55dab9786f22 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:50.293849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fc76b-8e40-4955-ab80-55dab9786f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:50.307454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1009/2034] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:50 2022] POST /identity/v3/projects => generated 367 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:50.311646 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9e24e-7eb3-4f2a-881f-da7217005d31 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:50.332043 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-999fc76b-8e40-4955-ab80-55dab9786f22 None None] MFA Rules not processed for user `a489bde5b73a46249ad0718554e4bcc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:50.334403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-999fc76b-8e40-4955-ab80-55dab9786f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:50.390756 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9e24e-7eb3-4f2a-881f-da7217005d31 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:50.398819 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648acbf-bafd-4b0f-90c4-33263ab6e1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:50.399712 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648acbf-bafd-4b0f-90c4-33263ab6e1da admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:50.400001 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648acbf-bafd-4b0f-90c4-33263ab6e1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:50.400279 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648acbf-bafd-4b0f-90c4-33263ab6e1da admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:50.401168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648acbf-bafd-4b0f-90c4-33263ab6e1da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:50.403366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648acbf-bafd-4b0f-90c4-33263ab6e1da admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:50.431500 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1010/2035] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:50 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:39:50.435264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648acbf-bafd-4b0f-90c4-33263ab6e1da admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:50.447928 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648acbf-bafd-4b0f-90c4-33263ab6e1da admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:50.450580 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1026/2036] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:50.453463 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e2b33-f42e-4500-9edf-4af3327440ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:50.455457 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e2b33-f42e-4500-9edf-4af3327440ac admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:50.455833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e2b33-f42e-4500-9edf-4af3327440ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:50.456187 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e2b33-f42e-4500-9edf-4af3327440ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:50.457091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e2b33-f42e-4500-9edf-4af3327440ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:50.458847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e2b33-f42e-4500-9edf-4af3327440ac admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:50.464046 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fc76b-8e40-4955-ab80-55dab9786f22 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:50.465751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-999fc76b-8e40-4955-ab80-55dab9786f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:50.471538 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1011/2037] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:50.476068 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e2b33-f42e-4500-9edf-4af3327440ac admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:50.486091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e2b33-f42e-4500-9edf-4af3327440ac admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:50.491634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7f0c4-74c6-4766-b5ca-4662b5d73146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:50.493044 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7f0c4-74c6-4766-b5ca-4662b5d73146 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:50.493428 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7f0c4-74c6-4766-b5ca-4662b5d73146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:50.494090 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7f0c4-74c6-4766-b5ca-4662b5d73146 admin admin] PATH_INFO: `/v3/projects/c6ce13c8513946708dc3c9a618592b1a/users/26ec883d251941dda165cd2d044c3aae/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:50.517574 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7f0c4-74c6-4766-b5ca-4662b5d73146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ce13c8513946708dc3c9a618592b1a, user_id=26ec883d251941dda165cd2d044c3aae, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:50.520297 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7f0c4-74c6-4766-b5ca-4662b5d73146 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:50.539590 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1012/2038] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:50 2022] PUT /identity/v3/projects/c6ce13c8513946708dc3c9a618592b1a/users/26ec883d251941dda165cd2d044c3aae/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:50.539748 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fc76b-8e40-4955-ab80-55dab9786f22 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:50.541364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7f0c4-74c6-4766-b5ca-4662b5d73146 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:50.552557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:50.617046 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfc9dd-fc27-4191-b4b6-a4ae775c29a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:50.619958 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfc9dd-fc27-4191-b4b6-a4ae775c29a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:50.620248 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfc9dd-fc27-4191-b4b6-a4ae775c29a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:50.620528 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfc9dd-fc27-4191-b4b6-a4ae775c29a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:50.633854 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7f0c4-74c6-4766-b5ca-4662b5d73146 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:50.638627 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f915a0-02ea-47bd-bbb7-f96d3be04f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:50.639453 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f915a0-02ea-47bd-bbb7-f96d3be04f18 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:50.639809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f915a0-02ea-47bd-bbb7-f96d3be04f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:50.640152 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f915a0-02ea-47bd-bbb7-f96d3be04f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:50.640940 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f915a0-02ea-47bd-bbb7-f96d3be04f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:50.643153 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f915a0-02ea-47bd-bbb7-f96d3be04f18 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:50.644339 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:50.658006 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1013/2039] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:39:50.659121 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f915a0-02ea-47bd-bbb7-f96d3be04f18 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:50.677129 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f915a0-02ea-47bd-bbb7-f96d3be04f18 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:50.689312 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df40382-21d0-4414-9a99-32df0872df98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:50.690224 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df40382-21d0-4414-9a99-32df0872df98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:50.690506 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df40382-21d0-4414-9a99-32df0872df98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:50.690789 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df40382-21d0-4414-9a99-32df0872df98 admin admin] PATH_INFO: `/v3/projects/c6ce13c8513946708dc3c9a618592b1a/users/26ec883d251941dda165cd2d044c3aae/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:50.695717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df40382-21d0-4414-9a99-32df0872df98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ce13c8513946708dc3c9a618592b1a, user_id=26ec883d251941dda165cd2d044c3aae, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:50.701222 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df40382-21d0-4414-9a99-32df0872df98 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:50.725825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1014/2040] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:50 2022] PUT /identity/v3/projects/c6ce13c8513946708dc3c9a618592b1a/users/26ec883d251941dda165cd2d044c3aae/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:50.728864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61898a69-58f1-4491-80e4-ee4f4862d050 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:50.729163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61898a69-58f1-4491-80e4-ee4f4862d050 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:50.729469 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61898a69-58f1-4491-80e4-ee4f4862d050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:50.740303 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfc9dd-fc27-4191-b4b6-a4ae775c29a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:50.745168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfc9dd-fc27-4191-b4b6-a4ae775c29a0 service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:50.761551 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1027/2041] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:39:50.771935 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-61898a69-58f1-4491-80e4-ee4f4862d050 None None] MFA Rules not processed for user `26ec883d251941dda165cd2d044c3aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:50.773146 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-61898a69-58f1-4491-80e4-ee4f4862d050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:50.816214 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfc9dd-fc27-4191-b4b6-a4ae775c29a0 service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:50.827986 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfc9dd-fc27-4191-b4b6-a4ae775c29a0 service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:50.869875 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1015/2042] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:50.882882 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61898a69-58f1-4491-80e4-ee4f4862d050 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:50.884781 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-61898a69-58f1-4491-80e4-ee4f4862d050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:50.907571 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68f8fe-ee34-48b3-a90a-fea0ab03a3cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:50.908401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68f8fe-ee34-48b3-a90a-fea0ab03a3cd service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:50.908793 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68f8fe-ee34-48b3-a90a-fea0ab03a3cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:50.909174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68f8fe-ee34-48b3-a90a-fea0ab03a3cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:50.911218 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-fe68f8fe-ee34-48b3-a90a-fea0ab03a3cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:50.966935 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61898a69-58f1-4491-80e4-ee4f4862d050 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:50.971709 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9b50e-f5be-4d99-aadf-2f511bd5ce97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:50.972386 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9b50e-f5be-4d99-aadf-2f511bd5ce97 service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:50.972838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9b50e-f5be-4d99-aadf-2f511bd5ce97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:50.973369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9b50e-f5be-4d99-aadf-2f511bd5ce97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:50.987138 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9b50e-f5be-4d99-aadf-2f511bd5ce97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:50.988542 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9b50e-f5be-4d99-aadf-2f511bd5ce97 service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:50.995542 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68f8fe-ee34-48b3-a90a-fea0ab03a3cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:50.997741 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68f8fe-ee34-48b3-a90a-fea0ab03a3cd service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:51.001947 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1016/2043] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:50 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:39:51.009550 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1028/2044] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:39:51.098375 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9b50e-f5be-4d99-aadf-2f511bd5ce97 service cinder] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:51.107045 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9b50e-f5be-4d99-aadf-2f511bd5ce97 service cinder] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:51.111296 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd401306-299e-41d7-8eb1-0508ce827eee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:51.111979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd401306-299e-41d7-8eb1-0508ce827eee service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:51.112260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd401306-299e-41d7-8eb1-0508ce827eee service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:51.112531 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd401306-299e-41d7-8eb1-0508ce827eee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:51.128107 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:51.182150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd401306-299e-41d7-8eb1-0508ce827eee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:51.183974 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd401306-299e-41d7-8eb1-0508ce827eee service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:51.196418 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1017/2045] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:51 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:54.096551 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68f8fe-ee34-48b3-a90a-fea0ab03a3cd service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:54.222588 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68f8fe-ee34-48b3-a90a-fea0ab03a3cd service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:54.236710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c66e7-eb9e-4feb-9235-589ef2ce8be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:54.237618 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c66e7-eb9e-4feb-9235-589ef2ce8be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:54.237961 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c66e7-eb9e-4feb-9235-589ef2ce8be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:54.239452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c66e7-eb9e-4feb-9235-589ef2ce8be8 admin admin] PATH_INFO: `/v3/users/d7f0ee99256e4f0f93478c77896bbe21` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:54.241553 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c66e7-eb9e-4feb-9235-589ef2ce8be8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7f0ee99256e4f0f93478c77896bbe21)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:54.249860 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c66e7-eb9e-4feb-9235-589ef2ce8be8 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:54.264379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:54.324165 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-459c66e7-eb9e-4feb-9235-589ef2ce8be8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7f0ee99256e4f0f93478c77896bbe21'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:54.325094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-459c66e7-eb9e-4feb-9235-589ef2ce8be8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7f0ee99256e4f0f93478c77896bbe21'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:54.334265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-459c66e7-eb9e-4feb-9235-589ef2ce8be8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7f0ee99256e4f0f93478c77896bbe21'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:54.335060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-459c66e7-eb9e-4feb-9235-589ef2ce8be8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7f0ee99256e4f0f93478c77896bbe21'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:54.359764 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-459c66e7-eb9e-4feb-9235-589ef2ce8be8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7f0ee99256e4f0f93478c77896bbe21'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:54.384221 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1029/2046] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:54 2022] DELETE /identity/v3/users/d7f0ee99256e4f0f93478c77896bbe21 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:54.388984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3b49a-89ff-41ff-9c07-d8dcad12377c None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:54.389637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3b49a-89ff-41ff-9c07-d8dcad12377c None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:54.389637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3b49a-89ff-41ff-9c07-d8dcad12377c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:54.424108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-fcb3b49a-89ff-41ff-9c07-d8dcad12377c None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:54.425986 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-fcb3b49a-89ff-41ff-9c07-d8dcad12377c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:54.545713 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1018/2047] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:54.556254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c66e7-eb9e-4feb-9235-589ef2ce8be8 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:54.557798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-459c66e7-eb9e-4feb-9235-589ef2ce8be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:54.632376 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c66e7-eb9e-4feb-9235-589ef2ce8be8 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:54.636294 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65589a56-5790-468f-a845-9285f3adce6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:54.636984 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65589a56-5790-468f-a845-9285f3adce6e service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:54.637202 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65589a56-5790-468f-a845-9285f3adce6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:54.637500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65589a56-5790-468f-a845-9285f3adce6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:54.648501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65589a56-5790-468f-a845-9285f3adce6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:54.650000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65589a56-5790-468f-a845-9285f3adce6e service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:54.660146 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1030/2048] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:55.285595 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3b49a-89ff-41ff-9c07-d8dcad12377c None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:55.289094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-fcb3b49a-89ff-41ff-9c07-d8dcad12377c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:55.318856 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3b49a-89ff-41ff-9c07-d8dcad12377c None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:55.333617 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f9a99-e8c8-4ecf-86c9-0202d4872c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:55.335866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f9a99-e8c8-4ecf-86c9-0202d4872c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:55.336184 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f9a99-e8c8-4ecf-86c9-0202d4872c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:55.336469 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f9a99-e8c8-4ecf-86c9-0202d4872c99 admin admin] PATH_INFO: `/v3/projects/d73362b239f84ce0bb784f4891f49002` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:55.337934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f9a99-e8c8-4ecf-86c9-0202d4872c99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d73362b239f84ce0bb784f4891f49002)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:55.340238 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f9a99-e8c8-4ecf-86c9-0202d4872c99 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:55.410326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-4b3f9a99-e8c8-4ecf-86c9-0202d4872c99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd73362b239f84ce0bb784f4891f49002', 'request_id': 'req-4b3f9a99-e8c8-4ecf-86c9-0202d4872c99'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:55.420784 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-4b3f9a99-e8c8-4ecf-86c9-0202d4872c99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd73362b239f84ce0bb784f4891f49002', 'request_id': 'req-4b3f9a99-e8c8-4ecf-86c9-0202d4872c99'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:55.433569 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-4b3f9a99-e8c8-4ecf-86c9-0202d4872c99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd73362b239f84ce0bb784f4891f49002', 'request_id': 'req-4b3f9a99-e8c8-4ecf-86c9-0202d4872c99'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:55.446492 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-4b3f9a99-e8c8-4ecf-86c9-0202d4872c99 admin admin] The token cache is being invalidate because project d73362b239f84ce0bb784f4891f49002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:55.446907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-4b3f9a99-e8c8-4ecf-86c9-0202d4872c99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:55.447827 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-4b3f9a99-e8c8-4ecf-86c9-0202d4872c99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:55.449418 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1019/2049] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:55 2022] DELETE /identity/v3/projects/d73362b239f84ce0bb784f4891f49002 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:55.453312 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65589a56-5790-468f-a845-9285f3adce6e service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:55.465905 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65589a56-5790-468f-a845-9285f3adce6e service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:55.618266 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9be55-7fdb-4ff5-9bfc-c98e27e9d123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:55.619263 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9be55-7fdb-4ff5-9bfc-c98e27e9d123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:55.619520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9be55-7fdb-4ff5-9bfc-c98e27e9d123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:55.619955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9be55-7fdb-4ff5-9bfc-c98e27e9d123 admin admin] PATH_INFO: `/v3/users/90a598ddf22f4fe9a75f42d4b3b879cc` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:55.621468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9be55-7fdb-4ff5-9bfc-c98e27e9d123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a598ddf22f4fe9a75f42d4b3b879cc)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:55.627490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9be55-7fdb-4ff5-9bfc-c98e27e9d123 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:55.689368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:55.704628 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0dc9be55-7fdb-4ff5-9bfc-c98e27e9d123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a598ddf22f4fe9a75f42d4b3b879cc'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:55.706115 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0dc9be55-7fdb-4ff5-9bfc-c98e27e9d123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a598ddf22f4fe9a75f42d4b3b879cc'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:55.715437 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0dc9be55-7fdb-4ff5-9bfc-c98e27e9d123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a598ddf22f4fe9a75f42d4b3b879cc'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:55.716861 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0dc9be55-7fdb-4ff5-9bfc-c98e27e9d123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a598ddf22f4fe9a75f42d4b3b879cc'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:55.740201 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0dc9be55-7fdb-4ff5-9bfc-c98e27e9d123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a598ddf22f4fe9a75f42d4b3b879cc'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:55.779476 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1031/2050] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:55 2022] DELETE /identity/v3/users/90a598ddf22f4fe9a75f42d4b3b879cc => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:56.560359 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f9a99-e8c8-4ecf-86c9-0202d4872c99 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:56.561867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-4b3f9a99-e8c8-4ecf-86c9-0202d4872c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:56.581510 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f9a99-e8c8-4ecf-86c9-0202d4872c99 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:56.658348 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:56.689354 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168f612-606c-4a7c-8794-f1d8b8051bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:56.690623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168f612-606c-4a7c-8794-f1d8b8051bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:56.691200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168f612-606c-4a7c-8794-f1d8b8051bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:56.691861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168f612-606c-4a7c-8794-f1d8b8051bb8 admin admin] PATH_INFO: `/v3/users/84cf88078dec4d9592d5d9d2ddd4d64f` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:56.693622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168f612-606c-4a7c-8794-f1d8b8051bb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84cf88078dec4d9592d5d9d2ddd4d64f)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:56.697229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168f612-606c-4a7c-8794-f1d8b8051bb8 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:56.703449 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9be55-7fdb-4ff5-9bfc-c98e27e9d123 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:56.705556 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-0dc9be55-7fdb-4ff5-9bfc-c98e27e9d123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:56.730586 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9be55-7fdb-4ff5-9bfc-c98e27e9d123 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:56.735754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5843a6c-2f5a-4da0-9caf-2a075ccaa0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:56.736742 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5843a6c-2f5a-4da0-9caf-2a075ccaa0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:56.736898 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5843a6c-2f5a-4da0-9caf-2a075ccaa0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:56.737540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5843a6c-2f5a-4da0-9caf-2a075ccaa0e3 admin admin] PATH_INFO: `/v3/projects/20596f5049774f8fb15f5801891efec8` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:56.738690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5843a6c-2f5a-4da0-9caf-2a075ccaa0e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20596f5049774f8fb15f5801891efec8)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:56.740686 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5843a6c-2f5a-4da0-9caf-2a075ccaa0e3 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:56.778148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-5168f612-606c-4a7c-8794-f1d8b8051bb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84cf88078dec4d9592d5d9d2ddd4d64f'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:56.787117 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-5168f612-606c-4a7c-8794-f1d8b8051bb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84cf88078dec4d9592d5d9d2ddd4d64f'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:56.788322 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-5168f612-606c-4a7c-8794-f1d8b8051bb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84cf88078dec4d9592d5d9d2ddd4d64f'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:56.804279 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-f5843a6c-2f5a-4da0-9caf-2a075ccaa0e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20596f5049774f8fb15f5801891efec8', 'request_id': 'req-f5843a6c-2f5a-4da0-9caf-2a075ccaa0e3'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:56.807860 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-5168f612-606c-4a7c-8794-f1d8b8051bb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84cf88078dec4d9592d5d9d2ddd4d64f'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:56.815164 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-f5843a6c-2f5a-4da0-9caf-2a075ccaa0e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20596f5049774f8fb15f5801891efec8', 'request_id': 'req-f5843a6c-2f5a-4da0-9caf-2a075ccaa0e3'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:56.818549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-5168f612-606c-4a7c-8794-f1d8b8051bb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84cf88078dec4d9592d5d9d2ddd4d64f'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:56.824056 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-f5843a6c-2f5a-4da0-9caf-2a075ccaa0e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20596f5049774f8fb15f5801891efec8', 'request_id': 'req-f5843a6c-2f5a-4da0-9caf-2a075ccaa0e3'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:56.825885 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1020/2051] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:56 2022] DELETE /identity/v3/users/84cf88078dec4d9592d5d9d2ddd4d64f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:56.845592 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-f5843a6c-2f5a-4da0-9caf-2a075ccaa0e3 admin admin] The token cache is being invalidate because project 20596f5049774f8fb15f5801891efec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:56.846145 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-f5843a6c-2f5a-4da0-9caf-2a075ccaa0e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:56.847023 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-f5843a6c-2f5a-4da0-9caf-2a075ccaa0e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:56.849554 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1032/2052] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:56 2022] DELETE /identity/v3/projects/20596f5049774f8fb15f5801891efec8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:56.853587 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168f612-606c-4a7c-8794-f1d8b8051bb8 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:56.855081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-5168f612-606c-4a7c-8794-f1d8b8051bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:56.929633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168f612-606c-4a7c-8794-f1d8b8051bb8 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:56.934396 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8855dd-1d80-43a8-a33f-54ca15006889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:56.935415 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8855dd-1d80-43a8-a33f-54ca15006889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:56.935822 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8855dd-1d80-43a8-a33f-54ca15006889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:56.936309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8855dd-1d80-43a8-a33f-54ca15006889 admin admin] PATH_INFO: `/v3/users/a489bde5b73a46249ad0718554e4bcc0` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:56.938073 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8855dd-1d80-43a8-a33f-54ca15006889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a489bde5b73a46249ad0718554e4bcc0)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:56.940607 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8855dd-1d80-43a8-a33f-54ca15006889 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:56.991837 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-5e8855dd-1d80-43a8-a33f-54ca15006889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a489bde5b73a46249ad0718554e4bcc0'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:56.998629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-5e8855dd-1d80-43a8-a33f-54ca15006889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a489bde5b73a46249ad0718554e4bcc0'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:56.999328 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-5e8855dd-1d80-43a8-a33f-54ca15006889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a489bde5b73a46249ad0718554e4bcc0'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:57.005935 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:57.019022 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-5e8855dd-1d80-43a8-a33f-54ca15006889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a489bde5b73a46249ad0718554e4bcc0'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:57.029596 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-5e8855dd-1d80-43a8-a33f-54ca15006889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a489bde5b73a46249ad0718554e4bcc0'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:57.037254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5843a6c-2f5a-4da0-9caf-2a075ccaa0e3 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:57.038807 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f5843a6c-2f5a-4da0-9caf-2a075ccaa0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:57.044126 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1021/2053] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:56 2022] DELETE /identity/v3/users/a489bde5b73a46249ad0718554e4bcc0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:39:57.124710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5843a6c-2f5a-4da0-9caf-2a075ccaa0e3 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:57.177802 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:57.218835 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ff657-db2d-4578-a788-6097fd76ae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:57.221466 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ff657-db2d-4578-a788-6097fd76ae44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:57.221606 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ff657-db2d-4578-a788-6097fd76ae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:57.221993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ff657-db2d-4578-a788-6097fd76ae44 admin admin] PATH_INFO: `/v3/projects/416975c7aa93428fb90fb832ee4049ad` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:57.225306 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ff657-db2d-4578-a788-6097fd76ae44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=416975c7aa93428fb90fb832ee4049ad)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:57.227163 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ff657-db2d-4578-a788-6097fd76ae44 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:57.382255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0a0ff657-db2d-4578-a788-6097fd76ae44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '416975c7aa93428fb90fb832ee4049ad', 'request_id': 'req-0a0ff657-db2d-4578-a788-6097fd76ae44'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:57.398815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0a0ff657-db2d-4578-a788-6097fd76ae44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '416975c7aa93428fb90fb832ee4049ad', 'request_id': 'req-0a0ff657-db2d-4578-a788-6097fd76ae44'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:57.399433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8855dd-1d80-43a8-a33f-54ca15006889 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:57.401243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-5e8855dd-1d80-43a8-a33f-54ca15006889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:57.415425 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0a0ff657-db2d-4578-a788-6097fd76ae44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '416975c7aa93428fb90fb832ee4049ad', 'request_id': 'req-0a0ff657-db2d-4578-a788-6097fd76ae44'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:57.436032 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8855dd-1d80-43a8-a33f-54ca15006889 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:57.446744 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0a0ff657-db2d-4578-a788-6097fd76ae44 admin admin] The token cache is being invalidate because project 416975c7aa93428fb90fb832ee4049ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:57.447045 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0a0ff657-db2d-4578-a788-6097fd76ae44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:57.449033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0a0ff657-db2d-4578-a788-6097fd76ae44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:57.454223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1033/2054] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:57 2022] DELETE /identity/v3/projects/416975c7aa93428fb90fb832ee4049ad => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:57.456170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ff657-db2d-4578-a788-6097fd76ae44 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:57.458340 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-0a0ff657-db2d-4578-a788-6097fd76ae44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:57.577406 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e5bb8-1884-4e2d-8380-872bf32cd9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:57.580123 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e5bb8-1884-4e2d-8380-872bf32cd9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:57.580349 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e5bb8-1884-4e2d-8380-872bf32cd9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:57.580648 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e5bb8-1884-4e2d-8380-872bf32cd9aa admin admin] PATH_INFO: `/v3/projects/32c7cf0810ac49a7837a8e297cfe8932` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:57.584532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e5bb8-1884-4e2d-8380-872bf32cd9aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=32c7cf0810ac49a7837a8e297cfe8932)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:57.589867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e5bb8-1884-4e2d-8380-872bf32cd9aa admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:57.647767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ff657-db2d-4578-a788-6097fd76ae44 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:57.659148 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c08084-ea87-4391-b628-9bd49f384670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:57.660169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c08084-ea87-4391-b628-9bd49f384670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:57.660525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c08084-ea87-4391-b628-9bd49f384670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:57.660871 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c08084-ea87-4391-b628-9bd49f384670 admin admin] PATH_INFO: `/v3/users/a86b787bd3c24382aecb536b6340ca6b` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:57.662313 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c08084-ea87-4391-b628-9bd49f384670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a86b787bd3c24382aecb536b6340ca6b)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:57.667461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c08084-ea87-4391-b628-9bd49f384670 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:57.669270 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c66e5bb8-1884-4e2d-8380-872bf32cd9aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c7cf0810ac49a7837a8e297cfe8932', 'request_id': 'req-c66e5bb8-1884-4e2d-8380-872bf32cd9aa'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:57.683040 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c66e5bb8-1884-4e2d-8380-872bf32cd9aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c7cf0810ac49a7837a8e297cfe8932', 'request_id': 'req-c66e5bb8-1884-4e2d-8380-872bf32cd9aa'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:57.700063 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c66e5bb8-1884-4e2d-8380-872bf32cd9aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c7cf0810ac49a7837a8e297cfe8932', 'request_id': 'req-c66e5bb8-1884-4e2d-8380-872bf32cd9aa'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:57.726082 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c66e5bb8-1884-4e2d-8380-872bf32cd9aa admin admin] The token cache is being invalidate because project 32c7cf0810ac49a7837a8e297cfe8932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:57.726393 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c66e5bb8-1884-4e2d-8380-872bf32cd9aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:57.727407 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c66e5bb8-1884-4e2d-8380-872bf32cd9aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:57.731423 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1022/2055] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:57 2022] DELETE /identity/v3/projects/32c7cf0810ac49a7837a8e297cfe8932 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:39:57.736104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc89bb-83e5-4c45-b825-d314fcdd5d87 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:57.737055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc89bb-83e5-4c45-b825-d314fcdd5d87 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:57.737488 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc89bb-83e5-4c45-b825-d314fcdd5d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:57.759392 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e2c08084-ea87-4391-b628-9bd49f384670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a86b787bd3c24382aecb536b6340ca6b'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:57.760211 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-a6cc89bb-83e5-4c45-b825-d314fcdd5d87 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:57.760915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e2c08084-ea87-4391-b628-9bd49f384670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a86b787bd3c24382aecb536b6340ca6b'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:57.761427 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-a6cc89bb-83e5-4c45-b825-d314fcdd5d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:57.770743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e2c08084-ea87-4391-b628-9bd49f384670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a86b787bd3c24382aecb536b6340ca6b'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:57.771709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e2c08084-ea87-4391-b628-9bd49f384670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a86b787bd3c24382aecb536b6340ca6b'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:57.794914 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:57.796177 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e2c08084-ea87-4391-b628-9bd49f384670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a86b787bd3c24382aecb536b6340ca6b'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:57.818691 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1034/2056] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:57 2022] DELETE /identity/v3/users/a86b787bd3c24382aecb536b6340ca6b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:57.821783 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c08084-ea87-4391-b628-9bd49f384670 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:57.822769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-e2c08084-ea87-4391-b628-9bd49f384670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:57.852742 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1023/2057] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:57.855328 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3992a-cffa-48cf-aa74-22065b2f1cce None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:57.855328 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3992a-cffa-48cf-aa74-22065b2f1cce None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:57.855328 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3992a-cffa-48cf-aa74-22065b2f1cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:57.899618 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-34b3992a-cffa-48cf-aa74-22065b2f1cce None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:57.899618 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-34b3992a-cffa-48cf-aa74-22065b2f1cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:57.908923 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:57.941150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c08084-ea87-4391-b628-9bd49f384670 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:57.950006 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ea23b-dca3-457a-aae6-a76343dbd76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:57.951085 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ea23b-dca3-457a-aae6-a76343dbd76b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:57.951400 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ea23b-dca3-457a-aae6-a76343dbd76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:57.951767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ea23b-dca3-457a-aae6-a76343dbd76b admin admin] PATH_INFO: `/v3/users/3abd8721ca704f55a600e27c711a751d` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:57.953365 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ea23b-dca3-457a-aae6-a76343dbd76b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3abd8721ca704f55a600e27c711a751d)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:57.956863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ea23b-dca3-457a-aae6-a76343dbd76b admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:58.000817 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1024/2058] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:58.002365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3992a-cffa-48cf-aa74-22065b2f1cce None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:58.013534 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3992a-cffa-48cf-aa74-22065b2f1cce None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:58.021503 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae746664-2545-4162-8273-569eb783c528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:58.022658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae746664-2545-4162-8273-569eb783c528 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:58.023391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae746664-2545-4162-8273-569eb783c528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:58.023720 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-c18ea23b-dca3-457a-aae6-a76343dbd76b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3abd8721ca704f55a600e27c711a751d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:58.023997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae746664-2545-4162-8273-569eb783c528 admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:58.024484 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-c18ea23b-dca3-457a-aae6-a76343dbd76b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3abd8721ca704f55a600e27c711a751d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:58.025059 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae746664-2545-4162-8273-569eb783c528 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:39:58.025520 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae746664-2545-4162-8273-569eb783c528 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:58.027758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae746664-2545-4162-8273-569eb783c528 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:58.041586 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-c18ea23b-dca3-457a-aae6-a76343dbd76b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3abd8721ca704f55a600e27c711a751d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:58.042917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-c18ea23b-dca3-457a-aae6-a76343dbd76b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3abd8721ca704f55a600e27c711a751d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:58.051636 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1025/2059] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:39:58.053108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae746664-2545-4162-8273-569eb783c528 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:58.055202 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-ae746664-2545-4162-8273-569eb783c528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:58.056919 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-c18ea23b-dca3-457a-aae6-a76343dbd76b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3abd8721ca704f55a600e27c711a751d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:58.069583 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae746664-2545-4162-8273-569eb783c528 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:58.074868 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef4b38-cb4e-4bbd-ad78-b2a2aa663014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:58.075592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef4b38-cb4e-4bbd-ad78-b2a2aa663014 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:58.075874 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef4b38-cb4e-4bbd-ad78-b2a2aa663014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:58.076158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef4b38-cb4e-4bbd-ad78-b2a2aa663014 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:58.077082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1035/2060] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:57 2022] DELETE /identity/v3/users/3abd8721ca704f55a600e27c711a751d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:58.077202 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef4b38-cb4e-4bbd-ad78-b2a2aa663014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:58.079468 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef4b38-cb4e-4bbd-ad78-b2a2aa663014 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:58.082035 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f697e60-d088-46f2-b34a-ffb0f771841e None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:58.082520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f697e60-d088-46f2-b34a-ffb0f771841e None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:58.083107 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f697e60-d088-46f2-b34a-ffb0f771841e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:58.104257 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-5f697e60-d088-46f2-b34a-ffb0f771841e None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:58.105834 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-5f697e60-d088-46f2-b34a-ffb0f771841e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:58.120735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1026/2061] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:58 2022] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:58.125360 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef4b38-cb4e-4bbd-ad78-b2a2aa663014 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:58.208481 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1036/2062] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:58.208481 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f697e60-d088-46f2-b34a-ffb0f771841e None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:58.209609 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-5f697e60-d088-46f2-b34a-ffb0f771841e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:58.217390 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef4b38-cb4e-4bbd-ad78-b2a2aa663014 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:58.222810 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e364930-df14-4e1f-9444-7a7341e078d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:58.223897 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e364930-df14-4e1f-9444-7a7341e078d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:58.224328 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e364930-df14-4e1f-9444-7a7341e078d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:58.224764 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f697e60-d088-46f2-b34a-ffb0f771841e None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:58.224865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e364930-df14-4e1f-9444-7a7341e078d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:58.225828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e364930-df14-4e1f-9444-7a7341e078d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:58.229416 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e364930-df14-4e1f-9444-7a7341e078d7 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:58.229679 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea0c6f-abbb-4898-befc-de3b0ca210ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:58.230606 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea0c6f-abbb-4898-befc-de3b0ca210ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:58.230891 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea0c6f-abbb-4898-befc-de3b0ca210ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:58.231165 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea0c6f-abbb-4898-befc-de3b0ca210ce admin admin] PATH_INFO: `/v3/projects/439700b1395545398b371ec43a8ab9cf` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:58.232624 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea0c6f-abbb-4898-befc-de3b0ca210ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=439700b1395545398b371ec43a8ab9cf)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:58.234598 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea0c6f-abbb-4898-befc-de3b0ca210ce admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:58.237423 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:58.257459 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1027/2063] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:58 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:58.257459 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e364930-df14-4e1f-9444-7a7341e078d7 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:58.258839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-9e364930-df14-4e1f-9444-7a7341e078d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:58.295088 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-5bea0c6f-abbb-4898-befc-de3b0ca210ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '439700b1395545398b371ec43a8ab9cf', 'request_id': 'req-5bea0c6f-abbb-4898-befc-de3b0ca210ce'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:58.303889 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-5bea0c6f-abbb-4898-befc-de3b0ca210ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '439700b1395545398b371ec43a8ab9cf', 'request_id': 'req-5bea0c6f-abbb-4898-befc-de3b0ca210ce'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:58.314377 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-5bea0c6f-abbb-4898-befc-de3b0ca210ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '439700b1395545398b371ec43a8ab9cf', 'request_id': 'req-5bea0c6f-abbb-4898-befc-de3b0ca210ce'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:58.326969 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-5bea0c6f-abbb-4898-befc-de3b0ca210ce admin admin] The token cache is being invalidate because project 439700b1395545398b371ec43a8ab9cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:58.327303 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-5bea0c6f-abbb-4898-befc-de3b0ca210ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:58.327977 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-5bea0c6f-abbb-4898-befc-de3b0ca210ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:58.330142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1037/2064] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:58 2022] DELETE /identity/v3/projects/439700b1395545398b371ec43a8ab9cf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:58.331419 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea0c6f-abbb-4898-befc-de3b0ca210ce admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:58.332300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-5bea0c6f-abbb-4898-befc-de3b0ca210ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:58.337977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e364930-df14-4e1f-9444-7a7341e078d7 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:58.355137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:58.394334 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d32c1-761f-4a25-a473-1bc6ab4f25d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:58.394984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d32c1-761f-4a25-a473-1bc6ab4f25d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:58.395264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d32c1-761f-4a25-a473-1bc6ab4f25d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:58.395585 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d32c1-761f-4a25-a473-1bc6ab4f25d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:58.397394 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-6a1d32c1-761f-4a25-a473-1bc6ab4f25d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:58.402768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea0c6f-abbb-4898-befc-de3b0ca210ce admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:58.407777 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250839a8-fdb9-421f-a742-125f972c4cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:58.408439 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250839a8-fdb9-421f-a742-125f972c4cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:58.408723 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250839a8-fdb9-421f-a742-125f972c4cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:58.408999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250839a8-fdb9-421f-a742-125f972c4cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:58.409193 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d32c1-761f-4a25-a473-1bc6ab4f25d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:58.409722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250839a8-fdb9-421f-a742-125f972c4cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:58.410608 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d32c1-761f-4a25-a473-1bc6ab4f25d9 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:58.411347 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250839a8-fdb9-421f-a742-125f972c4cf5 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:58.420495 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1028/2065] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:39:58.421817 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c385b-fb05-452d-9504-cfdcf12e40a2 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:58.422106 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c385b-fb05-452d-9504-cfdcf12e40a2 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:58.422382 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c385b-fb05-452d-9504-cfdcf12e40a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:58.428511 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1038/2066] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:58.432456 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250839a8-fdb9-421f-a742-125f972c4cf5 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:58.443444 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-a60c385b-fb05-452d-9504-cfdcf12e40a2 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:58.444315 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250839a8-fdb9-421f-a742-125f972c4cf5 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:58.444632 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-a60c385b-fb05-452d-9504-cfdcf12e40a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:58.450790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e240d-7eca-44ba-9a2e-661aa59a0632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:58.451675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e240d-7eca-44ba-9a2e-661aa59a0632 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:58.452039 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e240d-7eca-44ba-9a2e-661aa59a0632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:58.452418 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e240d-7eca-44ba-9a2e-661aa59a0632 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:58.453385 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e240d-7eca-44ba-9a2e-661aa59a0632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:58.455720 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e240d-7eca-44ba-9a2e-661aa59a0632 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:58.456481 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1029/2067] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:58.464835 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220b0ea-3821-4dff-b2ab-c18996ec7579 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:58.465136 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220b0ea-3821-4dff-b2ab-c18996ec7579 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:58.465516 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220b0ea-3821-4dff-b2ab-c18996ec7579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:58.471937 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1039/2068] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:39:58.473515 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e240d-7eca-44ba-9a2e-661aa59a0632 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:58.488604 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-2220b0ea-3821-4dff-b2ab-c18996ec7579 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:58.489090 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e240d-7eca-44ba-9a2e-661aa59a0632 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:58.489815 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-2220b0ea-3821-4dff-b2ab-c18996ec7579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:58.494453 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e8eee-f32c-46de-909f-3fcbd9523056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:58.495374 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e8eee-f32c-46de-909f-3fcbd9523056 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:58.495945 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e8eee-f32c-46de-909f-3fcbd9523056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:58.495945 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e8eee-f32c-46de-909f-3fcbd9523056 admin admin] PATH_INFO: `/v3/projects/dd7e2da02b0744418dae62d03b3c5fda/users/3bc890292fc249888c0443d44f30c278/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:58.499408 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1030/2069] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:39:58.503775 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220b0ea-3821-4dff-b2ab-c18996ec7579 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:58.518686 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e8eee-f32c-46de-909f-3fcbd9523056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd7e2da02b0744418dae62d03b3c5fda, user_id=3bc890292fc249888c0443d44f30c278, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:58.521697 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e8eee-f32c-46de-909f-3fcbd9523056 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:58.525468 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220b0ea-3821-4dff-b2ab-c18996ec7579 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:58.534346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706af03-19ee-4a32-bc77-79d76d454fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:58.535816 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706af03-19ee-4a32-bc77-79d76d454fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:58.536109 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706af03-19ee-4a32-bc77-79d76d454fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:58.536437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706af03-19ee-4a32-bc77-79d76d454fb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:58.537448 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706af03-19ee-4a32-bc77-79d76d454fb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:39:58.537888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706af03-19ee-4a32-bc77-79d76d454fb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:58.539062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1040/2070] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:58 2022] PUT /identity/v3/projects/dd7e2da02b0744418dae62d03b3c5fda/users/3bc890292fc249888c0443d44f30c278/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:58.540473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706af03-19ee-4a32-bc77-79d76d454fb1 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:58.551596 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9280f2-f2cc-4ca3-bded-c6f5bf79508b None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:58.551996 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9280f2-f2cc-4ca3-bded-c6f5bf79508b None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:58.552387 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9280f2-f2cc-4ca3-bded-c6f5bf79508b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:58.560377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1031/2071] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:39:58.565451 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706af03-19ee-4a32-bc77-79d76d454fb1 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:58.582073 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706af03-19ee-4a32-bc77-79d76d454fb1 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:58.586429 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-3c9280f2-f2cc-4ca3-bded-c6f5bf79508b None None] MFA Rules not processed for user `3bc890292fc249888c0443d44f30c278`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:58.587704 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-3c9280f2-f2cc-4ca3-bded-c6f5bf79508b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:58.652974 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88f24a-19cb-4b98-b81a-5e6a21b09c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:58.653431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:58.653646 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88f24a-19cb-4b98-b81a-5e6a21b09c40 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:58.653975 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88f24a-19cb-4b98-b81a-5e6a21b09c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:58.654253 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88f24a-19cb-4b98-b81a-5e6a21b09c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:58.655544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88f24a-19cb-4b98-b81a-5e6a21b09c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:58.658372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88f24a-19cb-4b98-b81a-5e6a21b09c40 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:58.690240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1041/2072] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:58.695349 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1032/2073] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:58 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:58.696836 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88f24a-19cb-4b98-b81a-5e6a21b09c40 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:58.696979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9280f2-f2cc-4ca3-bded-c6f5bf79508b None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:58.708553 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9280f2-f2cc-4ca3-bded-c6f5bf79508b None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:58.776051 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0e3ab-8744-4ceb-8e61-3d1f08b79796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:58.776882 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0e3ab-8744-4ceb-8e61-3d1f08b79796 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:58.777187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0e3ab-8744-4ceb-8e61-3d1f08b79796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:58.777552 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0e3ab-8744-4ceb-8e61-3d1f08b79796 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:58.778300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0e3ab-8744-4ceb-8e61-3d1f08b79796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:58.783493 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0e3ab-8744-4ceb-8e61-3d1f08b79796 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:58.787718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88f24a-19cb-4b98-b81a-5e6a21b09c40 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:58.798590 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf2ba5-d9f1-4102-b866-e5b528d4ace4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:58.800266 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf2ba5-d9f1-4102-b866-e5b528d4ace4 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:58.800557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf2ba5-d9f1-4102-b866-e5b528d4ace4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:58.800886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf2ba5-d9f1-4102-b866-e5b528d4ace4 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:58.801593 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf2ba5-d9f1-4102-b866-e5b528d4ace4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:58.803651 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf2ba5-d9f1-4102-b866-e5b528d4ace4 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:58.836842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1042/2074] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:39:58 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:58.837516 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1033/2075] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:58 2022] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:58.838071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0e3ab-8744-4ceb-8e61-3d1f08b79796 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:58.838390 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf2ba5-d9f1-4102-b866-e5b528d4ace4 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:58.840425 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-3ce0e3ab-8744-4ceb-8e61-3d1f08b79796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:58.850760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf2ba5-d9f1-4102-b866-e5b528d4ace4 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:58.860318 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:58.944825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0e3ab-8744-4ceb-8e61-3d1f08b79796 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:58.951446 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189a95e-0f3e-4e73-8839-2dcf9ecb557b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:58.952500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189a95e-0f3e-4e73-8839-2dcf9ecb557b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:58.952877 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189a95e-0f3e-4e73-8839-2dcf9ecb557b admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:58.953161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189a95e-0f3e-4e73-8839-2dcf9ecb557b admin admin] PATH_INFO: `/v3/projects/42646af387cd45c39089f7a1ae32f668` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:58.954973 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189a95e-0f3e-4e73-8839-2dcf9ecb557b admin admin] RBAC: Authorizing `identity:delete_project(project_id=42646af387cd45c39089f7a1ae32f668)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:58.957076 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189a95e-0f3e-4e73-8839-2dcf9ecb557b admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:58.961675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165bb24-2eb0-4f6c-8c80-35e2b24fa01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:58.962364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165bb24-2eb0-4f6c-8c80-35e2b24fa01d admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:58.962652 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165bb24-2eb0-4f6c-8c80-35e2b24fa01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:58.963039 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165bb24-2eb0-4f6c-8c80-35e2b24fa01d admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:58.963870 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165bb24-2eb0-4f6c-8c80-35e2b24fa01d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:58.968128 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165bb24-2eb0-4f6c-8c80-35e2b24fa01d admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:59.007475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1034/2076] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:39:58 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:39:59.008688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165bb24-2eb0-4f6c-8c80-35e2b24fa01d admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:59.020239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165bb24-2eb0-4f6c-8c80-35e2b24fa01d admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:59.044247 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0189a95e-0f3e-4e73-8839-2dcf9ecb557b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42646af387cd45c39089f7a1ae32f668', 'request_id': 'req-0189a95e-0f3e-4e73-8839-2dcf9ecb557b'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:59.054792 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0189a95e-0f3e-4e73-8839-2dcf9ecb557b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42646af387cd45c39089f7a1ae32f668', 'request_id': 'req-0189a95e-0f3e-4e73-8839-2dcf9ecb557b'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:59.065548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0189a95e-0f3e-4e73-8839-2dcf9ecb557b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42646af387cd45c39089f7a1ae32f668', 'request_id': 'req-0189a95e-0f3e-4e73-8839-2dcf9ecb557b'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:59.077926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:59.085030 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0189a95e-0f3e-4e73-8839-2dcf9ecb557b admin admin] The token cache is being invalidate because project 42646af387cd45c39089f7a1ae32f668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:59.085030 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0189a95e-0f3e-4e73-8839-2dcf9ecb557b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:59.085710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0189a95e-0f3e-4e73-8839-2dcf9ecb557b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:59.088538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1043/2077] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:58 2022] DELETE /identity/v3/projects/42646af387cd45c39089f7a1ae32f668 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:59.102407 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189a95e-0f3e-4e73-8839-2dcf9ecb557b admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:59.104816 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-0189a95e-0f3e-4e73-8839-2dcf9ecb557b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:59.153589 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865971de-4696-4e79-b859-bb1aa9964a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:59.156689 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865971de-4696-4e79-b859-bb1aa9964a61 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:59.157099 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865971de-4696-4e79-b859-bb1aa9964a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:59.157445 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865971de-4696-4e79-b859-bb1aa9964a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:59.160313 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865971de-4696-4e79-b859-bb1aa9964a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:59.162425 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865971de-4696-4e79-b859-bb1aa9964a61 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:59.183176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1035/2078] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:59.183176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865971de-4696-4e79-b859-bb1aa9964a61 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:59.183176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-865971de-4696-4e79-b859-bb1aa9964a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:59.198192 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865971de-4696-4e79-b859-bb1aa9964a61 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:59.202842 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478a5a6-0b6c-4dae-9e20-4f629f9c5e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:59.203810 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478a5a6-0b6c-4dae-9e20-4f629f9c5e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:59.204604 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478a5a6-0b6c-4dae-9e20-4f629f9c5e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:59.204885 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478a5a6-0b6c-4dae-9e20-4f629f9c5e17 admin admin] PATH_INFO: `/v3/users/26ec883d251941dda165cd2d044c3aae` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:59.206081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478a5a6-0b6c-4dae-9e20-4f629f9c5e17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ec883d251941dda165cd2d044c3aae)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:59.208035 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478a5a6-0b6c-4dae-9e20-4f629f9c5e17 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:59.235661 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189a95e-0f3e-4e73-8839-2dcf9ecb557b admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:59.240524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6eac3b-96ae-42fc-acb6-d334493f5d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:59.242617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6eac3b-96ae-42fc-acb6-d334493f5d51 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:59.242617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6eac3b-96ae-42fc-acb6-d334493f5d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:59.242617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6eac3b-96ae-42fc-acb6-d334493f5d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:59.243566 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6eac3b-96ae-42fc-acb6-d334493f5d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:59.245335 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6eac3b-96ae-42fc-acb6-d334493f5d51 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:59.263120 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1044/2079] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:59.264383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6eac3b-96ae-42fc-acb6-d334493f5d51 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:59.266625 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-0d6eac3b-96ae-42fc-acb6-d334493f5d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:59.278925 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-d478a5a6-0b6c-4dae-9e20-4f629f9c5e17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ec883d251941dda165cd2d044c3aae'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:59.285343 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6eac3b-96ae-42fc-acb6-d334493f5d51 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:59.286190 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-d478a5a6-0b6c-4dae-9e20-4f629f9c5e17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ec883d251941dda165cd2d044c3aae'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:59.286972 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-d478a5a6-0b6c-4dae-9e20-4f629f9c5e17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ec883d251941dda165cd2d044c3aae'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:59.290358 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29058396-88d8-4856-a2a6-5162e8dc9535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:59.291030 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29058396-88d8-4856-a2a6-5162e8dc9535 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:59.291337 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29058396-88d8-4856-a2a6-5162e8dc9535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:59.291762 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29058396-88d8-4856-a2a6-5162e8dc9535 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:59.293255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29058396-88d8-4856-a2a6-5162e8dc9535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:59.294260 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29058396-88d8-4856-a2a6-5162e8dc9535 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:59.303536 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-d478a5a6-0b6c-4dae-9e20-4f629f9c5e17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ec883d251941dda165cd2d044c3aae'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:59.308368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1045/2080] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:39:59.309673 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29058396-88d8-4856-a2a6-5162e8dc9535 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:59.315923 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-d478a5a6-0b6c-4dae-9e20-4f629f9c5e17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ec883d251941dda165cd2d044c3aae'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:59.322855 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29058396-88d8-4856-a2a6-5162e8dc9535 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:59.324128 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1036/2081] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:39:59 2022] DELETE /identity/v3/users/26ec883d251941dda165cd2d044c3aae => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:59.325098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478a5a6-0b6c-4dae-9e20-4f629f9c5e17 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:59.326622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-d478a5a6-0b6c-4dae-9e20-4f629f9c5e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:59.340841 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:59.432548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32eb227-828b-446c-802f-c964d39b041f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:59.434099 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32eb227-828b-446c-802f-c964d39b041f admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:59.434621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32eb227-828b-446c-802f-c964d39b041f admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:59.436028 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32eb227-828b-446c-802f-c964d39b041f admin admin] PATH_INFO: `/v3/projects/731ab09764ad4bacaf4689b5d819ac9c/users/b2c5df5d75604213959534db3a3abf77/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:59.439720 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478a5a6-0b6c-4dae-9e20-4f629f9c5e17 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:59.445596 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7ce11-00d0-4a3d-8fc1-2711bf4fe93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:59.446621 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7ce11-00d0-4a3d-8fc1-2711bf4fe93d admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:59.446994 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7ce11-00d0-4a3d-8fc1-2711bf4fe93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:59.447408 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7ce11-00d0-4a3d-8fc1-2711bf4fe93d admin admin] PATH_INFO: `/v3/projects/4b17fac30e6a469a8e0ca8b6e2fcdc1d/users/b35535c6b1c74a0baf58c8ccdbf30772/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:59.457686 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32eb227-828b-446c-802f-c964d39b041f admin admin] RBAC: Authorizing `identity:create_grant(project_id=731ab09764ad4bacaf4689b5d819ac9c, user_id=b2c5df5d75604213959534db3a3abf77, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:59.460389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32eb227-828b-446c-802f-c964d39b041f admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:59.469129 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7ce11-00d0-4a3d-8fc1-2711bf4fe93d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b17fac30e6a469a8e0ca8b6e2fcdc1d, user_id=b35535c6b1c74a0baf58c8ccdbf30772, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:59.475662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7ce11-00d0-4a3d-8fc1-2711bf4fe93d admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:59.475932 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1046/2082] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:59 2022] PUT /identity/v3/projects/731ab09764ad4bacaf4689b5d819ac9c/users/b2c5df5d75604213959534db3a3abf77/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:59.479714 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32eb227-828b-446c-802f-c964d39b041f admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:59.481508 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-a32eb227-828b-446c-802f-c964d39b041f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:59.495331 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1037/2083] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:59 2022] PUT /identity/v3/projects/4b17fac30e6a469a8e0ca8b6e2fcdc1d/users/b35535c6b1c74a0baf58c8ccdbf30772/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:59.497639 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0bd67-6781-4f78-a07d-c9f0fc0df3c8 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:59.497951 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0bd67-6781-4f78-a07d-c9f0fc0df3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:59.498203 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0bd67-6781-4f78-a07d-c9f0fc0df3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:59.520229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-58c0bd67-6781-4f78-a07d-c9f0fc0df3c8 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:59.521510 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-58c0bd67-6781-4f78-a07d-c9f0fc0df3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:59.578115 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32eb227-828b-446c-802f-c964d39b041f admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:59.588672 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:59.595383 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1038/2084] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:39:59.607178 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0bd67-6781-4f78-a07d-c9f0fc0df3c8 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:59.608635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-58c0bd67-6781-4f78-a07d-c9f0fc0df3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:59.642892 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb5e79-e0b5-473b-8753-fe3e7321848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:59.643599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb5e79-e0b5-473b-8753-fe3e7321848e admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:59.643881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb5e79-e0b5-473b-8753-fe3e7321848e admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:59.644159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb5e79-e0b5-473b-8753-fe3e7321848e admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:59.644880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb5e79-e0b5-473b-8753-fe3e7321848e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:59.646906 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb5e79-e0b5-473b-8753-fe3e7321848e admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:59.662144 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1047/2085] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:39:59.663169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb5e79-e0b5-473b-8753-fe3e7321848e admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:59.677891 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb5e79-e0b5-473b-8753-fe3e7321848e admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:59.682962 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2784de7-bec2-4753-826a-142107f09409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:59.683916 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2784de7-bec2-4753-826a-142107f09409 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:59.684200 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2784de7-bec2-4753-826a-142107f09409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:59.684851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2784de7-bec2-4753-826a-142107f09409 admin admin] PATH_INFO: `/v3/projects/731ab09764ad4bacaf4689b5d819ac9c/users/b2c5df5d75604213959534db3a3abf77/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:59.687060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2784de7-bec2-4753-826a-142107f09409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=731ab09764ad4bacaf4689b5d819ac9c, user_id=b2c5df5d75604213959534db3a3abf77, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:59.691625 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2784de7-bec2-4753-826a-142107f09409 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:59.700126 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0bd67-6781-4f78-a07d-c9f0fc0df3c8 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:59.717055 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1048/2086] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:39:59 2022] PUT /identity/v3/projects/731ab09764ad4bacaf4689b5d819ac9c/users/b2c5df5d75604213959534db3a3abf77/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:59.717055 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2784de7-bec2-4753-826a-142107f09409 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:39:59.717055 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d2784de7-bec2-4753-826a-142107f09409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:59.752074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:59.758179 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85f213-9238-44f0-9fd7-40a77dd38061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:59.758896 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85f213-9238-44f0-9fd7-40a77dd38061 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:59.759650 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85f213-9238-44f0-9fd7-40a77dd38061 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:59.760435 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85f213-9238-44f0-9fd7-40a77dd38061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:59.786242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2784de7-bec2-4753-826a-142107f09409 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:39:59.791519 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88407c5-9e15-4ed2-8622-c69b48a0d74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:39:59.792398 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88407c5-9e15-4ed2-8622-c69b48a0d74b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:59.792686 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88407c5-9e15-4ed2-8622-c69b48a0d74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:59.792968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88407c5-9e15-4ed2-8622-c69b48a0d74b admin admin] PATH_INFO: `/v3/projects/c6ce13c8513946708dc3c9a618592b1a` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:59.794224 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88407c5-9e15-4ed2-8622-c69b48a0d74b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6ce13c8513946708dc3c9a618592b1a)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:59.796270 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88407c5-9e15-4ed2-8622-c69b48a0d74b admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:59.837040 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85f213-9238-44f0-9fd7-40a77dd38061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:39:59.838931 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85f213-9238-44f0-9fd7-40a77dd38061 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:39:59.852718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1039/2087] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:39:59.854115 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051edb43-e158-4853-927a-303493bfb1e9 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:59.854430 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051edb43-e158-4853-927a-303493bfb1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:59.854705 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051edb43-e158-4853-927a-303493bfb1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:59.877457 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-c88407c5-9e15-4ed2-8622-c69b48a0d74b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6ce13c8513946708dc3c9a618592b1a', 'request_id': 'req-c88407c5-9e15-4ed2-8622-c69b48a0d74b'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:59.888292 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-c88407c5-9e15-4ed2-8622-c69b48a0d74b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6ce13c8513946708dc3c9a618592b1a', 'request_id': 'req-c88407c5-9e15-4ed2-8622-c69b48a0d74b'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:59.896511 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-c88407c5-9e15-4ed2-8622-c69b48a0d74b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6ce13c8513946708dc3c9a618592b1a', 'request_id': 'req-c88407c5-9e15-4ed2-8622-c69b48a0d74b'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:59.909751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-c88407c5-9e15-4ed2-8622-c69b48a0d74b admin admin] The token cache is being invalidate because project c6ce13c8513946708dc3c9a618592b1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:39:59.910177 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-c88407c5-9e15-4ed2-8622-c69b48a0d74b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:59.910924 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-c88407c5-9e15-4ed2-8622-c69b48a0d74b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:39:59.911573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-051edb43-e158-4853-927a-303493bfb1e9 None None] MFA Rules not processed for user `b2c5df5d75604213959534db3a3abf77`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:59.915351 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-051edb43-e158-4853-927a-303493bfb1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:39:59.915571 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1049/2088] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:39:59 2022] DELETE /identity/v3/projects/c6ce13c8513946708dc3c9a618592b1a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:39:59.919795 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fa571-ac85-410b-949c-777671ae8c4d None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:39:59.920166 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fa571-ac85-410b-949c-777671ae8c4d None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:39:59.920515 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fa571-ac85-410b-949c-777671ae8c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:39:59.975295 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-a88fa571-ac85-410b-949c-777671ae8c4d None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:39:59.976978 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-a88fa571-ac85-410b-949c-777671ae8c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:00.022315 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:00.105569 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1040/2089] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:00.120932 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051edb43-e158-4853-927a-303493bfb1e9 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:00.123136 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-051edb43-e158-4853-927a-303493bfb1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:00.129280 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1050/2090] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:00.142994 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ae9be-1679-407b-bd01-6e8ec0ae2d86 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:00.145628 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ae9be-1679-407b-bd01-6e8ec0ae2d86 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:00.146551 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ae9be-1679-407b-bd01-6e8ec0ae2d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:00.178333 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-6d7ae9be-1679-407b-bd01-6e8ec0ae2d86 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:00.179786 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-6d7ae9be-1679-407b-bd01-6e8ec0ae2d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:00.196409 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1051/2091] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:00.200215 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ae9be-1679-407b-bd01-6e8ec0ae2d86 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:00.206981 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051edb43-e158-4853-927a-303493bfb1e9 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:00.212398 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc599a36-4e98-4ee3-8fff-5a0177332898 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:00.212748 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ae9be-1679-407b-bd01-6e8ec0ae2d86 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:00.213834 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc599a36-4e98-4ee3-8fff-5a0177332898 service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:00.214261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc599a36-4e98-4ee3-8fff-5a0177332898 service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:00.216603 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc599a36-4e98-4ee3-8fff-5a0177332898 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:00.228704 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aca0fd-b481-4718-ac3c-390e644b1606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:00.229306 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aca0fd-b481-4718-ac3c-390e644b1606 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:00.229761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aca0fd-b481-4718-ac3c-390e644b1606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:00.230048 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aca0fd-b481-4718-ac3c-390e644b1606 admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:00.230784 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aca0fd-b481-4718-ac3c-390e644b1606 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:40:00.231242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aca0fd-b481-4718-ac3c-390e644b1606 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:00.232916 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aca0fd-b481-4718-ac3c-390e644b1606 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:00.237556 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc599a36-4e98-4ee3-8fff-5a0177332898 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:00.239044 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc599a36-4e98-4ee3-8fff-5a0177332898 service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:00.252957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1041/2092] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:40:00.259986 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1052/2093] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:40:00.264052 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc599a36-4e98-4ee3-8fff-5a0177332898 service cinder] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:00.281610 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc599a36-4e98-4ee3-8fff-5a0177332898 service cinder] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:00.290662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3614c5e-a4c1-4ed5-bf32-60f7630a2a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:00.291384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3614c5e-a4c1-4ed5-bf32-60f7630a2a46 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:00.291674 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3614c5e-a4c1-4ed5-bf32-60f7630a2a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:00.291954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3614c5e-a4c1-4ed5-bf32-60f7630a2a46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:00.293898 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3614c5e-a4c1-4ed5-bf32-60f7630a2a46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:00.296562 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3614c5e-a4c1-4ed5-bf32-60f7630a2a46 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:00.350001 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1042/2094] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:40:00 2022] POST /identity/v3/projects => generated 361 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:00.354869 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aca0fd-b481-4718-ac3c-390e644b1606 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:00.369303 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aca0fd-b481-4718-ac3c-390e644b1606 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:00.495917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aed0d7-9400-431d-88ac-a1e04acdbe2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:00.496624 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aed0d7-9400-431d-88ac-a1e04acdbe2d admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:00.497999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aed0d7-9400-431d-88ac-a1e04acdbe2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:00.498286 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aed0d7-9400-431d-88ac-a1e04acdbe2d admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:00.499003 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aed0d7-9400-431d-88ac-a1e04acdbe2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:00.501045 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aed0d7-9400-431d-88ac-a1e04acdbe2d admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:00.562554 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1053/2095] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:40:00 2022] POST /identity/v3/users => generated 281 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:00.563864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3614c5e-a4c1-4ed5-bf32-60f7630a2a46 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:00.573912 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:00.579067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3614c5e-a4c1-4ed5-bf32-60f7630a2a46 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:00.587588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95066331-6749-400b-bcc6-0d9ca58c2432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:00.588492 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95066331-6749-400b-bcc6-0d9ca58c2432 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:00.588880 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95066331-6749-400b-bcc6-0d9ca58c2432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:00.589392 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95066331-6749-400b-bcc6-0d9ca58c2432 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:00.591073 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95066331-6749-400b-bcc6-0d9ca58c2432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:00.593398 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95066331-6749-400b-bcc6-0d9ca58c2432 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:00.607821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1043/2096] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:00.616085 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aed0d7-9400-431d-88ac-a1e04acdbe2d admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:00.634482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aed0d7-9400-431d-88ac-a1e04acdbe2d admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:00.641992 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c556a4f-b28e-4c92-b728-3e71379e8665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:00.644654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c556a4f-b28e-4c92-b728-3e71379e8665 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:00.644977 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c556a4f-b28e-4c92-b728-3e71379e8665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:00.645271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c556a4f-b28e-4c92-b728-3e71379e8665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:00.646577 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c556a4f-b28e-4c92-b728-3e71379e8665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:00.648267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c556a4f-b28e-4c92-b728-3e71379e8665 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:00.667191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1054/2097] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:00.673092 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95066331-6749-400b-bcc6-0d9ca58c2432 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:00.693921 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95066331-6749-400b-bcc6-0d9ca58c2432 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:00.700543 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb8f31-72b3-4a79-84ed-61a695df19d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:00.701456 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb8f31-72b3-4a79-84ed-61a695df19d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:00.701746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb8f31-72b3-4a79-84ed-61a695df19d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:00.702039 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb8f31-72b3-4a79-84ed-61a695df19d8 admin admin] PATH_INFO: `/v3/projects/66f3f54ee34b4d579246d142730b5ae7/users/714c81768d634946962f6d45d4444342/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:00.722519 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb8f31-72b3-4a79-84ed-61a695df19d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f3f54ee34b4d579246d142730b5ae7, user_id=714c81768d634946962f6d45d4444342, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:00.732157 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb8f31-72b3-4a79-84ed-61a695df19d8 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:00.750218 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1044/2098] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:00 2022] PUT /identity/v3/projects/66f3f54ee34b4d579246d142730b5ae7/users/714c81768d634946962f6d45d4444342/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:00.764424 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90028384-1c97-43dd-a6cf-5891103ab954 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:00.764424 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90028384-1c97-43dd-a6cf-5891103ab954 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:00.764424 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90028384-1c97-43dd-a6cf-5891103ab954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:00.816852 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e983320-e7c9-46b2-a1c9-afada2560bef None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:00.817150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e983320-e7c9-46b2-a1c9-afada2560bef None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:00.817421 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e983320-e7c9-46b2-a1c9-afada2560bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:00.820757 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-90028384-1c97-43dd-a6cf-5891103ab954 None None] MFA Rules not processed for user `714c81768d634946962f6d45d4444342`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:00.822669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-90028384-1c97-43dd-a6cf-5891103ab954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:00.868050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-1e983320-e7c9-46b2-a1c9-afada2560bef None None] MFA Rules not processed for user `b35535c6b1c74a0baf58c8ccdbf30772`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:00.872176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-1e983320-e7c9-46b2-a1c9-afada2560bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:00.914441 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1055/2099] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:00.976684 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90028384-1c97-43dd-a6cf-5891103ab954 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:00.978711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-90028384-1c97-43dd-a6cf-5891103ab954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:00.981624 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1045/2100] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:01.002583 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e983320-e7c9-46b2-a1c9-afada2560bef None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:01.006867 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:01.073955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90028384-1c97-43dd-a6cf-5891103ab954 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:01.077819 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5d672-76bf-4528-b5d1-6c2f4a6f6ce1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:01.078533 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5d672-76bf-4528-b5d1-6c2f4a6f6ce1 service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:01.079464 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5d672-76bf-4528-b5d1-6c2f4a6f6ce1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:01.079746 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5d672-76bf-4528-b5d1-6c2f4a6f6ce1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:01.089694 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5d672-76bf-4528-b5d1-6c2f4a6f6ce1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:01.091165 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5d672-76bf-4528-b5d1-6c2f4a6f6ce1 service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:01.097164 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e983320-e7c9-46b2-a1c9-afada2560bef None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:01.101355 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc24939-9da5-4e81-9cdf-470b52b1134e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:01.102009 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc24939-9da5-4e81-9cdf-470b52b1134e service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:01.102307 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc24939-9da5-4e81-9cdf-470b52b1134e service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:01.102574 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc24939-9da5-4e81-9cdf-470b52b1134e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:01.104753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1056/2101] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:40:01.119358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc24939-9da5-4e81-9cdf-470b52b1134e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:01.119472 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5d672-76bf-4528-b5d1-6c2f4a6f6ce1 service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:01.120800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc24939-9da5-4e81-9cdf-470b52b1134e service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:01.133352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1046/2102] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:01.188949 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5d672-76bf-4528-b5d1-6c2f4a6f6ce1 service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:01.195766 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62b653-8d3d-4d28-97a3-843142427e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:01.196649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62b653-8d3d-4d28-97a3-843142427e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:01.196945 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62b653-8d3d-4d28-97a3-843142427e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:01.197195 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62b653-8d3d-4d28-97a3-843142427e22 admin admin] PATH_INFO: `/v3/users/714c81768d634946962f6d45d4444342` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:01.198575 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62b653-8d3d-4d28-97a3-843142427e22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=714c81768d634946962f6d45d4444342)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:01.201191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62b653-8d3d-4d28-97a3-843142427e22 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:01.256523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc24939-9da5-4e81-9cdf-470b52b1134e service cinder] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:01.258135 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-bcc24939-9da5-4e81-9cdf-470b52b1134e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:01.274673 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-fc62b653-8d3d-4d28-97a3-843142427e22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '714c81768d634946962f6d45d4444342'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:01.275388 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-fc62b653-8d3d-4d28-97a3-843142427e22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '714c81768d634946962f6d45d4444342'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:01.277096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc24939-9da5-4e81-9cdf-470b52b1134e service cinder] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:01.283845 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9feaea3-e518-499e-8765-bbfed005cf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:01.284063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-fc62b653-8d3d-4d28-97a3-843142427e22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '714c81768d634946962f6d45d4444342'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:01.284754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-fc62b653-8d3d-4d28-97a3-843142427e22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '714c81768d634946962f6d45d4444342'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:01.285443 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9feaea3-e518-499e-8765-bbfed005cf82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:01.285833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9feaea3-e518-499e-8765-bbfed005cf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:01.286295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9feaea3-e518-499e-8765-bbfed005cf82 admin admin] PATH_INFO: `/v3/users/3bc890292fc249888c0443d44f30c278` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:01.288222 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9feaea3-e518-499e-8765-bbfed005cf82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bc890292fc249888c0443d44f30c278)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:01.290451 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9feaea3-e518-499e-8765-bbfed005cf82 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:01.300130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-fc62b653-8d3d-4d28-97a3-843142427e22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '714c81768d634946962f6d45d4444342'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:01.319904 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1057/2103] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:40:01 2022] DELETE /identity/v3/users/714c81768d634946962f6d45d4444342 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:40:01.324903 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b1567-4f87-416e-90ae-69840e3f48a1 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:01.325196 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b1567-4f87-416e-90ae-69840e3f48a1 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:01.325500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b1567-4f87-416e-90ae-69840e3f48a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:01.352259 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-439b1567-4f87-416e-90ae-69840e3f48a1 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:01.353927 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-439b1567-4f87-416e-90ae-69840e3f48a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:01.360620 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f9feaea3-e518-499e-8765-bbfed005cf82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bc890292fc249888c0443d44f30c278'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:01.370462 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f9feaea3-e518-499e-8765-bbfed005cf82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bc890292fc249888c0443d44f30c278'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:01.372174 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f9feaea3-e518-499e-8765-bbfed005cf82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bc890292fc249888c0443d44f30c278'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:01.373920 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:01.390562 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f9feaea3-e518-499e-8765-bbfed005cf82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bc890292fc249888c0443d44f30c278'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:01.401535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f9feaea3-e518-499e-8765-bbfed005cf82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bc890292fc249888c0443d44f30c278'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:01.404368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:01.415504 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1047/2104] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:40:01 2022] DELETE /identity/v3/users/3bc890292fc249888c0443d44f30c278 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:40:01.418826 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982d3cf-5c06-4577-a0ba-18da5f149dc3 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:01.419267 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982d3cf-5c06-4577-a0ba-18da5f149dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:01.419685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982d3cf-5c06-4577-a0ba-18da5f149dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:01.444899 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-0982d3cf-5c06-4577-a0ba-18da5f149dc3 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:01.446865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-0982d3cf-5c06-4577-a0ba-18da5f149dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:01.451077 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1058/2105] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:40:01.460439 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b1567-4f87-416e-90ae-69840e3f48a1 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:01.461917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-439b1567-4f87-416e-90ae-69840e3f48a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:01.566775 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1048/2106] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:01.587491 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982d3cf-5c06-4577-a0ba-18da5f149dc3 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:01.589115 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-0982d3cf-5c06-4577-a0ba-18da5f149dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:01.618539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b1567-4f87-416e-90ae-69840e3f48a1 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:01.684374 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982d3cf-5c06-4577-a0ba-18da5f149dc3 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:01.688379 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971eb187-d208-4f49-9272-7416f8ef980c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:01.689068 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971eb187-d208-4f49-9272-7416f8ef980c service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:01.689359 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971eb187-d208-4f49-9272-7416f8ef980c service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:01.689705 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971eb187-d208-4f49-9272-7416f8ef980c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:01.696801 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e2993-7c84-4b43-8c4e-4272eae3c7b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:01.698457 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e2993-7c84-4b43-8c4e-4272eae3c7b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:01.698982 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e2993-7c84-4b43-8c4e-4272eae3c7b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:01.699510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e2993-7c84-4b43-8c4e-4272eae3c7b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:01.701298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971eb187-d208-4f49-9272-7416f8ef980c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:01.702260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971eb187-d208-4f49-9272-7416f8ef980c service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:01.711077 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e2993-7c84-4b43-8c4e-4272eae3c7b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:01.713434 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e2993-7c84-4b43-8c4e-4272eae3c7b3 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:01.722510 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1049/2107] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:40:01.727356 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1059/2108] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:02.226568 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e2993-7c84-4b43-8c4e-4272eae3c7b3 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:02.229106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-028e2993-7c84-4b43-8c4e-4272eae3c7b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:02.245467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971eb187-d208-4f49-9272-7416f8ef980c service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:02.247877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-971eb187-d208-4f49-9272-7416f8ef980c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:02.258988 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e2993-7c84-4b43-8c4e-4272eae3c7b3 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:02.264372 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83e18a-c5e7-44e5-9111-527b3040300f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:02.265363 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83e18a-c5e7-44e5-9111-527b3040300f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:02.265895 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83e18a-c5e7-44e5-9111-527b3040300f admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:02.266928 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83e18a-c5e7-44e5-9111-527b3040300f admin admin] PATH_INFO: `/v3/projects/dd7e2da02b0744418dae62d03b3c5fda` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:02.268297 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83e18a-c5e7-44e5-9111-527b3040300f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd7e2da02b0744418dae62d03b3c5fda)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:02.270368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83e18a-c5e7-44e5-9111-527b3040300f admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:02.276444 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971eb187-d208-4f49-9272-7416f8ef980c service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:02.291346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752d600-8f65-4b1a-964d-77da61fd1e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:02.292207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752d600-8f65-4b1a-964d-77da61fd1e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:02.292490 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752d600-8f65-4b1a-964d-77da61fd1e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:02.292769 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752d600-8f65-4b1a-964d-77da61fd1e19 admin admin] PATH_INFO: `/v3/projects/66f3f54ee34b4d579246d142730b5ae7` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:02.297127 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752d600-8f65-4b1a-964d-77da61fd1e19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66f3f54ee34b4d579246d142730b5ae7)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:02.299214 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752d600-8f65-4b1a-964d-77da61fd1e19 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:02.335922 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0f83e18a-c5e7-44e5-9111-527b3040300f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd7e2da02b0744418dae62d03b3c5fda', 'request_id': 'req-0f83e18a-c5e7-44e5-9111-527b3040300f'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:02.344311 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0f83e18a-c5e7-44e5-9111-527b3040300f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd7e2da02b0744418dae62d03b3c5fda', 'request_id': 'req-0f83e18a-c5e7-44e5-9111-527b3040300f'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:02.352513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0f83e18a-c5e7-44e5-9111-527b3040300f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd7e2da02b0744418dae62d03b3c5fda', 'request_id': 'req-0f83e18a-c5e7-44e5-9111-527b3040300f'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:02.370745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0f83e18a-c5e7-44e5-9111-527b3040300f admin admin] The token cache is being invalidate because project dd7e2da02b0744418dae62d03b3c5fda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:02.371344 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0f83e18a-c5e7-44e5-9111-527b3040300f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:02.372004 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0f83e18a-c5e7-44e5-9111-527b3040300f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:02.376689 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1060/2109] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:40:02 2022] DELETE /identity/v3/projects/dd7e2da02b0744418dae62d03b3c5fda => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:02.377711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83e18a-c5e7-44e5-9111-527b3040300f admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:02.379606 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-0f83e18a-c5e7-44e5-9111-527b3040300f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:02.380155 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f752d600-8f65-4b1a-964d-77da61fd1e19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66f3f54ee34b4d579246d142730b5ae7', 'request_id': 'req-f752d600-8f65-4b1a-964d-77da61fd1e19'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:02.388851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f752d600-8f65-4b1a-964d-77da61fd1e19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66f3f54ee34b4d579246d142730b5ae7', 'request_id': 'req-f752d600-8f65-4b1a-964d-77da61fd1e19'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:02.397793 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f752d600-8f65-4b1a-964d-77da61fd1e19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66f3f54ee34b4d579246d142730b5ae7', 'request_id': 'req-f752d600-8f65-4b1a-964d-77da61fd1e19'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:02.410344 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:02.414029 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:02.419600 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f752d600-8f65-4b1a-964d-77da61fd1e19 admin admin] The token cache is being invalidate because project 66f3f54ee34b4d579246d142730b5ae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:02.419948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f752d600-8f65-4b1a-964d-77da61fd1e19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:02.421334 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f752d600-8f65-4b1a-964d-77da61fd1e19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:02.423571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1050/2110] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:40:02 2022] DELETE /identity/v3/projects/66f3f54ee34b4d579246d142730b5ae7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:40:02.430110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596f53b-54dd-4dda-86e5-bf72ca4d40a7 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:02.430399 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596f53b-54dd-4dda-86e5-bf72ca4d40a7 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:02.431532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596f53b-54dd-4dda-86e5-bf72ca4d40a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:02.453142 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-a596f53b-54dd-4dda-86e5-bf72ca4d40a7 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:02.455404 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-a596f53b-54dd-4dda-86e5-bf72ca4d40a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:02.463095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83e18a-c5e7-44e5-9111-527b3040300f admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:02.523987 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb51782-72b0-4f95-8922-78b5d9b06955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:02.524869 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb51782-72b0-4f95-8922-78b5d9b06955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:02.525149 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb51782-72b0-4f95-8922-78b5d9b06955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:02.525421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb51782-72b0-4f95-8922-78b5d9b06955 admin admin] PATH_INFO: `/v3/users/b2c5df5d75604213959534db3a3abf77` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:02.526631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb51782-72b0-4f95-8922-78b5d9b06955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2c5df5d75604213959534db3a3abf77)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:02.530000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb51782-72b0-4f95-8922-78b5d9b06955 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:02.543553 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1051/2111] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:02.544963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef627c-53d3-4485-8b04-9377a5c95ba4 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:02.545277 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef627c-53d3-4485-8b04-9377a5c95ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:02.545522 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef627c-53d3-4485-8b04-9377a5c95ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:02.570386 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-e4ef627c-53d3-4485-8b04-9377a5c95ba4 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:02.571734 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e4ef627c-53d3-4485-8b04-9377a5c95ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:02.590882 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1052/2112] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:02.592044 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef627c-53d3-4485-8b04-9377a5c95ba4 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:02.604966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef627c-53d3-4485-8b04-9377a5c95ba4 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:02.616673 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d001aed-0253-42fc-b441-937107c75fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:02.617458 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d001aed-0253-42fc-b441-937107c75fdd admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:02.617793 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d001aed-0253-42fc-b441-937107c75fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:02.618267 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d001aed-0253-42fc-b441-937107c75fdd admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:02.619010 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d001aed-0253-42fc-b441-937107c75fdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:40:02.619361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d001aed-0253-42fc-b441-937107c75fdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:02.621362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d001aed-0253-42fc-b441-937107c75fdd admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:02.622801 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6cb51782-72b0-4f95-8922-78b5d9b06955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2c5df5d75604213959534db3a3abf77'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:02.624427 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6cb51782-72b0-4f95-8922-78b5d9b06955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2c5df5d75604213959534db3a3abf77'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:02.649661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1053/2113] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:40:02.650029 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6cb51782-72b0-4f95-8922-78b5d9b06955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2c5df5d75604213959534db3a3abf77'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:02.650626 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6cb51782-72b0-4f95-8922-78b5d9b06955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2c5df5d75604213959534db3a3abf77'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:02.664991 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d001aed-0253-42fc-b441-937107c75fdd admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:02.667631 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-7d001aed-0253-42fc-b441-937107c75fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:02.682671 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6cb51782-72b0-4f95-8922-78b5d9b06955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2c5df5d75604213959534db3a3abf77'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:02.685786 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d001aed-0253-42fc-b441-937107c75fdd admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:02.694772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7dd660-bc87-4f72-8ddb-e2abdcf9c378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:02.696084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dd660-bc87-4f72-8ddb-e2abdcf9c378 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:02.696520 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dd660-bc87-4f72-8ddb-e2abdcf9c378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:02.697568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dd660-bc87-4f72-8ddb-e2abdcf9c378 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:02.699599 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7dd660-bc87-4f72-8ddb-e2abdcf9c378 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:02.702780 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7dd660-bc87-4f72-8ddb-e2abdcf9c378 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:02.710669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1061/2114] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:40:02 2022] DELETE /identity/v3/users/b2c5df5d75604213959534db3a3abf77 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:02.744104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1054/2115] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:40:02 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:02.748012 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb51782-72b0-4f95-8922-78b5d9b06955 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:02.820381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:02.841927 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb51782-72b0-4f95-8922-78b5d9b06955 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:02.921449 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53402393-b944-499d-a029-dac718c4c369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:02.922152 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53402393-b944-499d-a029-dac718c4c369 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:02.923051 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53402393-b944-499d-a029-dac718c4c369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:02.924101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53402393-b944-499d-a029-dac718c4c369 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:02.925410 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53402393-b944-499d-a029-dac718c4c369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:02.929825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53402393-b944-499d-a029-dac718c4c369 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:02.960808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1062/2116] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:40:02 2022] POST /identity/v3/users => generated 288 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:40:02.962030 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7dd660-bc87-4f72-8ddb-e2abdcf9c378 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:02.977510 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7dd660-bc87-4f72-8ddb-e2abdcf9c378 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:02.983331 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9deb6-f295-4df3-bcff-040bdbe84e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:02.984053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9deb6-f295-4df3-bcff-040bdbe84e59 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:02.984342 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9deb6-f295-4df3-bcff-040bdbe84e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:02.984652 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9deb6-f295-4df3-bcff-040bdbe84e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:02.986293 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9deb6-f295-4df3-bcff-040bdbe84e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:02.990145 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9deb6-f295-4df3-bcff-040bdbe84e59 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:03.001391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1055/2117] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:03.006621 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53402393-b944-499d-a029-dac718c4c369 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:03.028412 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53402393-b944-499d-a029-dac718c4c369 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:03.039376 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd9dad-77cb-4d92-b39a-fa9ccfb0b6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:03.040885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd9dad-77cb-4d92-b39a-fa9ccfb0b6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:03.041235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd9dad-77cb-4d92-b39a-fa9ccfb0b6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:03.041638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd9dad-77cb-4d92-b39a-fa9ccfb0b6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:03.043250 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd9dad-77cb-4d92-b39a-fa9ccfb0b6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:03.044968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd9dad-77cb-4d92-b39a-fa9ccfb0b6f9 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:03.059431 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1063/2118] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:03.060657 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9deb6-f295-4df3-bcff-040bdbe84e59 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:03.071779 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9deb6-f295-4df3-bcff-040bdbe84e59 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:03.077277 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39bec6-af40-4738-b0b5-88cdd375eeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:03.078211 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39bec6-af40-4738-b0b5-88cdd375eeb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:03.078490 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39bec6-af40-4738-b0b5-88cdd375eeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:03.079346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39bec6-af40-4738-b0b5-88cdd375eeb6 admin admin] PATH_INFO: `/v3/projects/2566ca6b7046431c9c093a02ebe5a03a/users/da53c3fd11cc49d79e0a08f4c1fd483a/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:03.096037 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39bec6-af40-4738-b0b5-88cdd375eeb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2566ca6b7046431c9c093a02ebe5a03a, user_id=da53c3fd11cc49d79e0a08f4c1fd483a, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:03.099081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39bec6-af40-4738-b0b5-88cdd375eeb6 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:03.116125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1056/2119] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:03 2022] PUT /identity/v3/projects/2566ca6b7046431c9c093a02ebe5a03a/users/da53c3fd11cc49d79e0a08f4c1fd483a/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:03.128085 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1b2f3-271a-4a10-858d-90d7595bc452 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:03.128395 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1b2f3-271a-4a10-858d-90d7595bc452 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:03.128665 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1b2f3-271a-4a10-858d-90d7595bc452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:03.158818 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-66a1b2f3-271a-4a10-858d-90d7595bc452 None None] MFA Rules not processed for user `da53c3fd11cc49d79e0a08f4c1fd483a`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:03.160223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-66a1b2f3-271a-4a10-858d-90d7595bc452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:03.161899 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39bec6-af40-4738-b0b5-88cdd375eeb6 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:03.163595 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-0d39bec6-af40-4738-b0b5-88cdd375eeb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:03.242854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1064/2120] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:03.254180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1b2f3-271a-4a10-858d-90d7595bc452 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:03.255859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-66a1b2f3-271a-4a10-858d-90d7595bc452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:03.279871 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39bec6-af40-4738-b0b5-88cdd375eeb6 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:03.288211 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f312d4-2d69-47c7-8d15-88da9ab4ac87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:03.288989 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f312d4-2d69-47c7-8d15-88da9ab4ac87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:03.289297 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f312d4-2d69-47c7-8d15-88da9ab4ac87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:03.289643 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f312d4-2d69-47c7-8d15-88da9ab4ac87 admin admin] PATH_INFO: `/v3/projects/731ab09764ad4bacaf4689b5d819ac9c` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:03.293690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f312d4-2d69-47c7-8d15-88da9ab4ac87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=731ab09764ad4bacaf4689b5d819ac9c)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:03.296826 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f312d4-2d69-47c7-8d15-88da9ab4ac87 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:03.345329 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:03.387211 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-13f312d4-2d69-47c7-8d15-88da9ab4ac87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '731ab09764ad4bacaf4689b5d819ac9c', 'request_id': 'req-13f312d4-2d69-47c7-8d15-88da9ab4ac87'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:03.390903 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1b2f3-271a-4a10-858d-90d7595bc452 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:03.401760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-13f312d4-2d69-47c7-8d15-88da9ab4ac87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '731ab09764ad4bacaf4689b5d819ac9c', 'request_id': 'req-13f312d4-2d69-47c7-8d15-88da9ab4ac87'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:03.412153 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-13f312d4-2d69-47c7-8d15-88da9ab4ac87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '731ab09764ad4bacaf4689b5d819ac9c', 'request_id': 'req-13f312d4-2d69-47c7-8d15-88da9ab4ac87'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:03.414894 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:03.433565 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-13f312d4-2d69-47c7-8d15-88da9ab4ac87 admin admin] The token cache is being invalidate because project 731ab09764ad4bacaf4689b5d819ac9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:03.434055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-13f312d4-2d69-47c7-8d15-88da9ab4ac87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:03.434735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-13f312d4-2d69-47c7-8d15-88da9ab4ac87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:03.436362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1057/2121] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:40:03 2022] DELETE /identity/v3/projects/731ab09764ad4bacaf4689b5d819ac9c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:03.442742 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc8ab9-9a8a-4b93-b6aa-8777631ebf0a None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:03.443556 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc8ab9-9a8a-4b93-b6aa-8777631ebf0a None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:03.444595 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc8ab9-9a8a-4b93-b6aa-8777631ebf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:03.463055 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496ee7d-bc50-4de2-bd3f-6e6471c931f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:03.463737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496ee7d-bc50-4de2-bd3f-6e6471c931f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:03.464018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496ee7d-bc50-4de2-bd3f-6e6471c931f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:03.464308 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496ee7d-bc50-4de2-bd3f-6e6471c931f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:03.466153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-8496ee7d-bc50-4de2-bd3f-6e6471c931f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:03.486542 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-27dc8ab9-9a8a-4b93-b6aa-8777631ebf0a None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:03.492815 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-27dc8ab9-9a8a-4b93-b6aa-8777631ebf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:03.564384 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496ee7d-bc50-4de2-bd3f-6e6471c931f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:03.565896 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496ee7d-bc50-4de2-bd3f-6e6471c931f8 service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:03.576394 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1065/2122] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:40:03.603311 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1058/2123] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:03.612950 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4aae3d-a8e9-412f-bf71-2227cd69e9e4 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:03.613281 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4aae3d-a8e9-412f-bf71-2227cd69e9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:03.613882 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4aae3d-a8e9-412f-bf71-2227cd69e9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:03.637726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-ae4aae3d-a8e9-412f-bf71-2227cd69e9e4 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:03.639039 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-ae4aae3d-a8e9-412f-bf71-2227cd69e9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:03.650560 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1066/2124] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:40:03.653721 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc8ab9-9a8a-4b93-b6aa-8777631ebf0a None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:03.670707 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc8ab9-9a8a-4b93-b6aa-8777631ebf0a None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:03.679171 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179e5f7-7db1-47a4-b0aa-da854a1b78f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:03.680121 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179e5f7-7db1-47a4-b0aa-da854a1b78f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:03.680551 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179e5f7-7db1-47a4-b0aa-da854a1b78f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:03.680969 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179e5f7-7db1-47a4-b0aa-da854a1b78f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:03.681848 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179e5f7-7db1-47a4-b0aa-da854a1b78f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:40:03.682319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179e5f7-7db1-47a4-b0aa-da854a1b78f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:03.684125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179e5f7-7db1-47a4-b0aa-da854a1b78f8 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:03.704129 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1059/2125] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:40:03.704906 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4aae3d-a8e9-412f-bf71-2227cd69e9e4 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:03.715066 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4aae3d-a8e9-412f-bf71-2227cd69e9e4 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:03.721197 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471b2fd-ad85-4e38-88f2-ae81fc67f67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:03.721879 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471b2fd-ad85-4e38-88f2-ae81fc67f67b admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:03.722161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471b2fd-ad85-4e38-88f2-ae81fc67f67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:03.722436 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471b2fd-ad85-4e38-88f2-ae81fc67f67b admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:03.723530 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6471b2fd-ad85-4e38-88f2-ae81fc67f67b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:03.725592 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6471b2fd-ad85-4e38-88f2-ae81fc67f67b admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:03.765009 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1067/2126] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:40:03 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:40:03.769995 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179e5f7-7db1-47a4-b0aa-da854a1b78f8 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:03.783852 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179e5f7-7db1-47a4-b0aa-da854a1b78f8 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:03.861400 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68798824-c849-4377-8262-b0a84da980c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:03.863052 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68798824-c849-4377-8262-b0a84da980c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:03.863702 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68798824-c849-4377-8262-b0a84da980c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:03.864053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68798824-c849-4377-8262-b0a84da980c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:03.864826 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68798824-c849-4377-8262-b0a84da980c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:03.866860 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68798824-c849-4377-8262-b0a84da980c6 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:03.923991 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1060/2127] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:40:03 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:03.929565 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471b2fd-ad85-4e38-88f2-ae81fc67f67b admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:03.943803 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471b2fd-ad85-4e38-88f2-ae81fc67f67b admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:03.951123 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06168eb5-3d4f-4cbd-aec3-db9eaab58cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:03.952049 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06168eb5-3d4f-4cbd-aec3-db9eaab58cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:03.952834 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06168eb5-3d4f-4cbd-aec3-db9eaab58cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:03.953331 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06168eb5-3d4f-4cbd-aec3-db9eaab58cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:03.955237 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06168eb5-3d4f-4cbd-aec3-db9eaab58cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:03.957125 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06168eb5-3d4f-4cbd-aec3-db9eaab58cb4 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:03.972081 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1068/2128] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:03.987789 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68798824-c849-4377-8262-b0a84da980c6 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:03.997688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7d0d7-6cfa-4436-ab4c-59c05ca501cf None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:03.997860 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7d0d7-6cfa-4436-ab4c-59c05ca501cf None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:03.998227 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7d0d7-6cfa-4436-ab4c-59c05ca501cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:04.002477 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68798824-c849-4377-8262-b0a84da980c6 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:04.015763 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef428b7-2fd2-4735-af2a-70c6d7127306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:04.017352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef428b7-2fd2-4735-af2a-70c6d7127306 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:04.017746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef428b7-2fd2-4735-af2a-70c6d7127306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:04.018310 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef428b7-2fd2-4735-af2a-70c6d7127306 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:04.019235 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef428b7-2fd2-4735-af2a-70c6d7127306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:04.022196 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef428b7-2fd2-4735-af2a-70c6d7127306 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:04.036597 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-f1e7d0d7-6cfa-4436-ab4c-59c05ca501cf None None] MFA Rules not processed for user `b35535c6b1c74a0baf58c8ccdbf30772`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:04.043892 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f1e7d0d7-6cfa-4436-ab4c-59c05ca501cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:04.054321 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1061/2129] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:04.055508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef428b7-2fd2-4735-af2a-70c6d7127306 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:04.076311 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef428b7-2fd2-4735-af2a-70c6d7127306 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:04.081894 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f239615-538d-4957-8390-79a31e2e3bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:04.082797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f239615-538d-4957-8390-79a31e2e3bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:04.083085 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f239615-538d-4957-8390-79a31e2e3bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:04.083457 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f239615-538d-4957-8390-79a31e2e3bd5 admin admin] PATH_INFO: `/v3/projects/2e1044cf8f9c4c6d8782bf339540b7fc/users/76cd7aeb9dc74797b30707b140444bf2/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:04.124214 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f239615-538d-4957-8390-79a31e2e3bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1044cf8f9c4c6d8782bf339540b7fc, user_id=76cd7aeb9dc74797b30707b140444bf2, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:04.126992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f239615-538d-4957-8390-79a31e2e3bd5 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:04.132653 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:04.150574 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1062/2130] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:04 2022] PUT /identity/v3/projects/2e1044cf8f9c4c6d8782bf339540b7fc/users/76cd7aeb9dc74797b30707b140444bf2/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:04.153174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1069/2131] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:04.174067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4adba2-dbb6-414d-87ba-7e6a752e3c3b None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:04.176044 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4adba2-dbb6-414d-87ba-7e6a752e3c3b None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:04.176798 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4adba2-dbb6-414d-87ba-7e6a752e3c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:04.245205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-fa4adba2-dbb6-414d-87ba-7e6a752e3c3b None None] MFA Rules not processed for user `76cd7aeb9dc74797b30707b140444bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:04.246889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-fa4adba2-dbb6-414d-87ba-7e6a752e3c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:04.336553 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1063/2132] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:04.341175 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7d0d7-6cfa-4436-ab4c-59c05ca501cf None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:04.353563 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7d0d7-6cfa-4436-ab4c-59c05ca501cf None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:04.388891 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:04.416434 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9df4cd-26a3-4b84-b419-8afda5ccda64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:04.417112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9df4cd-26a3-4b84-b419-8afda5ccda64 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:04.417394 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9df4cd-26a3-4b84-b419-8afda5ccda64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:04.417672 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9df4cd-26a3-4b84-b419-8afda5ccda64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:04.419136 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9df4cd-26a3-4b84-b419-8afda5ccda64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:04.423590 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9df4cd-26a3-4b84-b419-8afda5ccda64 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:04.457477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1070/2133] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:40:04 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:04.462111 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4adba2-dbb6-414d-87ba-7e6a752e3c3b None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:04.484375 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4adba2-dbb6-414d-87ba-7e6a752e3c3b None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:04.556409 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226993f7-02e4-49f9-8260-f0f55a9967d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:04.557091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226993f7-02e4-49f9-8260-f0f55a9967d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:04.557373 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226993f7-02e4-49f9-8260-f0f55a9967d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:04.557647 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226993f7-02e4-49f9-8260-f0f55a9967d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:04.558366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226993f7-02e4-49f9-8260-f0f55a9967d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:04.560345 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226993f7-02e4-49f9-8260-f0f55a9967d5 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:04.586578 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1064/2134] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:40:04 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:40:04.592493 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9df4cd-26a3-4b84-b419-8afda5ccda64 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:04.613810 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9df4cd-26a3-4b84-b419-8afda5ccda64 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:04.620407 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fb6f7-6a35-4ce7-b472-9d0e37da4fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:04.621050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fb6f7-6a35-4ce7-b472-9d0e37da4fcc admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:04.621340 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fb6f7-6a35-4ce7-b472-9d0e37da4fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:04.621633 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fb6f7-6a35-4ce7-b472-9d0e37da4fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:04.622393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fb6f7-6a35-4ce7-b472-9d0e37da4fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:04.624059 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fb6f7-6a35-4ce7-b472-9d0e37da4fcc admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:04.644212 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1071/2135] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:04.648811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226993f7-02e4-49f9-8260-f0f55a9967d5 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:04.659919 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226993f7-02e4-49f9-8260-f0f55a9967d5 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:04.665450 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8881a-62b7-4549-a467-ed6738a9c3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:04.666169 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8881a-62b7-4549-a467-ed6738a9c3ac admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:04.666458 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8881a-62b7-4549-a467-ed6738a9c3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:04.666732 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8881a-62b7-4549-a467-ed6738a9c3ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:04.667486 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8881a-62b7-4549-a467-ed6738a9c3ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:04.669815 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8881a-62b7-4549-a467-ed6738a9c3ac admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:04.683314 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1065/2136] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:04.685697 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fb6f7-6a35-4ce7-b472-9d0e37da4fcc admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:04.697378 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fb6f7-6a35-4ce7-b472-9d0e37da4fcc admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:04.703178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f772c-7ef7-4dd8-b827-704dfed0a825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:04.704232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f772c-7ef7-4dd8-b827-704dfed0a825 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:04.704587 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f772c-7ef7-4dd8-b827-704dfed0a825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:04.705191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f772c-7ef7-4dd8-b827-704dfed0a825 admin admin] PATH_INFO: `/v3/projects/6d6fa53242b94e2180b83d95a210b671/users/7ddd449af10c4b488b1bf386ac4cc1bb/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:04.726079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f772c-7ef7-4dd8-b827-704dfed0a825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d6fa53242b94e2180b83d95a210b671, user_id=7ddd449af10c4b488b1bf386ac4cc1bb, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:04.729929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f772c-7ef7-4dd8-b827-704dfed0a825 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:04.746746 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1072/2137] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:04 2022] PUT /identity/v3/projects/6d6fa53242b94e2180b83d95a210b671/users/7ddd449af10c4b488b1bf386ac4cc1bb/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:04.757236 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18537cfe-afb3-463b-adaa-d2cbc468418b None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:04.757687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18537cfe-afb3-463b-adaa-d2cbc468418b None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:04.757913 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18537cfe-afb3-463b-adaa-d2cbc468418b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:04.802816 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-18537cfe-afb3-463b-adaa-d2cbc468418b None None] MFA Rules not processed for user `7ddd449af10c4b488b1bf386ac4cc1bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:04.804378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-18537cfe-afb3-463b-adaa-d2cbc468418b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:04.941050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:04.974665 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1066/2138] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:04.979068 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f772c-7ef7-4dd8-b827-704dfed0a825 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:05.118852 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f772c-7ef7-4dd8-b827-704dfed0a825 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:05.128462 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512af43d-ecdf-44b7-981c-8c5f25f0822f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:05.129149 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512af43d-ecdf-44b7-981c-8c5f25f0822f admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:05.129433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512af43d-ecdf-44b7-981c-8c5f25f0822f admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:05.129727 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512af43d-ecdf-44b7-981c-8c5f25f0822f admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:05.132619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512af43d-ecdf-44b7-981c-8c5f25f0822f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:05.135876 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512af43d-ecdf-44b7-981c-8c5f25f0822f admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:05.207184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1073/2139] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:40:04 2022] POST /identity/v3/projects => generated 377 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:05.207841 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18537cfe-afb3-463b-adaa-d2cbc468418b None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:05.223226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18537cfe-afb3-463b-adaa-d2cbc468418b None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:05.323646 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d474472-894a-4857-b0f8-88610a74b51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:05.324751 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d474472-894a-4857-b0f8-88610a74b51e admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:05.325218 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d474472-894a-4857-b0f8-88610a74b51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:05.325774 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d474472-894a-4857-b0f8-88610a74b51e admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:05.338093 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d474472-894a-4857-b0f8-88610a74b51e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:05.340360 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d474472-894a-4857-b0f8-88610a74b51e admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:05.388255 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1067/2140] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:40:05 2022] POST /identity/v3/users => generated 295 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:05.390839 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512af43d-ecdf-44b7-981c-8c5f25f0822f admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:05.407937 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512af43d-ecdf-44b7-981c-8c5f25f0822f admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:05.432228 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17f7d3-b6b4-4381-aa2e-c877286bfda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:05.434768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17f7d3-b6b4-4381-aa2e-c877286bfda0 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:05.435122 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17f7d3-b6b4-4381-aa2e-c877286bfda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:05.435476 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17f7d3-b6b4-4381-aa2e-c877286bfda0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:05.436241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17f7d3-b6b4-4381-aa2e-c877286bfda0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:05.439252 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17f7d3-b6b4-4381-aa2e-c877286bfda0 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:05.519206 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1074/2141] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:05.519404 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d474472-894a-4857-b0f8-88610a74b51e admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:05.542539 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d474472-894a-4857-b0f8-88610a74b51e admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:05.566356 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445f082-85d0-46fa-bca0-8d2af2cc961e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:05.567768 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445f082-85d0-46fa-bca0-8d2af2cc961e admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:05.573529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445f082-85d0-46fa-bca0-8d2af2cc961e admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:05.573835 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445f082-85d0-46fa-bca0-8d2af2cc961e admin admin] PATH_INFO: `/v3/projects/36c784cf9c364c0aad99ab283886a3bf/users/a03fc60d06514411982bc52b84e84515/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:05.639671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445f082-85d0-46fa-bca0-8d2af2cc961e admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c784cf9c364c0aad99ab283886a3bf, user_id=a03fc60d06514411982bc52b84e84515, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:05.643354 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445f082-85d0-46fa-bca0-8d2af2cc961e admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:05.677897 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1068/2142] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:05 2022] PUT /identity/v3/projects/36c784cf9c364c0aad99ab283886a3bf/users/a03fc60d06514411982bc52b84e84515/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:05.679881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17f7d3-b6b4-4381-aa2e-c877286bfda0 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:05.698971 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17f7d3-b6b4-4381-aa2e-c877286bfda0 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:05.884374 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9828ae-1886-42c8-8a9e-817da98810a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:05.885359 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9828ae-1886-42c8-8a9e-817da98810a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:05.885704 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9828ae-1886-42c8-8a9e-817da98810a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:05.886046 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9828ae-1886-42c8-8a9e-817da98810a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:05.886964 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9828ae-1886-42c8-8a9e-817da98810a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:05.888709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9828ae-1886-42c8-8a9e-817da98810a6 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:05.893961 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:05.931553 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445f082-85d0-46fa-bca0-8d2af2cc961e admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:05.932034 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1075/2143] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:05.948099 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445f082-85d0-46fa-bca0-8d2af2cc961e admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:05.955465 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c13d05-5c94-4bc8-807f-a27f537a9c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:05.956371 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c13d05-5c94-4bc8-807f-a27f537a9c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:05.956658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c13d05-5c94-4bc8-807f-a27f537a9c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:05.956931 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c13d05-5c94-4bc8-807f-a27f537a9c10 admin admin] PATH_INFO: `/v3/projects/36c784cf9c364c0aad99ab283886a3bf/users/a03fc60d06514411982bc52b84e84515/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:05.959074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c13d05-5c94-4bc8-807f-a27f537a9c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c784cf9c364c0aad99ab283886a3bf, user_id=a03fc60d06514411982bc52b84e84515, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:05.962461 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c13d05-5c94-4bc8-807f-a27f537a9c10 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:05.980145 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1069/2144] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:05 2022] PUT /identity/v3/projects/36c784cf9c364c0aad99ab283886a3bf/users/a03fc60d06514411982bc52b84e84515/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:40:05.991524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49121dda-2134-4b97-aeb5-a3b9564ebdd6 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:05.991946 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49121dda-2134-4b97-aeb5-a3b9564ebdd6 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:05.992331 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49121dda-2134-4b97-aeb5-a3b9564ebdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:06.045137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-49121dda-2134-4b97-aeb5-a3b9564ebdd6 None None] MFA Rules not processed for user `a03fc60d06514411982bc52b84e84515`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:06.046597 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-49121dda-2134-4b97-aeb5-a3b9564ebdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:06.196693 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1076/2145] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:06.230640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c13d05-5c94-4bc8-807f-a27f537a9c10 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:06.232581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-c5c13d05-5c94-4bc8-807f-a27f537a9c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:06.299718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c13d05-5c94-4bc8-807f-a27f537a9c10 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:06.307069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e9bb5-c43e-4730-8b86-ee1561e7d6fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:06.308040 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e9bb5-c43e-4730-8b86-ee1561e7d6fc service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:06.308510 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e9bb5-c43e-4730-8b86-ee1561e7d6fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:06.308993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e9bb5-c43e-4730-8b86-ee1561e7d6fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:06.407383 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e9bb5-c43e-4730-8b86-ee1561e7d6fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:06.409245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e9bb5-c43e-4730-8b86-ee1561e7d6fc service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:06.414458 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:06.420145 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1070/2146] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:07.386892 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49121dda-2134-4b97-aeb5-a3b9564ebdd6 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:07.388852 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-49121dda-2134-4b97-aeb5-a3b9564ebdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:07.476749 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49121dda-2134-4b97-aeb5-a3b9564ebdd6 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:07.481219 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff407352-d110-4ba7-8218-945b05538086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:07.482378 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff407352-d110-4ba7-8218-945b05538086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:07.482499 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff407352-d110-4ba7-8218-945b05538086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:07.482792 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff407352-d110-4ba7-8218-945b05538086 admin admin] PATH_INFO: `/v3/users/da53c3fd11cc49d79e0a08f4c1fd483a` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:07.484094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff407352-d110-4ba7-8218-945b05538086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da53c3fd11cc49d79e0a08f4c1fd483a)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:07.486694 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff407352-d110-4ba7-8218-945b05538086 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:07.547630 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ff407352-d110-4ba7-8218-945b05538086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da53c3fd11cc49d79e0a08f4c1fd483a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:07.548366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ff407352-d110-4ba7-8218-945b05538086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da53c3fd11cc49d79e0a08f4c1fd483a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:07.557392 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ff407352-d110-4ba7-8218-945b05538086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da53c3fd11cc49d79e0a08f4c1fd483a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:07.558176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ff407352-d110-4ba7-8218-945b05538086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da53c3fd11cc49d79e0a08f4c1fd483a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:07.573546 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ff407352-d110-4ba7-8218-945b05538086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da53c3fd11cc49d79e0a08f4c1fd483a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:07.590952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1077/2147] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:40:07 2022] DELETE /identity/v3/users/da53c3fd11cc49d79e0a08f4c1fd483a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:07.595525 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2fba2-fdd6-4d15-8cf0-ebeaef423eb3 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:07.596422 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2fba2-fdd6-4d15-8cf0-ebeaef423eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:07.596928 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2fba2-fdd6-4d15-8cf0-ebeaef423eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:07.617466 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-0cb2fba2-fdd6-4d15-8cf0-ebeaef423eb3 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:07.618591 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-0cb2fba2-fdd6-4d15-8cf0-ebeaef423eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:07.701434 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1071/2148] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:07.735334 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff407352-d110-4ba7-8218-945b05538086 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:07.737201 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-ff407352-d110-4ba7-8218-945b05538086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:07.743404 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:07.807948 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff407352-d110-4ba7-8218-945b05538086 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:07.811984 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254bc16-7fed-478d-bf91-df2da1cddea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:07.812880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254bc16-7fed-478d-bf91-df2da1cddea5 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:07.813341 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254bc16-7fed-478d-bf91-df2da1cddea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:07.813769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254bc16-7fed-478d-bf91-df2da1cddea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:07.835013 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a254bc16-7fed-478d-bf91-df2da1cddea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:07.836743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a254bc16-7fed-478d-bf91-df2da1cddea5 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:07.849153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1078/2149] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:40:08.383729 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2fba2-fdd6-4d15-8cf0-ebeaef423eb3 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:08.392498 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-0cb2fba2-fdd6-4d15-8cf0-ebeaef423eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:08.402299 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2fba2-fdd6-4d15-8cf0-ebeaef423eb3 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:08.406936 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f45f2-7a28-444c-b6ee-53eb73d6fb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:08.407825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f45f2-7a28-444c-b6ee-53eb73d6fb9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:08.408578 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f45f2-7a28-444c-b6ee-53eb73d6fb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:08.408860 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f45f2-7a28-444c-b6ee-53eb73d6fb9e admin admin] PATH_INFO: `/v3/projects/2566ca6b7046431c9c093a02ebe5a03a` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:08.410294 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f45f2-7a28-444c-b6ee-53eb73d6fb9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2566ca6b7046431c9c093a02ebe5a03a)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:08.412173 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f45f2-7a28-444c-b6ee-53eb73d6fb9e admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:08.485501 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-d05f45f2-7a28-444c-b6ee-53eb73d6fb9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2566ca6b7046431c9c093a02ebe5a03a', 'request_id': 'req-d05f45f2-7a28-444c-b6ee-53eb73d6fb9e'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:08.493445 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-d05f45f2-7a28-444c-b6ee-53eb73d6fb9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2566ca6b7046431c9c093a02ebe5a03a', 'request_id': 'req-d05f45f2-7a28-444c-b6ee-53eb73d6fb9e'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:08.499671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-d05f45f2-7a28-444c-b6ee-53eb73d6fb9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2566ca6b7046431c9c093a02ebe5a03a', 'request_id': 'req-d05f45f2-7a28-444c-b6ee-53eb73d6fb9e'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:08.511231 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-d05f45f2-7a28-444c-b6ee-53eb73d6fb9e admin admin] The token cache is being invalidate because project 2566ca6b7046431c9c093a02ebe5a03a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:08.511547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-d05f45f2-7a28-444c-b6ee-53eb73d6fb9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:08.512179 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-d05f45f2-7a28-444c-b6ee-53eb73d6fb9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:08.513731 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1072/2150] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:40:08 2022] DELETE /identity/v3/projects/2566ca6b7046431c9c093a02ebe5a03a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:08.518626 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecabf1-b00a-4c1c-803a-c8713d6a5e9f None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:08.519102 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecabf1-b00a-4c1c-803a-c8713d6a5e9f None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:08.519191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecabf1-b00a-4c1c-803a-c8713d6a5e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:08.537506 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-f6ecabf1-b00a-4c1c-803a-c8713d6a5e9f None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:08.538801 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f6ecabf1-b00a-4c1c-803a-c8713d6a5e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:08.602349 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1079/2151] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:08.610796 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3392c9d-2503-4173-86da-82f9cffc912c None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:08.611300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3392c9d-2503-4173-86da-82f9cffc912c None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:08.611422 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3392c9d-2503-4173-86da-82f9cffc912c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:08.630751 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-c3392c9d-2503-4173-86da-82f9cffc912c None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:08.632092 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-c3392c9d-2503-4173-86da-82f9cffc912c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:08.640807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1073/2152] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:08.645124 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecabf1-b00a-4c1c-803a-c8713d6a5e9f None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:08.658118 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecabf1-b00a-4c1c-803a-c8713d6a5e9f None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:08.663145 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559db310-a587-4000-9c21-ee0d8c6bd418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:08.664187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559db310-a587-4000-9c21-ee0d8c6bd418 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:08.664586 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559db310-a587-4000-9c21-ee0d8c6bd418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:08.664995 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559db310-a587-4000-9c21-ee0d8c6bd418 admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:08.665768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559db310-a587-4000-9c21-ee0d8c6bd418 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:40:08.666074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559db310-a587-4000-9c21-ee0d8c6bd418 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:08.667735 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559db310-a587-4000-9c21-ee0d8c6bd418 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:08.681252 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1080/2153] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:40:08.685717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3392c9d-2503-4173-86da-82f9cffc912c None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:08.694921 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3392c9d-2503-4173-86da-82f9cffc912c None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:08.699779 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9eb16-f9ba-4057-b044-36a3c68e73fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:08.700432 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9eb16-f9ba-4057-b044-36a3c68e73fb admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:08.700717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9eb16-f9ba-4057-b044-36a3c68e73fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:08.700991 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9eb16-f9ba-4057-b044-36a3c68e73fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:08.701688 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9eb16-f9ba-4057-b044-36a3c68e73fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:08.703670 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9eb16-f9ba-4057-b044-36a3c68e73fb admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:08.734236 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1074/2154] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:40:08 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:08.736476 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559db310-a587-4000-9c21-ee0d8c6bd418 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:08.749461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559db310-a587-4000-9c21-ee0d8c6bd418 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:08.810271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fc859-43ff-488b-b039-c1f703a6aa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:08.810948 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fc859-43ff-488b-b039-c1f703a6aa44 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:08.811229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fc859-43ff-488b-b039-c1f703a6aa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:08.811532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fc859-43ff-488b-b039-c1f703a6aa44 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:08.812323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fc859-43ff-488b-b039-c1f703a6aa44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:08.814869 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fc859-43ff-488b-b039-c1f703a6aa44 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:08.840776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1081/2155] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:40:08 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:40:08.842011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9eb16-f9ba-4057-b044-36a3c68e73fb admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:08.853941 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9eb16-f9ba-4057-b044-36a3c68e73fb admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:08.859605 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc016856-f7de-4beb-ac89-9501ed86abbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:08.860865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc016856-f7de-4beb-ac89-9501ed86abbf admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:08.861177 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc016856-f7de-4beb-ac89-9501ed86abbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:08.861457 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc016856-f7de-4beb-ac89-9501ed86abbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:08.862202 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc016856-f7de-4beb-ac89-9501ed86abbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:08.863871 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc016856-f7de-4beb-ac89-9501ed86abbf admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:08.876695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1075/2156] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:08.881370 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fc859-43ff-488b-b039-c1f703a6aa44 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:08.892975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fc859-43ff-488b-b039-c1f703a6aa44 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:08.900019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56c057-4ba0-45fb-bcd2-97aa9652a259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:08.900831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56c057-4ba0-45fb-bcd2-97aa9652a259 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:08.900956 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56c057-4ba0-45fb-bcd2-97aa9652a259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:08.901396 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56c057-4ba0-45fb-bcd2-97aa9652a259 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:08.902181 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56c057-4ba0-45fb-bcd2-97aa9652a259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:08.904106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56c057-4ba0-45fb-bcd2-97aa9652a259 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:08.918432 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1082/2157] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:08.923238 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc016856-f7de-4beb-ac89-9501ed86abbf admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:08.934175 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc016856-f7de-4beb-ac89-9501ed86abbf admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:08.940589 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b739a8-b31d-404f-b647-604b21615306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:08.941482 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b739a8-b31d-404f-b647-604b21615306 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:08.941773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b739a8-b31d-404f-b647-604b21615306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:08.942048 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b739a8-b31d-404f-b647-604b21615306 admin admin] PATH_INFO: `/v3/projects/fd5b7a3a6f5942b49b847f5d9ee9802a/users/52e6eb075ba742e68bab4ab79eb37e1d/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:08.958323 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b739a8-b31d-404f-b647-604b21615306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd5b7a3a6f5942b49b847f5d9ee9802a, user_id=52e6eb075ba742e68bab4ab79eb37e1d, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:08.961030 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b739a8-b31d-404f-b647-604b21615306 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:08.975716 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1076/2158] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:08 2022] PUT /identity/v3/projects/fd5b7a3a6f5942b49b847f5d9ee9802a/users/52e6eb075ba742e68bab4ab79eb37e1d/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:08.981090 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7640b23-fa67-4e49-87e1-9c230b5d50ae None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:08.981385 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7640b23-fa67-4e49-87e1-9c230b5d50ae None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:08.981664 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7640b23-fa67-4e49-87e1-9c230b5d50ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:09.001148 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-b7640b23-fa67-4e49-87e1-9c230b5d50ae None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:09.002036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-b7640b23-fa67-4e49-87e1-9c230b5d50ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:09.009268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:09.073895 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1083/2159] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:09.083959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b739a8-b31d-404f-b647-604b21615306 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:09.086079 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-44b739a8-b31d-404f-b647-604b21615306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:09.112764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:09.155656 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b739a8-b31d-404f-b647-604b21615306 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:09.160278 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714d3fa-f8f3-4eff-86f1-ecbd54ecabb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:09.160928 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714d3fa-f8f3-4eff-86f1-ecbd54ecabb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:09.161302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714d3fa-f8f3-4eff-86f1-ecbd54ecabb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:09.161463 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714d3fa-f8f3-4eff-86f1-ecbd54ecabb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:09.181272 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714d3fa-f8f3-4eff-86f1-ecbd54ecabb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:09.183079 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714d3fa-f8f3-4eff-86f1-ecbd54ecabb7 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:09.193471 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1077/2160] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:09.285394 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7640b23-fa67-4e49-87e1-9c230b5d50ae None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:09.287252 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-b7640b23-fa67-4e49-87e1-9c230b5d50ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:09.372364 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7640b23-fa67-4e49-87e1-9c230b5d50ae None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:09.378147 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f50f90-fa2e-48af-80f6-fbc4ed93709b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:09.378992 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f50f90-fa2e-48af-80f6-fbc4ed93709b service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:09.379406 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f50f90-fa2e-48af-80f6-fbc4ed93709b service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:09.380288 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f50f90-fa2e-48af-80f6-fbc4ed93709b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:09.382548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-85f50f90-fa2e-48af-80f6-fbc4ed93709b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:09.477894 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f50f90-fa2e-48af-80f6-fbc4ed93709b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:09.480266 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f50f90-fa2e-48af-80f6-fbc4ed93709b service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:09.496123 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1084/2161] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:10.257758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bbf1c-f6e7-454b-a477-c0233487752b None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:10.258222 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bbf1c-f6e7-454b-a477-c0233487752b None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:10.258383 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bbf1c-f6e7-454b-a477-c0233487752b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:10.279241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f50f90-fa2e-48af-80f6-fbc4ed93709b service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:10.290929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f50f90-fa2e-48af-80f6-fbc4ed93709b service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:10.300553 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-4d5bbf1c-f6e7-454b-a477-c0233487752b None None] MFA Rules not processed for user `52e6eb075ba742e68bab4ab79eb37e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:10.300835 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c4b36-e946-4b6f-9bc9-66eb271c163a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:10.301468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c4b36-e946-4b6f-9bc9-66eb271c163a service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:10.301750 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c4b36-e946-4b6f-9bc9-66eb271c163a service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:10.302030 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c4b36-e946-4b6f-9bc9-66eb271c163a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:10.303475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-4d5bbf1c-f6e7-454b-a477-c0233487752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:10.306766 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-3b6c4b36-e946-4b6f-9bc9-66eb271c163a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:10.449423 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c4b36-e946-4b6f-9bc9-66eb271c163a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:10.451074 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c4b36-e946-4b6f-9bc9-66eb271c163a service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:10.453018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1078/2162] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:10.460033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:10.474694 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1085/2163] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:10.506325 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bbf1c-f6e7-454b-a477-c0233487752b None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:10.508272 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-4d5bbf1c-f6e7-454b-a477-c0233487752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:10.522366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bbf1c-f6e7-454b-a477-c0233487752b None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:10.526649 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3695938-f20c-4876-96e2-bb996d16a323 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:10.527946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3695938-f20c-4876-96e2-bb996d16a323 service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:10.527946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3695938-f20c-4876-96e2-bb996d16a323 service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:10.528122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3695938-f20c-4876-96e2-bb996d16a323 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:10.538727 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3695938-f20c-4876-96e2-bb996d16a323 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:10.540216 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3695938-f20c-4876-96e2-bb996d16a323 service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:10.554486 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1079/2164] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:10.645208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c4b36-e946-4b6f-9bc9-66eb271c163a service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:10.646626 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-3b6c4b36-e946-4b6f-9bc9-66eb271c163a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:10.661091 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c4b36-e946-4b6f-9bc9-66eb271c163a service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:10.665743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b5d2b-99b1-4c82-8f6f-0660db52d519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:10.666653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b5d2b-99b1-4c82-8f6f-0660db52d519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:10.666939 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b5d2b-99b1-4c82-8f6f-0660db52d519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:10.667217 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b5d2b-99b1-4c82-8f6f-0660db52d519 admin admin] PATH_INFO: `/v3/users/f31b5e67d2ac4b80bf16a766a7f9f423` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:10.668456 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b5d2b-99b1-4c82-8f6f-0660db52d519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f31b5e67d2ac4b80bf16a766a7f9f423)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:10.670407 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b5d2b-99b1-4c82-8f6f-0660db52d519 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:10.721597 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3d7b5d2b-99b1-4c82-8f6f-0660db52d519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f31b5e67d2ac4b80bf16a766a7f9f423'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:10.722259 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3d7b5d2b-99b1-4c82-8f6f-0660db52d519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f31b5e67d2ac4b80bf16a766a7f9f423'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:10.731218 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3d7b5d2b-99b1-4c82-8f6f-0660db52d519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f31b5e67d2ac4b80bf16a766a7f9f423'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:10.731919 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3d7b5d2b-99b1-4c82-8f6f-0660db52d519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f31b5e67d2ac4b80bf16a766a7f9f423'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:10.747946 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3d7b5d2b-99b1-4c82-8f6f-0660db52d519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f31b5e67d2ac4b80bf16a766a7f9f423'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:10.761101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1086/2165] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:40:10 2022] DELETE /identity/v3/users/f31b5e67d2ac4b80bf16a766a7f9f423 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:10.972002 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3695938-f20c-4876-96e2-bb996d16a323 service cinder] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:10.983733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3695938-f20c-4876-96e2-bb996d16a323 service cinder] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:11.040735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a42760-87df-42b3-8926-a2dddf842804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:11.041610 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a42760-87df-42b3-8926-a2dddf842804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:11.041890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a42760-87df-42b3-8926-a2dddf842804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:11.042165 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a42760-87df-42b3-8926-a2dddf842804 admin admin] PATH_INFO: `/v3/projects/7479df6fb46a412398b2e1749b0cbd96` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:11.043363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a42760-87df-42b3-8926-a2dddf842804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7479df6fb46a412398b2e1749b0cbd96)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:11.045273 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a42760-87df-42b3-8926-a2dddf842804 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:11.086148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:11.092507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-53a42760-87df-42b3-8926-a2dddf842804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7479df6fb46a412398b2e1749b0cbd96', 'request_id': 'req-53a42760-87df-42b3-8926-a2dddf842804'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:11.099767 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-53a42760-87df-42b3-8926-a2dddf842804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7479df6fb46a412398b2e1749b0cbd96', 'request_id': 'req-53a42760-87df-42b3-8926-a2dddf842804'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:11.106010 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-53a42760-87df-42b3-8926-a2dddf842804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7479df6fb46a412398b2e1749b0cbd96', 'request_id': 'req-53a42760-87df-42b3-8926-a2dddf842804'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:11.116418 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-53a42760-87df-42b3-8926-a2dddf842804 admin admin] The token cache is being invalidate because project 7479df6fb46a412398b2e1749b0cbd96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:11.116708 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-53a42760-87df-42b3-8926-a2dddf842804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:11.117367 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-53a42760-87df-42b3-8926-a2dddf842804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:11.118916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1080/2166] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:40:10 2022] DELETE /identity/v3/projects/7479df6fb46a412398b2e1749b0cbd96 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:11.123841 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d880290-652e-4d52-b041-439bea4490f5 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:11.124161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d880290-652e-4d52-b041-439bea4490f5 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:11.124465 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d880290-652e-4d52-b041-439bea4490f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:11.144095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-1d880290-652e-4d52-b041-439bea4490f5 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:11.145315 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-1d880290-652e-4d52-b041-439bea4490f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:11.208139 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1087/2167] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:11.215964 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4d966-d390-4f41-844d-65cd57265f0b None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:11.216260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4d966-d390-4f41-844d-65cd57265f0b None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:11.216543 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4d966-d390-4f41-844d-65cd57265f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:11.235394 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-a3c4d966-d390-4f41-844d-65cd57265f0b None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:11.236599 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-a3c4d966-d390-4f41-844d-65cd57265f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:11.244645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1081/2168] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:11.248665 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d880290-652e-4d52-b041-439bea4490f5 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:11.259268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d880290-652e-4d52-b041-439bea4490f5 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:11.264111 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42996c-a45b-4a15-81cd-c75ff553f74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:11.264845 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42996c-a45b-4a15-81cd-c75ff553f74d admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:11.265219 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42996c-a45b-4a15-81cd-c75ff553f74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:11.265565 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42996c-a45b-4a15-81cd-c75ff553f74d admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:11.266382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42996c-a45b-4a15-81cd-c75ff553f74d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:40:11.266759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42996c-a45b-4a15-81cd-c75ff553f74d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:11.268424 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42996c-a45b-4a15-81cd-c75ff553f74d admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:11.280661 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1088/2169] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:40:11.284916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4d966-d390-4f41-844d-65cd57265f0b None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:11.294416 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4d966-d390-4f41-844d-65cd57265f0b None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:11.299662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e8dc4-2168-4cf9-8de9-ea6d8f57e154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:11.300323 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e8dc4-2168-4cf9-8de9-ea6d8f57e154 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:11.300603 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e8dc4-2168-4cf9-8de9-ea6d8f57e154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:11.300883 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e8dc4-2168-4cf9-8de9-ea6d8f57e154 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:11.301598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e8dc4-2168-4cf9-8de9-ea6d8f57e154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:11.303518 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e8dc4-2168-4cf9-8de9-ea6d8f57e154 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:11.332972 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1082/2170] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:40:11 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:11.337195 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42996c-a45b-4a15-81cd-c75ff553f74d admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:11.347321 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42996c-a45b-4a15-81cd-c75ff553f74d admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:11.403900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde2bdf-b0c9-4283-9178-56a78636753a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:11.404568 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde2bdf-b0c9-4283-9178-56a78636753a admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:11.404857 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde2bdf-b0c9-4283-9178-56a78636753a admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:11.405137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde2bdf-b0c9-4283-9178-56a78636753a admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:11.405839 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde2bdf-b0c9-4283-9178-56a78636753a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:11.407874 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde2bdf-b0c9-4283-9178-56a78636753a admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:11.414402 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:11.429251 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1089/2171] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:40:11 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:11.433516 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e8dc4-2168-4cf9-8de9-ea6d8f57e154 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:11.444276 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e8dc4-2168-4cf9-8de9-ea6d8f57e154 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:11.448887 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c951d01-33c0-4769-885e-531b994d10f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:11.449542 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c951d01-33c0-4769-885e-531b994d10f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:11.449828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c951d01-33c0-4769-885e-531b994d10f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:11.450109 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c951d01-33c0-4769-885e-531b994d10f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:11.450828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c951d01-33c0-4769-885e-531b994d10f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:11.452465 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c951d01-33c0-4769-885e-531b994d10f0 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:11.463828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1083/2172] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:40:11.467584 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde2bdf-b0c9-4283-9178-56a78636753a admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:11.477687 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde2bdf-b0c9-4283-9178-56a78636753a admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:11.482395 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea8d1f-1b53-46a6-add3-778c5c4a0c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:11.483054 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea8d1f-1b53-46a6-add3-778c5c4a0c64 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:11.483372 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea8d1f-1b53-46a6-add3-778c5c4a0c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:11.483655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea8d1f-1b53-46a6-add3-778c5c4a0c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:11.484409 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea8d1f-1b53-46a6-add3-778c5c4a0c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:11.486524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea8d1f-1b53-46a6-add3-778c5c4a0c64 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:11.496391 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1090/2173] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:11.500932 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c951d01-33c0-4769-885e-531b994d10f0 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:11.511050 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c951d01-33c0-4769-885e-531b994d10f0 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:11.515986 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd04b5-7b3c-4ef1-b9d8-b76bd12ff4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:11.516867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd04b5-7b3c-4ef1-b9d8-b76bd12ff4d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:11.517151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd04b5-7b3c-4ef1-b9d8-b76bd12ff4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:11.517434 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd04b5-7b3c-4ef1-b9d8-b76bd12ff4d5 admin admin] PATH_INFO: `/v3/projects/a9d2022c5b8c473e9ec36346168f55c1/users/b0587eaba4954884b4dd217936d87780/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:11.532141 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd04b5-7b3c-4ef1-b9d8-b76bd12ff4d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9d2022c5b8c473e9ec36346168f55c1, user_id=b0587eaba4954884b4dd217936d87780, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:11.534815 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd04b5-7b3c-4ef1-b9d8-b76bd12ff4d5 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:11.549417 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1084/2174] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:11 2022] PUT /identity/v3/projects/a9d2022c5b8c473e9ec36346168f55c1/users/b0587eaba4954884b4dd217936d87780/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:11.559502 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9e625-0b17-44cf-8037-ce81ee3a743c None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:11.559826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9e625-0b17-44cf-8037-ce81ee3a743c None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:11.560107 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9e625-0b17-44cf-8037-ce81ee3a743c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:11.586306 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-02d9e625-0b17-44cf-8037-ce81ee3a743c None None] MFA Rules not processed for user `b0587eaba4954884b4dd217936d87780`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:11.587481 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-02d9e625-0b17-44cf-8037-ce81ee3a743c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:11.653445 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1091/2175] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:11.658350 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd04b5-7b3c-4ef1-b9d8-b76bd12ff4d5 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:11.724300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd04b5-7b3c-4ef1-b9d8-b76bd12ff4d5 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:11.729531 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ecb34-05fa-465e-be9a-1ce2d9ea057a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:11.730933 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ecb34-05fa-465e-be9a-1ce2d9ea057a admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:11.731434 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ecb34-05fa-465e-be9a-1ce2d9ea057a admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:11.732858 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ecb34-05fa-465e-be9a-1ce2d9ea057a admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:11.733845 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ecb34-05fa-465e-be9a-1ce2d9ea057a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:11.736523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ecb34-05fa-465e-be9a-1ce2d9ea057a admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:11.765397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1085/2176] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:40:11 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:40:11.770289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9e625-0b17-44cf-8037-ce81ee3a743c None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:11.790233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9e625-0b17-44cf-8037-ce81ee3a743c None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:11.859379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d47434-36e1-4c9a-9d0c-54fc159999a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:11.860736 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d47434-36e1-4c9a-9d0c-54fc159999a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:11.861184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d47434-36e1-4c9a-9d0c-54fc159999a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:11.861524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d47434-36e1-4c9a-9d0c-54fc159999a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:11.862344 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d47434-36e1-4c9a-9d0c-54fc159999a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:11.864919 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d47434-36e1-4c9a-9d0c-54fc159999a6 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:11.887060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1092/2177] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:40:11 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:11.894996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ecb34-05fa-465e-be9a-1ce2d9ea057a admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:11.908045 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ecb34-05fa-465e-be9a-1ce2d9ea057a admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:11.914745 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efb054-6e71-4c6c-aafb-d1be0db5ff1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:11.915477 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efb054-6e71-4c6c-aafb-d1be0db5ff1d admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:11.915761 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efb054-6e71-4c6c-aafb-d1be0db5ff1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:11.916035 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efb054-6e71-4c6c-aafb-d1be0db5ff1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:11.916759 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efb054-6e71-4c6c-aafb-d1be0db5ff1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:11.918343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efb054-6e71-4c6c-aafb-d1be0db5ff1d admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:11.937987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1086/2178] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:11.939580 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d47434-36e1-4c9a-9d0c-54fc159999a6 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:11.953882 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d47434-36e1-4c9a-9d0c-54fc159999a6 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:11.959630 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3cb9a-442d-49f4-9395-33b91da3e4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:11.960842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3cb9a-442d-49f4-9395-33b91da3e4a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:11.961320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3cb9a-442d-49f4-9395-33b91da3e4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:11.961604 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3cb9a-442d-49f4-9395-33b91da3e4a1 admin admin] PATH_INFO: `/v3/projects/d204c71f603a4cc69b7cd5adc6722d1a/users/30bbe2809dd3485a9678331b64e7f0e2/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:11.980485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3cb9a-442d-49f4-9395-33b91da3e4a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d204c71f603a4cc69b7cd5adc6722d1a, user_id=30bbe2809dd3485a9678331b64e7f0e2, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:11.983168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3cb9a-442d-49f4-9395-33b91da3e4a1 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:11.996980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1093/2179] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:11 2022] PUT /identity/v3/projects/d204c71f603a4cc69b7cd5adc6722d1a/users/30bbe2809dd3485a9678331b64e7f0e2/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:12.001003 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efb054-6e71-4c6c-aafb-d1be0db5ff1d admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:12.010965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efb054-6e71-4c6c-aafb-d1be0db5ff1d admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:12.049793 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:12.069634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ce2a0-2896-4890-80b4-4142ac52e11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:12.070299 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ce2a0-2896-4890-80b4-4142ac52e11a admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:12.070576 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ce2a0-2896-4890-80b4-4142ac52e11a admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:12.070846 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ce2a0-2896-4890-80b4-4142ac52e11a admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:12.071594 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ce2a0-2896-4890-80b4-4142ac52e11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:12.073204 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ce2a0-2896-4890-80b4-4142ac52e11a admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:12.083835 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1087/2180] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:40:12.088215 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3cb9a-442d-49f4-9395-33b91da3e4a1 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:12.099216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3cb9a-442d-49f4-9395-33b91da3e4a1 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:12.103862 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfbd7a-bde1-4f1d-87f8-40f029961157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:12.104741 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfbd7a-bde1-4f1d-87f8-40f029961157 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:12.105027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfbd7a-bde1-4f1d-87f8-40f029961157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:12.105302 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfbd7a-bde1-4f1d-87f8-40f029961157 admin admin] PATH_INFO: `/v3/projects/d204c71f603a4cc69b7cd5adc6722d1a/users/30bbe2809dd3485a9678331b64e7f0e2/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:12.107241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfbd7a-bde1-4f1d-87f8-40f029961157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d204c71f603a4cc69b7cd5adc6722d1a, user_id=30bbe2809dd3485a9678331b64e7f0e2, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:12.109987 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfbd7a-bde1-4f1d-87f8-40f029961157 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:12.120156 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1094/2181] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:12 2022] PUT /identity/v3/projects/d204c71f603a4cc69b7cd5adc6722d1a/users/30bbe2809dd3485a9678331b64e7f0e2/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:12.131013 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a971e8-a21e-4f28-8f39-b1772474c723 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:12.131340 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a971e8-a21e-4f28-8f39-b1772474c723 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:12.131626 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a971e8-a21e-4f28-8f39-b1772474c723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:12.158325 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-21a971e8-a21e-4f28-8f39-b1772474c723 None None] MFA Rules not processed for user `30bbe2809dd3485a9678331b64e7f0e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:12.159557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-21a971e8-a21e-4f28-8f39-b1772474c723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:12.226770 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1088/2182] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:12.240559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfbd7a-bde1-4f1d-87f8-40f029961157 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:12.242288 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-60cfbd7a-bde1-4f1d-87f8-40f029961157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:12.264406 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:12.300374 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfbd7a-bde1-4f1d-87f8-40f029961157 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:12.304131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619c22b-7886-427d-9092-ab9fadf4a853 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:12.304775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619c22b-7886-427d-9092-ab9fadf4a853 service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:12.305065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619c22b-7886-427d-9092-ab9fadf4a853 service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:12.305348 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619c22b-7886-427d-9092-ab9fadf4a853 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:12.314316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619c22b-7886-427d-9092-ab9fadf4a853 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:12.315824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619c22b-7886-427d-9092-ab9fadf4a853 service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:12.325104 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1095/2183] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:12.702034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a971e8-a21e-4f28-8f39-b1772474c723 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:12.764039 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a971e8-a21e-4f28-8f39-b1772474c723 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:12.768583 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073604d-e9c8-46ee-bf22-2c771a5eeac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:12.769446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073604d-e9c8-46ee-bf22-2c771a5eeac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:12.769733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073604d-e9c8-46ee-bf22-2c771a5eeac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:12.770013 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073604d-e9c8-46ee-bf22-2c771a5eeac5 admin admin] PATH_INFO: `/v3/users/b0587eaba4954884b4dd217936d87780` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:12.771191 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073604d-e9c8-46ee-bf22-2c771a5eeac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0587eaba4954884b4dd217936d87780)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:12.773139 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073604d-e9c8-46ee-bf22-2c771a5eeac5 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:12.819013 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-3073604d-e9c8-46ee-bf22-2c771a5eeac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0587eaba4954884b4dd217936d87780'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:12.825984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-3073604d-e9c8-46ee-bf22-2c771a5eeac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0587eaba4954884b4dd217936d87780'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:12.826858 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-3073604d-e9c8-46ee-bf22-2c771a5eeac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0587eaba4954884b4dd217936d87780'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:12.834177 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:12.843060 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-3073604d-e9c8-46ee-bf22-2c771a5eeac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0587eaba4954884b4dd217936d87780'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:12.850868 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-3073604d-e9c8-46ee-bf22-2c771a5eeac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0587eaba4954884b4dd217936d87780'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:12.857434 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1089/2184] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:40:12 2022] DELETE /identity/v3/users/b0587eaba4954884b4dd217936d87780 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:12.862461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ea029-97df-4a45-a090-86b20c8e6f78 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:12.862753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ea029-97df-4a45-a090-86b20c8e6f78 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:12.863059 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ea029-97df-4a45-a090-86b20c8e6f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:12.882624 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-4d7ea029-97df-4a45-a090-86b20c8e6f78 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:12.883911 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-4d7ea029-97df-4a45-a090-86b20c8e6f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:12.944020 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1096/2185] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:40:12.953983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073604d-e9c8-46ee-bf22-2c771a5eeac5 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:12.955555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-3073604d-e9c8-46ee-bf22-2c771a5eeac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:13.018814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073604d-e9c8-46ee-bf22-2c771a5eeac5 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:13.023475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f88c7-80a6-48a9-88c7-73e79f80d229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:13.024130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f88c7-80a6-48a9-88c7-73e79f80d229 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:13.024410 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f88c7-80a6-48a9-88c7-73e79f80d229 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:13.024685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f88c7-80a6-48a9-88c7-73e79f80d229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:13.034245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f88c7-80a6-48a9-88c7-73e79f80d229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:13.036063 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f88c7-80a6-48a9-88c7-73e79f80d229 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:13.037435 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101acda-69b8-42f9-8dab-5821ae577d03 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:13.037824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101acda-69b8-42f9-8dab-5821ae577d03 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:13.038201 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101acda-69b8-42f9-8dab-5821ae577d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:13.046084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1090/2186] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:13.056886 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-c101acda-69b8-42f9-8dab-5821ae577d03 None None] MFA Rules not processed for user `52e6eb075ba742e68bab4ab79eb37e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:13.058082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-c101acda-69b8-42f9-8dab-5821ae577d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:13.119520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1097/2187] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:13.320338 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f88c7-80a6-48a9-88c7-73e79f80d229 service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:13.321949 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-1e1f88c7-80a6-48a9-88c7-73e79f80d229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:13.343245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f88c7-80a6-48a9-88c7-73e79f80d229 service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:13.350015 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87301fbb-3321-4e63-a689-020d79e7461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:13.351223 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87301fbb-3321-4e63-a689-020d79e7461d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:13.351626 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87301fbb-3321-4e63-a689-020d79e7461d admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:13.352133 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87301fbb-3321-4e63-a689-020d79e7461d admin admin] PATH_INFO: `/v3/projects/a9d2022c5b8c473e9ec36346168f55c1` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:13.353787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87301fbb-3321-4e63-a689-020d79e7461d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9d2022c5b8c473e9ec36346168f55c1)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:13.355940 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87301fbb-3321-4e63-a689-020d79e7461d admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:13.407721 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-87301fbb-3321-4e63-a689-020d79e7461d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9d2022c5b8c473e9ec36346168f55c1', 'request_id': 'req-87301fbb-3321-4e63-a689-020d79e7461d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:13.415615 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-87301fbb-3321-4e63-a689-020d79e7461d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9d2022c5b8c473e9ec36346168f55c1', 'request_id': 'req-87301fbb-3321-4e63-a689-020d79e7461d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:13.423164 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-87301fbb-3321-4e63-a689-020d79e7461d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9d2022c5b8c473e9ec36346168f55c1', 'request_id': 'req-87301fbb-3321-4e63-a689-020d79e7461d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:13.434132 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-87301fbb-3321-4e63-a689-020d79e7461d admin admin] The token cache is being invalidate because project a9d2022c5b8c473e9ec36346168f55c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:13.434420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-87301fbb-3321-4e63-a689-020d79e7461d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:13.435761 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-87301fbb-3321-4e63-a689-020d79e7461d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:13.437317 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1091/2188] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:40:13 2022] DELETE /identity/v3/projects/a9d2022c5b8c473e9ec36346168f55c1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:13.441363 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101acda-69b8-42f9-8dab-5821ae577d03 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:13.452085 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101acda-69b8-42f9-8dab-5821ae577d03 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:13.510010 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44071bee-ccb6-4486-9952-062f2ad20114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:13.510921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44071bee-ccb6-4486-9952-062f2ad20114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:13.511209 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44071bee-ccb6-4486-9952-062f2ad20114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:13.511557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44071bee-ccb6-4486-9952-062f2ad20114 admin admin] PATH_INFO: `/v3/users/30bbe2809dd3485a9678331b64e7f0e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:13.512752 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44071bee-ccb6-4486-9952-062f2ad20114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30bbe2809dd3485a9678331b64e7f0e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:13.514881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44071bee-ccb6-4486-9952-062f2ad20114 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:13.525828 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:13.571342 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-44071bee-ccb6-4486-9952-062f2ad20114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30bbe2809dd3485a9678331b64e7f0e2'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:13.572187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-44071bee-ccb6-4486-9952-062f2ad20114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30bbe2809dd3485a9678331b64e7f0e2'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:13.580596 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-44071bee-ccb6-4486-9952-062f2ad20114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30bbe2809dd3485a9678331b64e7f0e2'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:13.581241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-44071bee-ccb6-4486-9952-062f2ad20114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30bbe2809dd3485a9678331b64e7f0e2'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:13.593135 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-44071bee-ccb6-4486-9952-062f2ad20114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30bbe2809dd3485a9678331b64e7f0e2'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:13.608475 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1098/2189] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:40:13 2022] DELETE /identity/v3/users/30bbe2809dd3485a9678331b64e7f0e2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:40:13.898084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87301fbb-3321-4e63-a689-020d79e7461d admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:13.899862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-87301fbb-3321-4e63-a689-020d79e7461d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:13.914868 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87301fbb-3321-4e63-a689-020d79e7461d admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:13.982934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f20b8-ccc0-4fb6-976d-a8671a26afae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:13.984203 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f20b8-ccc0-4fb6-976d-a8671a26afae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:13.984666 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f20b8-ccc0-4fb6-976d-a8671a26afae admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:13.985129 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f20b8-ccc0-4fb6-976d-a8671a26afae admin admin] PATH_INFO: `/v3/projects/d204c71f603a4cc69b7cd5adc6722d1a` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:13.986612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f20b8-ccc0-4fb6-976d-a8671a26afae admin admin] RBAC: Authorizing `identity:delete_project(project_id=d204c71f603a4cc69b7cd5adc6722d1a)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:13.988722 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f20b8-ccc0-4fb6-976d-a8671a26afae admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:14.002136 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:14.085708 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-1d9f20b8-ccc0-4fb6-976d-a8671a26afae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd204c71f603a4cc69b7cd5adc6722d1a', 'request_id': 'req-1d9f20b8-ccc0-4fb6-976d-a8671a26afae'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:14.095665 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-1d9f20b8-ccc0-4fb6-976d-a8671a26afae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd204c71f603a4cc69b7cd5adc6722d1a', 'request_id': 'req-1d9f20b8-ccc0-4fb6-976d-a8671a26afae'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:14.105555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-1d9f20b8-ccc0-4fb6-976d-a8671a26afae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd204c71f603a4cc69b7cd5adc6722d1a', 'request_id': 'req-1d9f20b8-ccc0-4fb6-976d-a8671a26afae'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:14.122057 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-1d9f20b8-ccc0-4fb6-976d-a8671a26afae admin admin] The token cache is being invalidate because project d204c71f603a4cc69b7cd5adc6722d1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:14.122357 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-1d9f20b8-ccc0-4fb6-976d-a8671a26afae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:14.123140 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-1d9f20b8-ccc0-4fb6-976d-a8671a26afae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:14.124740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1092/2190] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:40:13 2022] DELETE /identity/v3/projects/d204c71f603a4cc69b7cd5adc6722d1a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:14.130822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffa783-aa31-4d53-a954-9b03eadead73 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:14.131106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffa783-aa31-4d53-a954-9b03eadead73 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:14.131423 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffa783-aa31-4d53-a954-9b03eadead73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:14.178744 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-e3ffa783-aa31-4d53-a954-9b03eadead73 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:14.180134 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-e3ffa783-aa31-4d53-a954-9b03eadead73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:14.248854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1099/2191] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:14.258720 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccd18d-262c-4e02-a09f-a200257be9f9 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:14.259208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccd18d-262c-4e02-a09f-a200257be9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:14.259695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccd18d-262c-4e02-a09f-a200257be9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:14.282499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-a7ccd18d-262c-4e02-a09f-a200257be9f9 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:14.283800 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-a7ccd18d-262c-4e02-a09f-a200257be9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:14.291991 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1093/2192] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:14.297570 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffa783-aa31-4d53-a954-9b03eadead73 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:14.309222 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffa783-aa31-4d53-a954-9b03eadead73 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:14.315157 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2273c-5c44-4d64-bbf0-cc629adb3348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:14.315762 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2273c-5c44-4d64-bbf0-cc629adb3348 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:14.316082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2273c-5c44-4d64-bbf0-cc629adb3348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:14.316367 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2273c-5c44-4d64-bbf0-cc629adb3348 admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:14.317108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2273c-5c44-4d64-bbf0-cc629adb3348 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:40:14.317433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2273c-5c44-4d64-bbf0-cc629adb3348 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:14.319040 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2273c-5c44-4d64-bbf0-cc629adb3348 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:14.334782 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1100/2193] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:40:14.336145 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccd18d-262c-4e02-a09f-a200257be9f9 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:14.347441 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccd18d-262c-4e02-a09f-a200257be9f9 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:14.352340 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b57bd-65d6-48cc-b0e4-e400ba3aecbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:14.353126 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b57bd-65d6-48cc-b0e4-e400ba3aecbd admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:14.353476 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b57bd-65d6-48cc-b0e4-e400ba3aecbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:14.353820 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b57bd-65d6-48cc-b0e4-e400ba3aecbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:14.354734 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b57bd-65d6-48cc-b0e4-e400ba3aecbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:14.357099 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b57bd-65d6-48cc-b0e4-e400ba3aecbd admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:14.389475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1094/2194] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:40:14 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:40:14.394407 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2273c-5c44-4d64-bbf0-cc629adb3348 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:14.406575 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2273c-5c44-4d64-bbf0-cc629adb3348 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:14.469891 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36573345-a6a0-456d-abb3-5fea14cf4c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:14.470569 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36573345-a6a0-456d-abb3-5fea14cf4c4d admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:14.470858 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36573345-a6a0-456d-abb3-5fea14cf4c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:14.471137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36573345-a6a0-456d-abb3-5fea14cf4c4d admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:14.471862 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36573345-a6a0-456d-abb3-5fea14cf4c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:14.474213 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36573345-a6a0-456d-abb3-5fea14cf4c4d admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:14.495968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1101/2195] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:40:14 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:14.499445 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b57bd-65d6-48cc-b0e4-e400ba3aecbd admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:14.514574 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b57bd-65d6-48cc-b0e4-e400ba3aecbd admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:14.519493 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfcbd0-f28d-4fa4-811d-15570bd04bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:14.520151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfcbd0-f28d-4fa4-811d-15570bd04bff admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:14.520436 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfcbd0-f28d-4fa4-811d-15570bd04bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:14.520713 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfcbd0-f28d-4fa4-811d-15570bd04bff admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:14.521435 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfcbd0-f28d-4fa4-811d-15570bd04bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:14.523024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfcbd0-f28d-4fa4-811d-15570bd04bff admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:14.533935 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1095/2196] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:40:14.537612 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36573345-a6a0-456d-abb3-5fea14cf4c4d admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:14.544003 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:14.548536 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36573345-a6a0-456d-abb3-5fea14cf4c4d admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:14.554377 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42351fa1-6c06-49b1-bd12-803d7cfac288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:14.555206 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42351fa1-6c06-49b1-bd12-803d7cfac288 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:14.555698 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42351fa1-6c06-49b1-bd12-803d7cfac288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:14.556030 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42351fa1-6c06-49b1-bd12-803d7cfac288 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:14.556965 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42351fa1-6c06-49b1-bd12-803d7cfac288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:14.558572 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42351fa1-6c06-49b1-bd12-803d7cfac288 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:14.569061 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1102/2197] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:14.573157 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfcbd0-f28d-4fa4-811d-15570bd04bff admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:14.582917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfcbd0-f28d-4fa4-811d-15570bd04bff admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:14.587437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a28ff-b428-48b8-833a-cffcda71c54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:14.588308 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a28ff-b428-48b8-833a-cffcda71c54c admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:14.588592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a28ff-b428-48b8-833a-cffcda71c54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:14.588869 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a28ff-b428-48b8-833a-cffcda71c54c admin admin] PATH_INFO: `/v3/projects/499d9e2350744c77996fbbcb7e50b5af/users/a93db43210ab47d3ab05cd6801384f61/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:14.603979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a28ff-b428-48b8-833a-cffcda71c54c admin admin] RBAC: Authorizing `identity:create_grant(project_id=499d9e2350744c77996fbbcb7e50b5af, user_id=a93db43210ab47d3ab05cd6801384f61, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:14.606723 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a28ff-b428-48b8-833a-cffcda71c54c admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:14.619340 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1096/2198] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:14 2022] PUT /identity/v3/projects/499d9e2350744c77996fbbcb7e50b5af/users/a93db43210ab47d3ab05cd6801384f61/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:14.630336 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e82ba5-a5e5-43b9-a8be-65daa39e33e0 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:14.630624 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e82ba5-a5e5-43b9-a8be-65daa39e33e0 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:14.630902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e82ba5-a5e5-43b9-a8be-65daa39e33e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:14.659079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-d4e82ba5-a5e5-43b9-a8be-65daa39e33e0 None None] MFA Rules not processed for user `a93db43210ab47d3ab05cd6801384f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:14.660318 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d4e82ba5-a5e5-43b9-a8be-65daa39e33e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:14.733162 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1103/2199] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:14.738401 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a28ff-b428-48b8-833a-cffcda71c54c admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:14.805065 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a28ff-b428-48b8-833a-cffcda71c54c admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:14.810144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2a70b-914c-4d77-9ba7-47da2c6e9192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:14.810823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2a70b-914c-4d77-9ba7-47da2c6e9192 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:14.811110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2a70b-914c-4d77-9ba7-47da2c6e9192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:14.811490 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2a70b-914c-4d77-9ba7-47da2c6e9192 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:14.812199 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2a70b-914c-4d77-9ba7-47da2c6e9192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:14.814145 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2a70b-914c-4d77-9ba7-47da2c6e9192 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:14.848949 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1097/2200] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:40:14 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:14.853591 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e82ba5-a5e5-43b9-a8be-65daa39e33e0 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:14.867963 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e82ba5-a5e5-43b9-a8be-65daa39e33e0 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:14.951087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720eb5fb-ead7-408b-941f-6f7394292dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:14.951940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eb5fb-ead7-408b-941f-6f7394292dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:14.952370 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eb5fb-ead7-408b-941f-6f7394292dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:14.952752 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eb5fb-ead7-408b-941f-6f7394292dd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:14.955625 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720eb5fb-ead7-408b-941f-6f7394292dd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:14.957768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720eb5fb-ead7-408b-941f-6f7394292dd0 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:14.987081 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1104/2201] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:40:14 2022] POST /identity/v3/users => generated 300 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:40:14.991193 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2a70b-914c-4d77-9ba7-47da2c6e9192 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:15.010150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2a70b-914c-4d77-9ba7-47da2c6e9192 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:15.021667 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570acef9-291e-4d83-aaa3-127017393dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:15.023051 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570acef9-291e-4d83-aaa3-127017393dcb admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:15.023051 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570acef9-291e-4d83-aaa3-127017393dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:15.023854 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570acef9-291e-4d83-aaa3-127017393dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:15.024854 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570acef9-291e-4d83-aaa3-127017393dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:15.027101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570acef9-291e-4d83-aaa3-127017393dcb admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:15.061346 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1098/2202] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:15.067303 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720eb5fb-ead7-408b-941f-6f7394292dd0 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:15.079619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720eb5fb-ead7-408b-941f-6f7394292dd0 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:15.085883 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3098c26-c831-4d2d-aea4-69cd7c8e04bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:15.086991 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3098c26-c831-4d2d-aea4-69cd7c8e04bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:15.087377 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3098c26-c831-4d2d-aea4-69cd7c8e04bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:15.087766 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3098c26-c831-4d2d-aea4-69cd7c8e04bc admin admin] PATH_INFO: `/v3/projects/82bed29e4b454e65ae88080c71676779/users/eb9fedc156c5445c9d7a6bb7832cdb3d/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:15.120395 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3098c26-c831-4d2d-aea4-69cd7c8e04bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=82bed29e4b454e65ae88080c71676779, user_id=eb9fedc156c5445c9d7a6bb7832cdb3d, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:15.124358 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3098c26-c831-4d2d-aea4-69cd7c8e04bc admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:15.141397 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1105/2203] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:15 2022] PUT /identity/v3/projects/82bed29e4b454e65ae88080c71676779/users/eb9fedc156c5445c9d7a6bb7832cdb3d/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:15.145297 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570acef9-291e-4d83-aaa3-127017393dcb admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:15.155861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570acef9-291e-4d83-aaa3-127017393dcb admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:15.160599 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:15.245551 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfdb5e-41e8-40d0-a7af-729bd8bef761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:15.246672 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfdb5e-41e8-40d0-a7af-729bd8bef761 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:15.246835 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfdb5e-41e8-40d0-a7af-729bd8bef761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:15.246999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfdb5e-41e8-40d0-a7af-729bd8bef761 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:15.247795 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfdb5e-41e8-40d0-a7af-729bd8bef761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:15.249329 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfdb5e-41e8-40d0-a7af-729bd8bef761 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:15.262840 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1099/2204] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:40:15.264107 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3098c26-c831-4d2d-aea4-69cd7c8e04bc admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:15.275372 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3098c26-c831-4d2d-aea4-69cd7c8e04bc admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:15.280035 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16456f-1281-4080-89c6-bfd65345a7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:15.280925 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16456f-1281-4080-89c6-bfd65345a7b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:15.281207 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16456f-1281-4080-89c6-bfd65345a7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:15.281540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16456f-1281-4080-89c6-bfd65345a7b9 admin admin] PATH_INFO: `/v3/projects/82bed29e4b454e65ae88080c71676779/users/eb9fedc156c5445c9d7a6bb7832cdb3d/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:15.283512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16456f-1281-4080-89c6-bfd65345a7b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82bed29e4b454e65ae88080c71676779, user_id=eb9fedc156c5445c9d7a6bb7832cdb3d, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:15.286165 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16456f-1281-4080-89c6-bfd65345a7b9 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:15.296814 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1106/2205] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:15 2022] PUT /identity/v3/projects/82bed29e4b454e65ae88080c71676779/users/eb9fedc156c5445c9d7a6bb7832cdb3d/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:15.307472 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabbd98-0556-49e5-a940-e9c8201d7570 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:15.307801 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabbd98-0556-49e5-a940-e9c8201d7570 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:15.308085 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabbd98-0556-49e5-a940-e9c8201d7570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:15.340724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-bdabbd98-0556-49e5-a940-e9c8201d7570 None None] MFA Rules not processed for user `eb9fedc156c5445c9d7a6bb7832cdb3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:15.342101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-bdabbd98-0556-49e5-a940-e9c8201d7570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:15.418000 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1100/2206] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:15.429295 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16456f-1281-4080-89c6-bfd65345a7b9 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:15.431015 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-2c16456f-1281-4080-89c6-bfd65345a7b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:15.474525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:15.496641 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16456f-1281-4080-89c6-bfd65345a7b9 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:15.500826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f031af4-75c9-466f-90ed-198fc3e7c2b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:15.501496 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f031af4-75c9-466f-90ed-198fc3e7c2b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:15.502282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f031af4-75c9-466f-90ed-198fc3e7c2b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:15.502282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f031af4-75c9-466f-90ed-198fc3e7c2b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:15.525406 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f031af4-75c9-466f-90ed-198fc3e7c2b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:15.528186 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f031af4-75c9-466f-90ed-198fc3e7c2b2 service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:15.544972 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1107/2207] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:15.581525 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabbd98-0556-49e5-a940-e9c8201d7570 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:15.583172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-bdabbd98-0556-49e5-a940-e9c8201d7570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:15.664701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabbd98-0556-49e5-a940-e9c8201d7570 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:15.675479 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563b857-613b-49d3-a2ce-e98cc0c08f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:15.675479 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563b857-613b-49d3-a2ce-e98cc0c08f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:15.675479 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563b857-613b-49d3-a2ce-e98cc0c08f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:15.675479 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563b857-613b-49d3-a2ce-e98cc0c08f2a admin admin] PATH_INFO: `/v3/users/76cd7aeb9dc74797b30707b140444bf2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:15.675979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563b857-613b-49d3-a2ce-e98cc0c08f2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=76cd7aeb9dc74797b30707b140444bf2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:15.678039 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563b857-613b-49d3-a2ce-e98cc0c08f2a admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:15.739809 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f031af4-75c9-466f-90ed-198fc3e7c2b2 service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:15.750718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:15.754900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f031af4-75c9-466f-90ed-198fc3e7c2b2 service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:15.760910 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f83d8-9d2f-4f93-a7a6-8c44ae861a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:15.762350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f83d8-9d2f-4f93-a7a6-8c44ae861a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:15.762350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f83d8-9d2f-4f93-a7a6-8c44ae861a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:15.762550 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f83d8-9d2f-4f93-a7a6-8c44ae861a46 admin admin] PATH_INFO: `/v3/users/a93db43210ab47d3ab05cd6801384f61` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:15.763799 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f83d8-9d2f-4f93-a7a6-8c44ae861a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a93db43210ab47d3ab05cd6801384f61)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:15.766361 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f83d8-9d2f-4f93-a7a6-8c44ae861a46 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:15.779915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c563b857-613b-49d3-a2ce-e98cc0c08f2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76cd7aeb9dc74797b30707b140444bf2'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:15.821667 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c563b857-613b-49d3-a2ce-e98cc0c08f2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76cd7aeb9dc74797b30707b140444bf2'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:15.821667 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c563b857-613b-49d3-a2ce-e98cc0c08f2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76cd7aeb9dc74797b30707b140444bf2'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:15.851390 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c563b857-613b-49d3-a2ce-e98cc0c08f2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76cd7aeb9dc74797b30707b140444bf2'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:15.860398 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c563b857-613b-49d3-a2ce-e98cc0c08f2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76cd7aeb9dc74797b30707b140444bf2'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:15.865785 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-602f83d8-9d2f-4f93-a7a6-8c44ae861a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a93db43210ab47d3ab05cd6801384f61'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:15.867547 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-602f83d8-9d2f-4f93-a7a6-8c44ae861a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a93db43210ab47d3ab05cd6801384f61'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:15.871122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1101/2208] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:40:15 2022] DELETE /identity/v3/users/76cd7aeb9dc74797b30707b140444bf2 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:15.875377 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd57e3-7a56-48c7-b198-329d552c969b None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:15.876137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd57e3-7a56-48c7-b198-329d552c969b None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:15.877368 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd57e3-7a56-48c7-b198-329d552c969b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:15.881360 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-602f83d8-9d2f-4f93-a7a6-8c44ae861a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a93db43210ab47d3ab05cd6801384f61'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:15.882183 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-602f83d8-9d2f-4f93-a7a6-8c44ae861a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a93db43210ab47d3ab05cd6801384f61'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:15.915844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-602f83d8-9d2f-4f93-a7a6-8c44ae861a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a93db43210ab47d3ab05cd6801384f61'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:15.921925 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-0abd57e3-7a56-48c7-b198-329d552c969b None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:15.927824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-0abd57e3-7a56-48c7-b198-329d552c969b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:15.942703 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1108/2209] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:40:15 2022] DELETE /identity/v3/users/a93db43210ab47d3ab05cd6801384f61 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:15.948638 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07b13c-bdc2-4932-bf40-c17a37533b53 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:15.948983 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07b13c-bdc2-4932-bf40-c17a37533b53 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:15.949267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07b13c-bdc2-4932-bf40-c17a37533b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:15.969893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-9c07b13c-bdc2-4932-bf40-c17a37533b53 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:15.971849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-9c07b13c-bdc2-4932-bf40-c17a37533b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:16.027393 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1102/2210] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:16.039438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd57e3-7a56-48c7-b198-329d552c969b None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:16.042606 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-0abd57e3-7a56-48c7-b198-329d552c969b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:16.065369 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1109/2211] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:16.077150 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07b13c-bdc2-4932-bf40-c17a37533b53 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:16.079347 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-9c07b13c-bdc2-4932-bf40-c17a37533b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:16.148283 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd57e3-7a56-48c7-b198-329d552c969b None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:16.173181 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07b13c-bdc2-4932-bf40-c17a37533b53 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:16.177503 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483fc7b-c433-4b4a-8b9a-6bec75072626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:16.178218 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483fc7b-c433-4b4a-8b9a-6bec75072626 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:16.178512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483fc7b-c433-4b4a-8b9a-6bec75072626 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:16.178826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483fc7b-c433-4b4a-8b9a-6bec75072626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:16.186103 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:16.191952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483fc7b-c433-4b4a-8b9a-6bec75072626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:16.193959 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483fc7b-c433-4b4a-8b9a-6bec75072626 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:16.212528 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1110/2212] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:40:16.256260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3be3a-85ec-4c75-9741-05c3aedc9765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:16.256929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3be3a-85ec-4c75-9741-05c3aedc9765 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:16.257213 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3be3a-85ec-4c75-9741-05c3aedc9765 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:16.257490 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3be3a-85ec-4c75-9741-05c3aedc9765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:16.278238 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3be3a-85ec-4c75-9741-05c3aedc9765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:16.279926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3be3a-85ec-4c75-9741-05c3aedc9765 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:16.293649 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1103/2213] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:16.583200 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483fc7b-c433-4b4a-8b9a-6bec75072626 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:16.585038 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f483fc7b-c433-4b4a-8b9a-6bec75072626 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:16.601938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483fc7b-c433-4b4a-8b9a-6bec75072626 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:16.607687 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d94a23-7f16-496e-b05d-05cf4ec4cd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:16.608690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d94a23-7f16-496e-b05d-05cf4ec4cd06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:16.608982 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d94a23-7f16-496e-b05d-05cf4ec4cd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:16.609895 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d94a23-7f16-496e-b05d-05cf4ec4cd06 admin admin] PATH_INFO: `/v3/projects/499d9e2350744c77996fbbcb7e50b5af` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:16.611199 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d94a23-7f16-496e-b05d-05cf4ec4cd06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=499d9e2350744c77996fbbcb7e50b5af)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:16.613805 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d94a23-7f16-496e-b05d-05cf4ec4cd06 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:16.669512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-49d94a23-7f16-496e-b05d-05cf4ec4cd06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '499d9e2350744c77996fbbcb7e50b5af', 'request_id': 'req-49d94a23-7f16-496e-b05d-05cf4ec4cd06'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:16.678781 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-49d94a23-7f16-496e-b05d-05cf4ec4cd06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '499d9e2350744c77996fbbcb7e50b5af', 'request_id': 'req-49d94a23-7f16-496e-b05d-05cf4ec4cd06'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:16.688427 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-49d94a23-7f16-496e-b05d-05cf4ec4cd06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '499d9e2350744c77996fbbcb7e50b5af', 'request_id': 'req-49d94a23-7f16-496e-b05d-05cf4ec4cd06'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:16.700183 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-49d94a23-7f16-496e-b05d-05cf4ec4cd06 admin admin] The token cache is being invalidate because project 499d9e2350744c77996fbbcb7e50b5af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:16.700475 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-49d94a23-7f16-496e-b05d-05cf4ec4cd06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:16.701255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-49d94a23-7f16-496e-b05d-05cf4ec4cd06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:16.702899 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1111/2214] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:40:16 2022] DELETE /identity/v3/projects/499d9e2350744c77996fbbcb7e50b5af => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:16.707008 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3be3a-85ec-4c75-9741-05c3aedc9765 service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:16.719524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3be3a-85ec-4c75-9741-05c3aedc9765 service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:16.723868 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:16.806356 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9329f-184b-4f2a-8b02-4cc5c710fa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:16.807403 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9329f-184b-4f2a-8b02-4cc5c710fa0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:16.807803 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9329f-184b-4f2a-8b02-4cc5c710fa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:16.808088 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9329f-184b-4f2a-8b02-4cc5c710fa0c admin admin] PATH_INFO: `/v3/users/eb9fedc156c5445c9d7a6bb7832cdb3d` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:16.809365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9329f-184b-4f2a-8b02-4cc5c710fa0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb9fedc156c5445c9d7a6bb7832cdb3d)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:16.811465 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9329f-184b-4f2a-8b02-4cc5c710fa0c admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:16.871734 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c2c9329f-184b-4f2a-8b02-4cc5c710fa0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb9fedc156c5445c9d7a6bb7832cdb3d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:16.879134 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c2c9329f-184b-4f2a-8b02-4cc5c710fa0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb9fedc156c5445c9d7a6bb7832cdb3d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:16.879885 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c2c9329f-184b-4f2a-8b02-4cc5c710fa0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb9fedc156c5445c9d7a6bb7832cdb3d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:16.891995 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c2c9329f-184b-4f2a-8b02-4cc5c710fa0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb9fedc156c5445c9d7a6bb7832cdb3d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:16.899824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c2c9329f-184b-4f2a-8b02-4cc5c710fa0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb9fedc156c5445c9d7a6bb7832cdb3d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:16.915533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1104/2215] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:40:16 2022] DELETE /identity/v3/users/eb9fedc156c5445c9d7a6bb7832cdb3d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:16.985818 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d94a23-7f16-496e-b05d-05cf4ec4cd06 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:16.987574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-49d94a23-7f16-496e-b05d-05cf4ec4cd06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:17.003535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d94a23-7f16-496e-b05d-05cf4ec4cd06 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:17.092099 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6978cb7-eb85-4a38-9e58-7104da1865a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:17.094347 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6978cb7-eb85-4a38-9e58-7104da1865a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:17.094971 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6978cb7-eb85-4a38-9e58-7104da1865a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:17.095442 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6978cb7-eb85-4a38-9e58-7104da1865a8 admin admin] PATH_INFO: `/v3/projects/2e1044cf8f9c4c6d8782bf339540b7fc` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:17.096970 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6978cb7-eb85-4a38-9e58-7104da1865a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e1044cf8f9c4c6d8782bf339540b7fc)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:17.099645 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6978cb7-eb85-4a38-9e58-7104da1865a8 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:17.151259 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-f6978cb7-eb85-4a38-9e58-7104da1865a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e1044cf8f9c4c6d8782bf339540b7fc', 'request_id': 'req-f6978cb7-eb85-4a38-9e58-7104da1865a8'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.160132 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-f6978cb7-eb85-4a38-9e58-7104da1865a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e1044cf8f9c4c6d8782bf339540b7fc', 'request_id': 'req-f6978cb7-eb85-4a38-9e58-7104da1865a8'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.169231 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-f6978cb7-eb85-4a38-9e58-7104da1865a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e1044cf8f9c4c6d8782bf339540b7fc', 'request_id': 'req-f6978cb7-eb85-4a38-9e58-7104da1865a8'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.185735 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-f6978cb7-eb85-4a38-9e58-7104da1865a8 admin admin] The token cache is being invalidate because project 2e1044cf8f9c4c6d8782bf339540b7fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:17.186244 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-f6978cb7-eb85-4a38-9e58-7104da1865a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.187202 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-f6978cb7-eb85-4a38-9e58-7104da1865a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.189801 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1112/2216] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:40:16 2022] DELETE /identity/v3/projects/2e1044cf8f9c4c6d8782bf339540b7fc => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:17.193503 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9329f-184b-4f2a-8b02-4cc5c710fa0c admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:17.195057 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-c2c9329f-184b-4f2a-8b02-4cc5c710fa0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:17.210034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9329f-184b-4f2a-8b02-4cc5c710fa0c admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:17.263154 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6978cb7-eb85-4a38-9e58-7104da1865a8 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:17.265924 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f6978cb7-eb85-4a38-9e58-7104da1865a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:17.282218 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:17.326330 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a904b-4f51-4ac6-a918-dbee414d14c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:17.327548 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a904b-4f51-4ac6-a918-dbee414d14c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:17.328013 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a904b-4f51-4ac6-a918-dbee414d14c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:17.328536 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a904b-4f51-4ac6-a918-dbee414d14c6 admin admin] PATH_INFO: `/v3/users/7ddd449af10c4b488b1bf386ac4cc1bb` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:17.330067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a904b-4f51-4ac6-a918-dbee414d14c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ddd449af10c4b488b1bf386ac4cc1bb)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:17.332428 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a904b-4f51-4ac6-a918-dbee414d14c6 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:17.382418 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6978cb7-eb85-4a38-9e58-7104da1865a8 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:17.386132 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:17.390090 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cff57-8122-4996-907a-348c8b09b2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:17.391426 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cff57-8122-4996-907a-348c8b09b2f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:17.391568 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cff57-8122-4996-907a-348c8b09b2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:17.391849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cff57-8122-4996-907a-348c8b09b2f3 admin admin] PATH_INFO: `/v3/projects/82bed29e4b454e65ae88080c71676779` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:17.393868 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650cff57-8122-4996-907a-348c8b09b2f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82bed29e4b454e65ae88080c71676779)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:17.395781 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650cff57-8122-4996-907a-348c8b09b2f3 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:17.417412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-b79a904b-4f51-4ac6-a918-dbee414d14c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ddd449af10c4b488b1bf386ac4cc1bb'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.427425 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-b79a904b-4f51-4ac6-a918-dbee414d14c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ddd449af10c4b488b1bf386ac4cc1bb'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.428327 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-b79a904b-4f51-4ac6-a918-dbee414d14c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ddd449af10c4b488b1bf386ac4cc1bb'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.453930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-b79a904b-4f51-4ac6-a918-dbee414d14c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ddd449af10c4b488b1bf386ac4cc1bb'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.467343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-b79a904b-4f51-4ac6-a918-dbee414d14c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ddd449af10c4b488b1bf386ac4cc1bb'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.477587 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1105/2217] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:40:17 2022] DELETE /identity/v3/users/7ddd449af10c4b488b1bf386ac4cc1bb => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:17.481274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a904b-4f51-4ac6-a918-dbee414d14c6 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:17.482848 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-b79a904b-4f51-4ac6-a918-dbee414d14c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:17.518865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-650cff57-8122-4996-907a-348c8b09b2f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82bed29e4b454e65ae88080c71676779', 'request_id': 'req-650cff57-8122-4996-907a-348c8b09b2f3'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.530011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-650cff57-8122-4996-907a-348c8b09b2f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82bed29e4b454e65ae88080c71676779', 'request_id': 'req-650cff57-8122-4996-907a-348c8b09b2f3'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.539248 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-650cff57-8122-4996-907a-348c8b09b2f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82bed29e4b454e65ae88080c71676779', 'request_id': 'req-650cff57-8122-4996-907a-348c8b09b2f3'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.556818 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-650cff57-8122-4996-907a-348c8b09b2f3 admin admin] The token cache is being invalidate because project 82bed29e4b454e65ae88080c71676779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:17.557579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-650cff57-8122-4996-907a-348c8b09b2f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.558737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-650cff57-8122-4996-907a-348c8b09b2f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.561629 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1113/2218] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:40:17 2022] DELETE /identity/v3/projects/82bed29e4b454e65ae88080c71676779 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:40:17.568246 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d98c0-6f81-4dbf-99aa-32b60431acad None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:17.568665 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d98c0-6f81-4dbf-99aa-32b60431acad None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:17.569051 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d98c0-6f81-4dbf-99aa-32b60431acad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:17.574055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a904b-4f51-4ac6-a918-dbee414d14c6 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:17.600101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-274d98c0-6f81-4dbf-99aa-32b60431acad None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:17.601899 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-274d98c0-6f81-4dbf-99aa-32b60431acad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:17.693633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b2727-cd7e-43ec-8e07-acdf13a4b403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:17.694538 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b2727-cd7e-43ec-8e07-acdf13a4b403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:17.694969 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b2727-cd7e-43ec-8e07-acdf13a4b403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:17.695321 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b2727-cd7e-43ec-8e07-acdf13a4b403 admin admin] PATH_INFO: `/v3/users/371fb41ee2d840f7a8e26c42f76ad030` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:17.697850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b2727-cd7e-43ec-8e07-acdf13a4b403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=371fb41ee2d840f7a8e26c42f76ad030)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:17.702196 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b2727-cd7e-43ec-8e07-acdf13a4b403 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:17.733794 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1114/2219] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:17.736632 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d3c25-838f-4b43-ba01-06c7be886479 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:17.737066 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d3c25-838f-4b43-ba01-06c7be886479 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:17.737453 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d3c25-838f-4b43-ba01-06c7be886479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:17.785517 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-620d3c25-838f-4b43-ba01-06c7be886479 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:17.787122 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-620d3c25-838f-4b43-ba01-06c7be886479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:17.788724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ad2b2727-cd7e-43ec-8e07-acdf13a4b403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '371fb41ee2d840f7a8e26c42f76ad030'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.794520 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:17.796937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ad2b2727-cd7e-43ec-8e07-acdf13a4b403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '371fb41ee2d840f7a8e26c42f76ad030'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.798474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ad2b2727-cd7e-43ec-8e07-acdf13a4b403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '371fb41ee2d840f7a8e26c42f76ad030'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.800662 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1115/2220] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:17.805582 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d3c25-838f-4b43-ba01-06c7be886479 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:17.816399 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ad2b2727-cd7e-43ec-8e07-acdf13a4b403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '371fb41ee2d840f7a8e26c42f76ad030'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.817004 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d3c25-838f-4b43-ba01-06c7be886479 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:17.822819 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8f89e-4c26-4dc6-9841-671940366b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:17.823588 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8f89e-4c26-4dc6-9841-671940366b44 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:17.823941 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8f89e-4c26-4dc6-9841-671940366b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:17.824192 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8f89e-4c26-4dc6-9841-671940366b44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:17.826338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8f89e-4c26-4dc6-9841-671940366b44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:40:17.826919 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8f89e-4c26-4dc6-9841-671940366b44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:17.827739 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ad2b2727-cd7e-43ec-8e07-acdf13a4b403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '371fb41ee2d840f7a8e26c42f76ad030'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:17.830849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8f89e-4c26-4dc6-9841-671940366b44 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:17.840058 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1106/2221] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:40:17 2022] DELETE /identity/v3/users/371fb41ee2d840f7a8e26c42f76ad030 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:17.844985 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d481482-e713-46d9-bf05-0279b1660003 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:17.845373 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d481482-e713-46d9-bf05-0279b1660003 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:17.846077 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d481482-e713-46d9-bf05-0279b1660003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:17.857966 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1116/2222] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:40:17.859971 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8f89e-4c26-4dc6-9841-671940366b44 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:17.861842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-b3e8f89e-4c26-4dc6-9841-671940366b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:17.871862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-5d481482-e713-46d9-bf05-0279b1660003 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:17.873282 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-5d481482-e713-46d9-bf05-0279b1660003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:17.879007 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8f89e-4c26-4dc6-9841-671940366b44 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:17.896489 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:17.977079 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1107/2223] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:17.995912 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fff6b1-f9a9-4aa6-8e3a-25f845980f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:17.996687 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fff6b1-f9a9-4aa6-8e3a-25f845980f77 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:17.996970 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fff6b1-f9a9-4aa6-8e3a-25f845980f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:17.997247 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fff6b1-f9a9-4aa6-8e3a-25f845980f77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:17.997951 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fff6b1-f9a9-4aa6-8e3a-25f845980f77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:17.999585 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d481482-e713-46d9-bf05-0279b1660003 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:18.001825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-5d481482-e713-46d9-bf05-0279b1660003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:18.005193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fff6b1-f9a9-4aa6-8e3a-25f845980f77 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:18.054115 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1117/2224] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:40:17 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:18.054115 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fff6b1-f9a9-4aa6-8e3a-25f845980f77 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:18.056459 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-73fff6b1-f9a9-4aa6-8e3a-25f845980f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:18.125632 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d481482-e713-46d9-bf05-0279b1660003 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:18.143761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fff6b1-f9a9-4aa6-8e3a-25f845980f77 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:18.149149 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20648f7d-6a87-4899-aee7-752b309aa405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:18.150128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20648f7d-6a87-4899-aee7-752b309aa405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:18.150458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20648f7d-6a87-4899-aee7-752b309aa405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:18.150927 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20648f7d-6a87-4899-aee7-752b309aa405 admin admin] PATH_INFO: `/v3/projects/6d6fa53242b94e2180b83d95a210b671` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:18.152745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20648f7d-6a87-4899-aee7-752b309aa405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d6fa53242b94e2180b83d95a210b671)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:18.155053 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20648f7d-6a87-4899-aee7-752b309aa405 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:18.185897 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f85092-4ee0-40ba-9379-b2cfe646fe6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:18.186946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f85092-4ee0-40ba-9379-b2cfe646fe6f service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:18.187224 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f85092-4ee0-40ba-9379-b2cfe646fe6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:18.187565 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f85092-4ee0-40ba-9379-b2cfe646fe6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:18.197887 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f85092-4ee0-40ba-9379-b2cfe646fe6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:18.199912 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f85092-4ee0-40ba-9379-b2cfe646fe6f service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:18.209227 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-20648f7d-6a87-4899-aee7-752b309aa405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d6fa53242b94e2180b83d95a210b671', 'request_id': 'req-20648f7d-6a87-4899-aee7-752b309aa405'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:18.212734 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1108/2225] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:40:18.213382 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f85092-4ee0-40ba-9379-b2cfe646fe6f service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:18.221901 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-20648f7d-6a87-4899-aee7-752b309aa405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d6fa53242b94e2180b83d95a210b671', 'request_id': 'req-20648f7d-6a87-4899-aee7-752b309aa405'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:18.225643 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f85092-4ee0-40ba-9379-b2cfe646fe6f service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:18.230981 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-20648f7d-6a87-4899-aee7-752b309aa405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d6fa53242b94e2180b83d95a210b671', 'request_id': 'req-20648f7d-6a87-4899-aee7-752b309aa405'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:18.246927 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-20648f7d-6a87-4899-aee7-752b309aa405 admin admin] The token cache is being invalidate because project 6d6fa53242b94e2180b83d95a210b671 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:18.247642 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-20648f7d-6a87-4899-aee7-752b309aa405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:18.248527 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-20648f7d-6a87-4899-aee7-752b309aa405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:18.250879 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1118/2226] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:40:18 2022] DELETE /identity/v3/projects/6d6fa53242b94e2180b83d95a210b671 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:18.258591 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20648f7d-6a87-4899-aee7-752b309aa405 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:18.260918 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-20648f7d-6a87-4899-aee7-752b309aa405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:18.304176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:18.306065 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:18.341474 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20648f7d-6a87-4899-aee7-752b309aa405 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:18.342471 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e29489-ec33-4882-8af9-fb1d407b3250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:18.343547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e29489-ec33-4882-8af9-fb1d407b3250 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:18.344433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e29489-ec33-4882-8af9-fb1d407b3250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:18.344720 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e29489-ec33-4882-8af9-fb1d407b3250 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:18.345447 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e29489-ec33-4882-8af9-fb1d407b3250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:18.347546 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e29489-ec33-4882-8af9-fb1d407b3250 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:18.348214 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8259a-8588-477c-a322-44c696d0f25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:18.349443 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8259a-8588-477c-a322-44c696d0f25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:18.349872 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8259a-8588-477c-a322-44c696d0f25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:18.350295 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8259a-8588-477c-a322-44c696d0f25c admin admin] PATH_INFO: `/v3/users/a03fc60d06514411982bc52b84e84515` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:18.351934 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8259a-8588-477c-a322-44c696d0f25c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a03fc60d06514411982bc52b84e84515)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:18.354223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8259a-8588-477c-a322-44c696d0f25c admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:18.376829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1109/2227] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:40:18 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:18.380795 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e29489-ec33-4882-8af9-fb1d407b3250 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:18.383162 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-71e29489-ec33-4882-8af9-fb1d407b3250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:18.397511 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e29489-ec33-4882-8af9-fb1d407b3250 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:18.403026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf423345-7146-4e36-a98f-dadf4fbef5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:18.404220 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf423345-7146-4e36-a98f-dadf4fbef5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:18.404655 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf423345-7146-4e36-a98f-dadf4fbef5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:18.405258 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf423345-7146-4e36-a98f-dadf4fbef5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:18.406292 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf423345-7146-4e36-a98f-dadf4fbef5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:18.409004 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf423345-7146-4e36-a98f-dadf4fbef5e1 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:18.412919 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6ff8259a-8588-477c-a322-44c696d0f25c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a03fc60d06514411982bc52b84e84515'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:18.413669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6ff8259a-8588-477c-a322-44c696d0f25c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a03fc60d06514411982bc52b84e84515'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:18.420744 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6ff8259a-8588-477c-a322-44c696d0f25c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a03fc60d06514411982bc52b84e84515'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:18.421481 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6ff8259a-8588-477c-a322-44c696d0f25c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a03fc60d06514411982bc52b84e84515'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:18.424268 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1110/2228] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:40:18.428633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf423345-7146-4e36-a98f-dadf4fbef5e1 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:18.430569 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-cf423345-7146-4e36-a98f-dadf4fbef5e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:18.435259 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6ff8259a-8588-477c-a322-44c696d0f25c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a03fc60d06514411982bc52b84e84515'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:18.446664 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf423345-7146-4e36-a98f-dadf4fbef5e1 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:18.451587 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1119/2229] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:40:18 2022] DELETE /identity/v3/users/a03fc60d06514411982bc52b84e84515 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:18.451716 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8b699-a47f-485f-9004-2c090f993556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:18.452362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8b699-a47f-485f-9004-2c090f993556 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:18.452646 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8b699-a47f-485f-9004-2c090f993556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:18.452921 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8b699-a47f-485f-9004-2c090f993556 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:18.454256 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8b699-a47f-485f-9004-2c090f993556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:18.455912 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8b699-a47f-485f-9004-2c090f993556 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:18.468014 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1111/2230] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:18.473038 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8259a-8588-477c-a322-44c696d0f25c admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:18.572505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8259a-8588-477c-a322-44c696d0f25c admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:18.582748 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e05f6-853c-46d3-90e0-53ec167592e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:18.584203 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e05f6-853c-46d3-90e0-53ec167592e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:18.584513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e05f6-853c-46d3-90e0-53ec167592e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:18.584848 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e05f6-853c-46d3-90e0-53ec167592e4 admin admin] PATH_INFO: `/v3/projects/1b086d7ddb9245e484c85cecf8eacafb/users/e79a4d84eb1348cb843d82154784815a/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:18.589588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8b699-a47f-485f-9004-2c090f993556 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:18.591739 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-bdb8b699-a47f-485f-9004-2c090f993556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:18.612462 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8b699-a47f-485f-9004-2c090f993556 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:18.622420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa4592-f351-4627-9d70-81d1ad179ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:18.624052 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa4592-f351-4627-9d70-81d1ad179ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:18.624343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa4592-f351-4627-9d70-81d1ad179ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:18.624623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa4592-f351-4627-9d70-81d1ad179ad9 admin admin] PATH_INFO: `/v3/projects/a05e273048cc4c77abf8747d23b0fa1a` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:18.625878 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e05f6-853c-46d3-90e0-53ec167592e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b086d7ddb9245e484c85cecf8eacafb, user_id=e79a4d84eb1348cb843d82154784815a, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:18.627792 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa4592-f351-4627-9d70-81d1ad179ad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a05e273048cc4c77abf8747d23b0fa1a)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:18.629414 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e05f6-853c-46d3-90e0-53ec167592e4 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:18.629682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa4592-f351-4627-9d70-81d1ad179ad9 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:18.651697 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1120/2231] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:18 2022] PUT /identity/v3/projects/1b086d7ddb9245e484c85cecf8eacafb/users/e79a4d84eb1348cb843d82154784815a/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:18.663661 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf1981-bb05-47f8-b077-d2ad413028f1 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:18.664202 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf1981-bb05-47f8-b077-d2ad413028f1 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:18.664786 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf1981-bb05-47f8-b077-d2ad413028f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:18.698608 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-57fa4592-f351-4627-9d70-81d1ad179ad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a05e273048cc4c77abf8747d23b0fa1a', 'request_id': 'req-57fa4592-f351-4627-9d70-81d1ad179ad9'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:18.705924 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-cfbf1981-bb05-47f8-b077-d2ad413028f1 None None] MFA Rules not processed for user `e79a4d84eb1348cb843d82154784815a`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:18.707676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-cfbf1981-bb05-47f8-b077-d2ad413028f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:18.709063 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-57fa4592-f351-4627-9d70-81d1ad179ad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a05e273048cc4c77abf8747d23b0fa1a', 'request_id': 'req-57fa4592-f351-4627-9d70-81d1ad179ad9'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:18.716677 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-57fa4592-f351-4627-9d70-81d1ad179ad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a05e273048cc4c77abf8747d23b0fa1a', 'request_id': 'req-57fa4592-f351-4627-9d70-81d1ad179ad9'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:18.730604 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-57fa4592-f351-4627-9d70-81d1ad179ad9 admin admin] The token cache is being invalidate because project a05e273048cc4c77abf8747d23b0fa1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:18.730974 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-57fa4592-f351-4627-9d70-81d1ad179ad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:18.731704 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-57fa4592-f351-4627-9d70-81d1ad179ad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:18.737303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1112/2232] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:40:18 2022] DELETE /identity/v3/projects/a05e273048cc4c77abf8747d23b0fa1a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:18.739092 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:18.739289 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe4ace-3548-4c63-ad00-d275e6d87155 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:18.739602 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe4ace-3548-4c63-ad00-d275e6d87155 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:18.739884 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe4ace-3548-4c63-ad00-d275e6d87155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:18.764020 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-06fe4ace-3548-4c63-ad00-d275e6d87155 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:18.765246 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-06fe4ace-3548-4c63-ad00-d275e6d87155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:18.798310 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1121/2233] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:18.803632 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf1981-bb05-47f8-b077-d2ad413028f1 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:18.805030 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-cfbf1981-bb05-47f8-b077-d2ad413028f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:18.847443 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1113/2234] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:40:18.847443 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe4ace-3548-4c63-ad00-d275e6d87155 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:18.847443 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-06fe4ace-3548-4c63-ad00-d275e6d87155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:18.857627 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe4ace-3548-4c63-ad00-d275e6d87155 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:18.864332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d264d06-cabe-480c-bd80-2e472b8e83cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:18.865353 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d264d06-cabe-480c-bd80-2e472b8e83cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:18.865637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d264d06-cabe-480c-bd80-2e472b8e83cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:18.867159 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d264d06-cabe-480c-bd80-2e472b8e83cd admin admin] PATH_INFO: `/v3/projects/36c784cf9c364c0aad99ab283886a3bf` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:18.868575 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d264d06-cabe-480c-bd80-2e472b8e83cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=36c784cf9c364c0aad99ab283886a3bf)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:18.870932 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d264d06-cabe-480c-bd80-2e472b8e83cd admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:18.884498 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf1981-bb05-47f8-b077-d2ad413028f1 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:18.888095 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:18.889177 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75396c58-cbac-49af-9284-64a7dc077d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:18.889909 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75396c58-cbac-49af-9284-64a7dc077d94 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:18.890297 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75396c58-cbac-49af-9284-64a7dc077d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:18.891112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75396c58-cbac-49af-9284-64a7dc077d94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:18.891853 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75396c58-cbac-49af-9284-64a7dc077d94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:18.894107 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75396c58-cbac-49af-9284-64a7dc077d94 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:18.923937 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1122/2235] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:40:18 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:18.924144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-9d264d06-cabe-480c-bd80-2e472b8e83cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36c784cf9c364c0aad99ab283886a3bf', 'request_id': 'req-9d264d06-cabe-480c-bd80-2e472b8e83cd'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:18.924254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fb0d1-b4d7-40f2-b058-2b9cf8e7e269 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:18.924254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fb0d1-b4d7-40f2-b058-2b9cf8e7e269 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:18.924254 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fb0d1-b4d7-40f2-b058-2b9cf8e7e269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:18.931363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-9d264d06-cabe-480c-bd80-2e472b8e83cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36c784cf9c364c0aad99ab283886a3bf', 'request_id': 'req-9d264d06-cabe-480c-bd80-2e472b8e83cd'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:18.937801 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-9d264d06-cabe-480c-bd80-2e472b8e83cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36c784cf9c364c0aad99ab283886a3bf', 'request_id': 'req-9d264d06-cabe-480c-bd80-2e472b8e83cd'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:18.941822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-e79fb0d1-b4d7-40f2-b058-2b9cf8e7e269 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:18.943046 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-e79fb0d1-b4d7-40f2-b058-2b9cf8e7e269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:18.955951 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-9d264d06-cabe-480c-bd80-2e472b8e83cd admin admin] The token cache is being invalidate because project 36c784cf9c364c0aad99ab283886a3bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:18.956249 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-9d264d06-cabe-480c-bd80-2e472b8e83cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:18.956937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-9d264d06-cabe-480c-bd80-2e472b8e83cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:18.958732 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1114/2236] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:40:18 2022] DELETE /identity/v3/projects/36c784cf9c364c0aad99ab283886a3bf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:18.959263 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d264d06-cabe-480c-bd80-2e472b8e83cd admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:18.963087 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-9d264d06-cabe-480c-bd80-2e472b8e83cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:19.017375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1123/2237] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:19.018648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb647ed-fdb2-46a6-babf-bf67697f664c None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.019012 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb647ed-fdb2-46a6-babf-bf67697f664c None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.019393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb647ed-fdb2-46a6-babf-bf67697f664c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.038557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-beb647ed-fdb2-46a6-babf-bf67697f664c None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:19.039785 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-beb647ed-fdb2-46a6-babf-bf67697f664c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:19.042581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d264d06-cabe-480c-bd80-2e472b8e83cd admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:19.047789 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85adb52-8226-47e4-aef9-eb86805293e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:19.054662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85adb52-8226-47e4-aef9-eb86805293e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.054830 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1124/2238] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:19.054947 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85adb52-8226-47e4-aef9-eb86805293e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.054947 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85adb52-8226-47e4-aef9-eb86805293e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.055119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb647ed-fdb2-46a6-babf-bf67697f664c None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:19.055209 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85adb52-8226-47e4-aef9-eb86805293e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:19.055209 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85adb52-8226-47e4-aef9-eb86805293e5 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:19.059126 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb647ed-fdb2-46a6-babf-bf67697f664c None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:19.063623 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d8de7-b147-427b-be2e-ea69b62bc4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:19.064383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d8de7-b147-427b-be2e-ea69b62bc4ed admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.064727 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d8de7-b147-427b-be2e-ea69b62bc4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.065068 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d8de7-b147-427b-be2e-ea69b62bc4ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.065860 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d8de7-b147-427b-be2e-ea69b62bc4ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:40:19.066231 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d8de7-b147-427b-be2e-ea69b62bc4ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:19.067974 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d8de7-b147-427b-be2e-ea69b62bc4ed admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:19.081805 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1125/2239] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:40:19.085426 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1115/2240] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:40:18 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:19.086565 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85adb52-8226-47e4-aef9-eb86805293e5 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:19.086896 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf2118-a746-4093-b91d-864c6133f8d8 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.087188 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf2118-a746-4093-b91d-864c6133f8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.087498 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf2118-a746-4093-b91d-864c6133f8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.099563 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85adb52-8226-47e4-aef9-eb86805293e5 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:19.106236 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830aa4a2-109f-4615-84eb-9322c50b8f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:19.107170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830aa4a2-109f-4615-84eb-9322c50b8f03 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.107701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830aa4a2-109f-4615-84eb-9322c50b8f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.108048 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830aa4a2-109f-4615-84eb-9322c50b8f03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.109244 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830aa4a2-109f-4615-84eb-9322c50b8f03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:19.109381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-6fbf2118-a746-4093-b91d-864c6133f8d8 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:19.110207 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-6fbf2118-a746-4093-b91d-864c6133f8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:19.111175 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830aa4a2-109f-4615-84eb-9322c50b8f03 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:19.123879 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1126/2241] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:19.123879 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf2118-a746-4093-b91d-864c6133f8d8 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:19.132580 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf2118-a746-4093-b91d-864c6133f8d8 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:19.139160 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42f571-a52a-49a3-9cc7-11b4e1fef989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:19.140316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42f571-a52a-49a3-9cc7-11b4e1fef989 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.141458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42f571-a52a-49a3-9cc7-11b4e1fef989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.142821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42f571-a52a-49a3-9cc7-11b4e1fef989 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.144210 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42f571-a52a-49a3-9cc7-11b4e1fef989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:19.147341 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42f571-a52a-49a3-9cc7-11b4e1fef989 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:19.149787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1116/2242] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:40:19 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:19.150486 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830aa4a2-109f-4615-84eb-9322c50b8f03 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:19.160727 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1127/2243] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:19.161806 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42f571-a52a-49a3-9cc7-11b4e1fef989 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:19.176906 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42f571-a52a-49a3-9cc7-11b4e1fef989 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:19.187017 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:19.227232 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830aa4a2-109f-4615-84eb-9322c50b8f03 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:19.232223 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6f24a-5b94-4858-97cf-84455e7c0181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:19.232902 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6f24a-5b94-4858-97cf-84455e7c0181 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.233180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6f24a-5b94-4858-97cf-84455e7c0181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.233452 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6f24a-5b94-4858-97cf-84455e7c0181 admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.234188 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6f24a-5b94-4858-97cf-84455e7c0181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:40:19.234543 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6f24a-5b94-4858-97cf-84455e7c0181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:19.236201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6f24a-5b94-4858-97cf-84455e7c0181 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:19.242692 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0618db-6597-452a-9c95-8bff43e339e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:19.243725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0618db-6597-452a-9c95-8bff43e339e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.244221 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0618db-6597-452a-9c95-8bff43e339e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.244505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0618db-6597-452a-9c95-8bff43e339e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.245229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0618db-6597-452a-9c95-8bff43e339e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:19.247435 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0618db-6597-452a-9c95-8bff43e339e0 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:19.253977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1117/2244] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:40:19.253977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6f24a-5b94-4858-97cf-84455e7c0181 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:19.264914 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6f24a-5b94-4858-97cf-84455e7c0181 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:19.270353 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072189d-707e-474d-81c0-453cf3f9859f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:19.271257 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072189d-707e-474d-81c0-453cf3f9859f admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.271734 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1128/2245] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:40:19 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:19.272651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0618db-6597-452a-9c95-8bff43e339e0 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:19.275394 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072189d-707e-474d-81c0-453cf3f9859f admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.276111 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072189d-707e-474d-81c0-453cf3f9859f admin admin] PATH_INFO: `/v3/projects/3e6c31541afb48d5a5bfd66c458f45c0/users/c3423ae09563469087145205bc7b150b/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.279866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:19.285924 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0618db-6597-452a-9c95-8bff43e339e0 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:19.298343 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ec8fa-8c05-4c0c-b8c6-1e7fe7d38fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:19.298902 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072189d-707e-474d-81c0-453cf3f9859f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6c31541afb48d5a5bfd66c458f45c0, user_id=c3423ae09563469087145205bc7b150b, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:19.299030 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ec8fa-8c05-4c0c-b8c6-1e7fe7d38fbb admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.299462 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ec8fa-8c05-4c0c-b8c6-1e7fe7d38fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.299746 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ec8fa-8c05-4c0c-b8c6-1e7fe7d38fbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.301151 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ec8fa-8c05-4c0c-b8c6-1e7fe7d38fbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:19.302039 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072189d-707e-474d-81c0-453cf3f9859f admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:19.303499 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ec8fa-8c05-4c0c-b8c6-1e7fe7d38fbb admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:19.320944 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1118/2246] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:19 2022] PUT /identity/v3/projects/3e6c31541afb48d5a5bfd66c458f45c0/users/c3423ae09563469087145205bc7b150b/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:19.322275 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072189d-707e-474d-81c0-453cf3f9859f admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:19.353020 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1129/2247] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:40:19 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:19.354059 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ec8fa-8c05-4c0c-b8c6-1e7fe7d38fbb admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:19.404053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072189d-707e-474d-81c0-453cf3f9859f admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:19.428537 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ec8fa-8c05-4c0c-b8c6-1e7fe7d38fbb admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:19.434059 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee81b1-55d9-477a-b571-1f3eed37058f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:19.434817 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee81b1-55d9-477a-b571-1f3eed37058f admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.435331 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee81b1-55d9-477a-b571-1f3eed37058f admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.435455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee81b1-55d9-477a-b571-1f3eed37058f admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.436193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee81b1-55d9-477a-b571-1f3eed37058f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:19.438635 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee81b1-55d9-477a-b571-1f3eed37058f admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:19.455994 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1130/2248] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:19.455994 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee81b1-55d9-477a-b571-1f3eed37058f admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:19.468170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee81b1-55d9-477a-b571-1f3eed37058f admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:19.473105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088ac7d-d088-4af6-b45b-c903ea5be90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:19.473765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bb1bb-fdea-4a31-a864-ac2724ee27ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:19.474101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088ac7d-d088-4af6-b45b-c903ea5be90e admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.474487 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088ac7d-d088-4af6-b45b-c903ea5be90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.474668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bb1bb-fdea-4a31-a864-ac2724ee27ef admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.474916 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bb1bb-fdea-4a31-a864-ac2724ee27ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.475199 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bb1bb-fdea-4a31-a864-ac2724ee27ef admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.475848 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088ac7d-d088-4af6-b45b-c903ea5be90e admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.475980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bb1bb-fdea-4a31-a864-ac2724ee27ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:19.476781 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088ac7d-d088-4af6-b45b-c903ea5be90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:19.477985 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bb1bb-fdea-4a31-a864-ac2724ee27ef admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:19.480304 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088ac7d-d088-4af6-b45b-c903ea5be90e admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:19.496726 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1119/2249] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:19.497627 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088ac7d-d088-4af6-b45b-c903ea5be90e admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:19.505528 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1131/2250] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:40:19 2022] POST /identity/v3/users => generated 287 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:19.506595 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bb1bb-fdea-4a31-a864-ac2724ee27ef admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:19.509875 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088ac7d-d088-4af6-b45b-c903ea5be90e admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:19.516891 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e2322-586e-4e39-a855-a1fe760f780f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:19.517788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e2322-586e-4e39-a855-a1fe760f780f admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.518073 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e2322-586e-4e39-a855-a1fe760f780f admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.518350 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e2322-586e-4e39-a855-a1fe760f780f admin admin] PATH_INFO: `/v3/projects/3e6c31541afb48d5a5bfd66c458f45c0/users/c3423ae09563469087145205bc7b150b/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.518949 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bb1bb-fdea-4a31-a864-ac2724ee27ef admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:19.520393 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e2322-586e-4e39-a855-a1fe760f780f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6c31541afb48d5a5bfd66c458f45c0, user_id=c3423ae09563469087145205bc7b150b, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:19.523070 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e2322-586e-4e39-a855-a1fe760f780f admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:19.524648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84768d5-bdaf-4a19-9d65-b1acfeede184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:19.525497 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84768d5-bdaf-4a19-9d65-b1acfeede184 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.525942 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84768d5-bdaf-4a19-9d65-b1acfeede184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.526388 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84768d5-bdaf-4a19-9d65-b1acfeede184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.527122 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84768d5-bdaf-4a19-9d65-b1acfeede184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:19.528784 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84768d5-bdaf-4a19-9d65-b1acfeede184 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:19.536048 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1120/2251] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:19 2022] PUT /identity/v3/projects/3e6c31541afb48d5a5bfd66c458f45c0/users/c3423ae09563469087145205bc7b150b/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:19.536947 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e2322-586e-4e39-a855-a1fe760f780f admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:19.552093 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1132/2252] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:19.558874 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664b147-af9f-4caf-b6a2-3434d51d2877 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.559166 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664b147-af9f-4caf-b6a2-3434d51d2877 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.559474 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664b147-af9f-4caf-b6a2-3434d51d2877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.593172 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-c664b147-af9f-4caf-b6a2-3434d51d2877 None None] MFA Rules not processed for user `c3423ae09563469087145205bc7b150b`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:19.595178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-c664b147-af9f-4caf-b6a2-3434d51d2877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:19.622180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e2322-586e-4e39-a855-a1fe760f780f admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:19.629916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84728c-3cae-4f2e-9e87-02f056d9b34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:19.631469 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84728c-3cae-4f2e-9e87-02f056d9b34c admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.639343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84728c-3cae-4f2e-9e87-02f056d9b34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.639343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84728c-3cae-4f2e-9e87-02f056d9b34c admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.639343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84728c-3cae-4f2e-9e87-02f056d9b34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:19.639343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84728c-3cae-4f2e-9e87-02f056d9b34c admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:19.642131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:19.652964 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1121/2253] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:19.653985 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84728c-3cae-4f2e-9e87-02f056d9b34c admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:19.665787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84728c-3cae-4f2e-9e87-02f056d9b34c admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:19.670343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d2fff-a508-42a4-a3a4-c68a2e468b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:19.671208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d2fff-a508-42a4-a3a4-c68a2e468b0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.671527 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d2fff-a508-42a4-a3a4-c68a2e468b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.671840 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d2fff-a508-42a4-a3a4-c68a2e468b0c admin admin] PATH_INFO: `/v3/projects/6f8cea4b2c364af1abc57e5872f0ef44/users/2f377fef4f8d48679bc16ca61e45fdc1/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.674012 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1133/2254] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:19.674848 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664b147-af9f-4caf-b6a2-3434d51d2877 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:19.675797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:19.684824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664b147-af9f-4caf-b6a2-3434d51d2877 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:19.689570 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15723997-fb1f-4635-8de9-f6a1ee4487d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:19.690240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15723997-fb1f-4635-8de9-f6a1ee4487d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.690523 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15723997-fb1f-4635-8de9-f6a1ee4487d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.690801 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15723997-fb1f-4635-8de9-f6a1ee4487d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.691697 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15723997-fb1f-4635-8de9-f6a1ee4487d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:19.692900 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d2fff-a508-42a4-a3a4-c68a2e468b0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f8cea4b2c364af1abc57e5872f0ef44, user_id=2f377fef4f8d48679bc16ca61e45fdc1, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:19.693304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15723997-fb1f-4635-8de9-f6a1ee4487d3 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:19.695585 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d2fff-a508-42a4-a3a4-c68a2e468b0c admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:19.707439 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1134/2255] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:19.707439 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15723997-fb1f-4635-8de9-f6a1ee4487d3 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:19.707439 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-15723997-fb1f-4635-8de9-f6a1ee4487d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:19.712680 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1122/2256] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:19 2022] PUT /identity/v3/projects/6f8cea4b2c364af1abc57e5872f0ef44/users/2f377fef4f8d48679bc16ca61e45fdc1/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:19.716135 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d2fff-a508-42a4-a3a4-c68a2e468b0c admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:19.765006 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15723997-fb1f-4635-8de9-f6a1ee4487d3 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:19.781024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d2fff-a508-42a4-a3a4-c68a2e468b0c admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:19.787898 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed507b6-dfe3-4749-8b93-3ba5bd1c2933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:19.789191 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed507b6-dfe3-4749-8b93-3ba5bd1c2933 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.789675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed507b6-dfe3-4749-8b93-3ba5bd1c2933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.790011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed507b6-dfe3-4749-8b93-3ba5bd1c2933 admin admin] PATH_INFO: `/v3/projects/1e1a71d909a04cf2834df4dc1837e69d/users/f11db409960b47bab310605d0bfcc34d/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.813927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed507b6-dfe3-4749-8b93-3ba5bd1c2933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1a71d909a04cf2834df4dc1837e69d, user_id=f11db409960b47bab310605d0bfcc34d, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:19.817008 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed507b6-dfe3-4749-8b93-3ba5bd1c2933 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:19.822394 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4802a2-d4dc-40c1-9f3b-802fbe3d79f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:19.823236 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4802a2-d4dc-40c1-9f3b-802fbe3d79f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.823555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4802a2-d4dc-40c1-9f3b-802fbe3d79f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.823922 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4802a2-d4dc-40c1-9f3b-802fbe3d79f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.826265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-3f4802a2-d4dc-40c1-9f3b-802fbe3d79f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:19.834436 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1123/2257] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:19 2022] PUT /identity/v3/projects/1e1a71d909a04cf2834df4dc1837e69d/users/f11db409960b47bab310605d0bfcc34d/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:19.835254 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8902032-6e09-412f-8d58-7e67ac3de42b None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.835575 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8902032-6e09-412f-8d58-7e67ac3de42b None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.835855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8902032-6e09-412f-8d58-7e67ac3de42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.867561 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-d8902032-6e09-412f-8d58-7e67ac3de42b None None] MFA Rules not processed for user `2f377fef4f8d48679bc16ca61e45fdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:19.868827 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-d8902032-6e09-412f-8d58-7e67ac3de42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:19.902065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4802a2-d4dc-40c1-9f3b-802fbe3d79f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:19.903556 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4802a2-d4dc-40c1-9f3b-802fbe3d79f4 service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:19.912866 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1135/2258] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:19.914110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f0825-75e9-431d-a242-49801cfd2f55 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:19.914396 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f0825-75e9-431d-a242-49801cfd2f55 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:19.914720 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f0825-75e9-431d-a242-49801cfd2f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:19.935754 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1124/2259] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:19.944737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-9f3f0825-75e9-431d-a242-49801cfd2f55 None None] MFA Rules not processed for user `f11db409960b47bab310605d0bfcc34d`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:19.946379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-9f3f0825-75e9-431d-a242-49801cfd2f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:19.947005 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8902032-6e09-412f-8d58-7e67ac3de42b None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:19.948959 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-d8902032-6e09-412f-8d58-7e67ac3de42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:19.975624 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=100 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:20.025276 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1136/2260] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:20.030972 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8902032-6e09-412f-8d58-7e67ac3de42b None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:20.035036 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278966b-93f9-40b1-aad3-080e4be6e8ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:20.035989 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278966b-93f9-40b1-aad3-080e4be6e8ed service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:20.036337 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278966b-93f9-40b1-aad3-080e4be6e8ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:20.036704 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278966b-93f9-40b1-aad3-080e4be6e8ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:20.046187 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278966b-93f9-40b1-aad3-080e4be6e8ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:20.048709 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278966b-93f9-40b1-aad3-080e4be6e8ed service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:20.053616 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:20.060160 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1125/2261] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:40:20.168977 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f0825-75e9-431d-a242-49801cfd2f55 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:20.192850 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f0825-75e9-431d-a242-49801cfd2f55 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:20.197729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da12828-147c-4456-87ba-50dc4233122c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:20.198802 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da12828-147c-4456-87ba-50dc4233122c service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:20.199313 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da12828-147c-4456-87ba-50dc4233122c service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:20.199786 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da12828-147c-4456-87ba-50dc4233122c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:20.211550 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da12828-147c-4456-87ba-50dc4233122c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:20.213434 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da12828-147c-4456-87ba-50dc4233122c service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:20.239778 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1137/2262] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:23.736887 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278966b-93f9-40b1-aad3-080e4be6e8ed service cinder] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:23.800922 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278966b-93f9-40b1-aad3-080e4be6e8ed service cinder] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:23.805480 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d4172-7163-4b49-85cc-bf596ba3fdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:23.806356 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d4172-7163-4b49-85cc-bf596ba3fdfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:23.806639 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d4172-7163-4b49-85cc-bf596ba3fdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:23.806912 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d4172-7163-4b49-85cc-bf596ba3fdfc admin admin] PATH_INFO: `/v3/users/e79a4d84eb1348cb843d82154784815a` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:23.808142 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d4172-7163-4b49-85cc-bf596ba3fdfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e79a4d84eb1348cb843d82154784815a)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:23.810208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d4172-7163-4b49-85cc-bf596ba3fdfc admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:23.861047 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ee8d4172-7163-4b49-85cc-bf596ba3fdfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e79a4d84eb1348cb843d82154784815a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:23.867998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ee8d4172-7163-4b49-85cc-bf596ba3fdfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e79a4d84eb1348cb843d82154784815a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:23.868717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ee8d4172-7163-4b49-85cc-bf596ba3fdfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e79a4d84eb1348cb843d82154784815a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:23.881328 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ee8d4172-7163-4b49-85cc-bf596ba3fdfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e79a4d84eb1348cb843d82154784815a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:23.888929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ee8d4172-7163-4b49-85cc-bf596ba3fdfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e79a4d84eb1348cb843d82154784815a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:23.894954 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1126/2263] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:40:23 2022] DELETE /identity/v3/users/e79a4d84eb1348cb843d82154784815a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:23.899349 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c294d-32ca-4550-a210-78b26d561445 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:23.899837 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c294d-32ca-4550-a210-78b26d561445 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:23.899928 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c294d-32ca-4550-a210-78b26d561445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:23.917205 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-594c294d-32ca-4550-a210-78b26d561445 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:23.918412 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-594c294d-32ca-4550-a210-78b26d561445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:23.979917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1138/2264] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:23.990088 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d4172-7163-4b49-85cc-bf596ba3fdfc admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:23.991505 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-ee8d4172-7163-4b49-85cc-bf596ba3fdfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:24.049942 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d4172-7163-4b49-85cc-bf596ba3fdfc admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:24.053580 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac44d52-12f6-4b38-b5da-bf245c02bbc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:24.054226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac44d52-12f6-4b38-b5da-bf245c02bbc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:24.054507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac44d52-12f6-4b38-b5da-bf245c02bbc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:24.054783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac44d52-12f6-4b38-b5da-bf245c02bbc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:24.064023 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac44d52-12f6-4b38-b5da-bf245c02bbc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:24.065477 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac44d52-12f6-4b38-b5da-bf245c02bbc7 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:24.074889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1127/2265] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:24.344763 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c294d-32ca-4550-a210-78b26d561445 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:24.346278 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-594c294d-32ca-4550-a210-78b26d561445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:24.372136 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c294d-32ca-4550-a210-78b26d561445 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:24.379726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f6a59-fe59-42ae-974f-eaa287802ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:24.380705 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f6a59-fe59-42ae-974f-eaa287802ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:24.380992 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f6a59-fe59-42ae-974f-eaa287802ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:24.381274 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f6a59-fe59-42ae-974f-eaa287802ca7 admin admin] PATH_INFO: `/v3/projects/1b086d7ddb9245e484c85cecf8eacafb` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:24.382559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f6a59-fe59-42ae-974f-eaa287802ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b086d7ddb9245e484c85cecf8eacafb)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:24.384522 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f6a59-fe59-42ae-974f-eaa287802ca7 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:24.434637 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ef0f6a59-fe59-42ae-974f-eaa287802ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b086d7ddb9245e484c85cecf8eacafb', 'request_id': 'req-ef0f6a59-fe59-42ae-974f-eaa287802ca7'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:24.442549 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ef0f6a59-fe59-42ae-974f-eaa287802ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b086d7ddb9245e484c85cecf8eacafb', 'request_id': 'req-ef0f6a59-fe59-42ae-974f-eaa287802ca7'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:24.448759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ef0f6a59-fe59-42ae-974f-eaa287802ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b086d7ddb9245e484c85cecf8eacafb', 'request_id': 'req-ef0f6a59-fe59-42ae-974f-eaa287802ca7'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:24.460790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ef0f6a59-fe59-42ae-974f-eaa287802ca7 admin admin] The token cache is being invalidate because project 1b086d7ddb9245e484c85cecf8eacafb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:24.461076 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ef0f6a59-fe59-42ae-974f-eaa287802ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:24.461719 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ef0f6a59-fe59-42ae-974f-eaa287802ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:24.463252 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1139/2266] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:40:24 2022] DELETE /identity/v3/projects/1b086d7ddb9245e484c85cecf8eacafb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:24.467103 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac44d52-12f6-4b38-b5da-bf245c02bbc7 service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:24.477017 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac44d52-12f6-4b38-b5da-bf245c02bbc7 service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:24.495151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:24.537168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedf0b6-ddbc-4429-a874-ca5919fda783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:24.538051 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedf0b6-ddbc-4429-a874-ca5919fda783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:24.538334 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedf0b6-ddbc-4429-a874-ca5919fda783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:24.538607 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedf0b6-ddbc-4429-a874-ca5919fda783 admin admin] PATH_INFO: `/v3/users/c3423ae09563469087145205bc7b150b` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:24.539843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedf0b6-ddbc-4429-a874-ca5919fda783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3423ae09563469087145205bc7b150b)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:24.541806 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedf0b6-ddbc-4429-a874-ca5919fda783 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:24.601487 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-8cedf0b6-ddbc-4429-a874-ca5919fda783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3423ae09563469087145205bc7b150b'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:24.608519 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-8cedf0b6-ddbc-4429-a874-ca5919fda783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3423ae09563469087145205bc7b150b'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:24.609207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-8cedf0b6-ddbc-4429-a874-ca5919fda783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3423ae09563469087145205bc7b150b'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:24.620753 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-8cedf0b6-ddbc-4429-a874-ca5919fda783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3423ae09563469087145205bc7b150b'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:24.628644 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-8cedf0b6-ddbc-4429-a874-ca5919fda783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3423ae09563469087145205bc7b150b'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:24.634555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1128/2267] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:40:24 2022] DELETE /identity/v3/users/c3423ae09563469087145205bc7b150b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:24.910906 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f6a59-fe59-42ae-974f-eaa287802ca7 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:24.912393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-ef0f6a59-fe59-42ae-974f-eaa287802ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:24.931373 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f6a59-fe59-42ae-974f-eaa287802ca7 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:24.965342 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:24.996914 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c7d45-0303-438a-986a-ea87d5bcc689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:24.997787 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c7d45-0303-438a-986a-ea87d5bcc689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:24.998063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c7d45-0303-438a-986a-ea87d5bcc689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:24.998338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c7d45-0303-438a-986a-ea87d5bcc689 admin admin] PATH_INFO: `/v3/projects/3e6c31541afb48d5a5bfd66c458f45c0` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:24.999559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c7d45-0303-438a-986a-ea87d5bcc689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e6c31541afb48d5a5bfd66c458f45c0)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:25.002138 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c7d45-0303-438a-986a-ea87d5bcc689 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:25.055630 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4d8c7d45-0303-438a-986a-ea87d5bcc689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e6c31541afb48d5a5bfd66c458f45c0', 'request_id': 'req-4d8c7d45-0303-438a-986a-ea87d5bcc689'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:25.065987 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4d8c7d45-0303-438a-986a-ea87d5bcc689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e6c31541afb48d5a5bfd66c458f45c0', 'request_id': 'req-4d8c7d45-0303-438a-986a-ea87d5bcc689'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:25.071803 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4d8c7d45-0303-438a-986a-ea87d5bcc689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e6c31541afb48d5a5bfd66c458f45c0', 'request_id': 'req-4d8c7d45-0303-438a-986a-ea87d5bcc689'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:25.082841 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4d8c7d45-0303-438a-986a-ea87d5bcc689 admin admin] The token cache is being invalidate because project 3e6c31541afb48d5a5bfd66c458f45c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:25.083135 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4d8c7d45-0303-438a-986a-ea87d5bcc689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:25.083802 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4d8c7d45-0303-438a-986a-ea87d5bcc689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:25.085355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1140/2268] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:40:24 2022] DELETE /identity/v3/projects/3e6c31541afb48d5a5bfd66c458f45c0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:25.090528 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf206ad2-a5ca-4ec7-8fd9-8a544bad0f52 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:25.090990 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf206ad2-a5ca-4ec7-8fd9-8a544bad0f52 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:25.091090 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf206ad2-a5ca-4ec7-8fd9-8a544bad0f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:25.109417 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-cf206ad2-a5ca-4ec7-8fd9-8a544bad0f52 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:25.111123 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-cf206ad2-a5ca-4ec7-8fd9-8a544bad0f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:25.168214 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1129/2269] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:25.176453 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c818b0-ea01-4715-8b7b-ec71b9ea259d None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:25.176749 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c818b0-ea01-4715-8b7b-ec71b9ea259d None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:25.177035 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c818b0-ea01-4715-8b7b-ec71b9ea259d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:25.195146 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-49c818b0-ea01-4715-8b7b-ec71b9ea259d None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:25.196377 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-49c818b0-ea01-4715-8b7b-ec71b9ea259d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:25.204838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1141/2270] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:25.208973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf206ad2-a5ca-4ec7-8fd9-8a544bad0f52 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:25.220134 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf206ad2-a5ca-4ec7-8fd9-8a544bad0f52 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:25.225053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cb46e-40b1-4347-a5f6-92bd9646b34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:25.225711 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cb46e-40b1-4347-a5f6-92bd9646b34e admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:25.226001 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cb46e-40b1-4347-a5f6-92bd9646b34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:25.226276 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cb46e-40b1-4347-a5f6-92bd9646b34e admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:25.227002 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cb46e-40b1-4347-a5f6-92bd9646b34e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:40:25.227337 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cb46e-40b1-4347-a5f6-92bd9646b34e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:25.228922 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cb46e-40b1-4347-a5f6-92bd9646b34e admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:25.245605 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1130/2271] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:40:25.249919 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c818b0-ea01-4715-8b7b-ec71b9ea259d None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:25.259158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c818b0-ea01-4715-8b7b-ec71b9ea259d None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:25.263807 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d7d56-9743-4429-b79e-eccf2b8cab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:25.264462 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d7d56-9743-4429-b79e-eccf2b8cab31 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:25.264750 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d7d56-9743-4429-b79e-eccf2b8cab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:25.265032 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d7d56-9743-4429-b79e-eccf2b8cab31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:25.265740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d7d56-9743-4429-b79e-eccf2b8cab31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:25.267701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d7d56-9743-4429-b79e-eccf2b8cab31 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:25.293708 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1142/2272] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:40:25 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:25.298661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cb46e-40b1-4347-a5f6-92bd9646b34e admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:25.315150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cb46e-40b1-4347-a5f6-92bd9646b34e admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:25.340842 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:25.373254 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a9aba-47a7-42fd-9ae2-73bfb188ab8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:25.373918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a9aba-47a7-42fd-9ae2-73bfb188ab8a admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:25.374202 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a9aba-47a7-42fd-9ae2-73bfb188ab8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:25.374530 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a9aba-47a7-42fd-9ae2-73bfb188ab8a admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:25.375260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a9aba-47a7-42fd-9ae2-73bfb188ab8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:25.377265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a9aba-47a7-42fd-9ae2-73bfb188ab8a admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:25.396005 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1131/2273] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:40:25 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:25.400121 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d7d56-9743-4429-b79e-eccf2b8cab31 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:25.410810 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d7d56-9743-4429-b79e-eccf2b8cab31 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:25.415422 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0060cd3-5991-415d-a8a0-b8d817eca74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:25.416083 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0060cd3-5991-415d-a8a0-b8d817eca74f admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:25.416368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0060cd3-5991-415d-a8a0-b8d817eca74f admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:25.416648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0060cd3-5991-415d-a8a0-b8d817eca74f admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:25.417373 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0060cd3-5991-415d-a8a0-b8d817eca74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:25.418974 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0060cd3-5991-415d-a8a0-b8d817eca74f admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:25.429698 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1143/2274] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:25.433385 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a9aba-47a7-42fd-9ae2-73bfb188ab8a admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:25.443155 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a9aba-47a7-42fd-9ae2-73bfb188ab8a admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:25.447831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16407d0-0fdc-4a80-a908-9cf09e13d580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:25.448482 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16407d0-0fdc-4a80-a908-9cf09e13d580 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:25.448767 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16407d0-0fdc-4a80-a908-9cf09e13d580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:25.449042 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16407d0-0fdc-4a80-a908-9cf09e13d580 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:25.449785 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16407d0-0fdc-4a80-a908-9cf09e13d580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:25.451392 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16407d0-0fdc-4a80-a908-9cf09e13d580 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:25.461078 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1132/2275] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:25.464924 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0060cd3-5991-415d-a8a0-b8d817eca74f admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:25.475705 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0060cd3-5991-415d-a8a0-b8d817eca74f admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:25.480302 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c054a14-264a-4973-a40b-b0bc884125d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:25.481169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c054a14-264a-4973-a40b-b0bc884125d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:25.481448 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c054a14-264a-4973-a40b-b0bc884125d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:25.481720 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c054a14-264a-4973-a40b-b0bc884125d7 admin admin] PATH_INFO: `/v3/projects/ec7c77a6b40342498c9568b43986716c/users/73cce4bc138849a68e9fc403756425ba/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:25.496333 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c054a14-264a-4973-a40b-b0bc884125d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec7c77a6b40342498c9568b43986716c, user_id=73cce4bc138849a68e9fc403756425ba, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:25.498978 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c054a14-264a-4973-a40b-b0bc884125d7 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:25.511856 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1144/2276] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:25 2022] PUT /identity/v3/projects/ec7c77a6b40342498c9568b43986716c/users/73cce4bc138849a68e9fc403756425ba/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:25.523683 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6aa38-3d95-4b4d-9fce-8c0947309b5b None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:25.523981 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6aa38-3d95-4b4d-9fce-8c0947309b5b None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:25.524267 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6aa38-3d95-4b4d-9fce-8c0947309b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:25.550752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-aff6aa38-3d95-4b4d-9fce-8c0947309b5b None None] MFA Rules not processed for user `73cce4bc138849a68e9fc403756425ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:25.551948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-aff6aa38-3d95-4b4d-9fce-8c0947309b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:25.620770 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1133/2277] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:25.625567 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c054a14-264a-4973-a40b-b0bc884125d7 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:25.692718 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c054a14-264a-4973-a40b-b0bc884125d7 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:25.697344 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd03a9-c7f8-4bc2-8e14-8e673db7f588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:25.698000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd03a9-c7f8-4bc2-8e14-8e673db7f588 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:25.698281 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd03a9-c7f8-4bc2-8e14-8e673db7f588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:25.698555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd03a9-c7f8-4bc2-8e14-8e673db7f588 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:25.699249 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd03a9-c7f8-4bc2-8e14-8e673db7f588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:25.701191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd03a9-c7f8-4bc2-8e14-8e673db7f588 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:25.705058 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:25.730746 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1145/2278] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:40:25 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:25.735090 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6aa38-3d95-4b4d-9fce-8c0947309b5b None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:25.746296 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6aa38-3d95-4b4d-9fce-8c0947309b5b None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:25.810830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4b88c-3f25-452a-938c-0a564f985edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:25.811516 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4b88c-3f25-452a-938c-0a564f985edc admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:25.811845 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4b88c-3f25-452a-938c-0a564f985edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:25.812126 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4b88c-3f25-452a-938c-0a564f985edc admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:25.812857 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4b88c-3f25-452a-938c-0a564f985edc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:25.814940 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4b88c-3f25-452a-938c-0a564f985edc admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:25.846782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1134/2279] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:40:25 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:25.848284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd03a9-c7f8-4bc2-8e14-8e673db7f588 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:25.858500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd03a9-c7f8-4bc2-8e14-8e673db7f588 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:25.863107 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e082124-f7d9-415e-95a9-ca731f491a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:25.863779 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e082124-f7d9-415e-95a9-ca731f491a41 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:25.864060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e082124-f7d9-415e-95a9-ca731f491a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:25.864333 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e082124-f7d9-415e-95a9-ca731f491a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:25.865049 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e082124-f7d9-415e-95a9-ca731f491a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:25.866666 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e082124-f7d9-415e-95a9-ca731f491a41 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:25.877410 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1146/2280] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:25.881066 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4b88c-3f25-452a-938c-0a564f985edc admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:25.891267 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4b88c-3f25-452a-938c-0a564f985edc admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:25.895798 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1535d-bee2-49ac-9c05-60b796608d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:25.896423 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1535d-bee2-49ac-9c05-60b796608d47 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:25.896703 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1535d-bee2-49ac-9c05-60b796608d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:25.896974 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1535d-bee2-49ac-9c05-60b796608d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:25.897685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1535d-bee2-49ac-9c05-60b796608d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:25.899254 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1535d-bee2-49ac-9c05-60b796608d47 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:25.908988 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1135/2281] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:25.913751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e082124-f7d9-415e-95a9-ca731f491a41 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:25.924075 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e082124-f7d9-415e-95a9-ca731f491a41 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:25.928777 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e9877-4dc2-4f94-a71d-352d8eddae41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:25.929661 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e9877-4dc2-4f94-a71d-352d8eddae41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:25.929946 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e9877-4dc2-4f94-a71d-352d8eddae41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:25.930225 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e9877-4dc2-4f94-a71d-352d8eddae41 admin admin] PATH_INFO: `/v3/projects/badbaa11d0354ea1ae0ef88272ebc0a6/users/bf2097572ee74ddaa7a96ae606c13ad1/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:25.946040 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e9877-4dc2-4f94-a71d-352d8eddae41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=badbaa11d0354ea1ae0ef88272ebc0a6, user_id=bf2097572ee74ddaa7a96ae606c13ad1, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:25.948766 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e9877-4dc2-4f94-a71d-352d8eddae41 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:25.961815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1147/2282] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:25 2022] PUT /identity/v3/projects/badbaa11d0354ea1ae0ef88272ebc0a6/users/bf2097572ee74ddaa7a96ae606c13ad1/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:25.971820 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929784c-c134-4004-843b-4281a88cc80d None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:25.972118 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929784c-c134-4004-843b-4281a88cc80d None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:25.972400 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929784c-c134-4004-843b-4281a88cc80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:25.998485 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-7929784c-c134-4004-843b-4281a88cc80d None None] MFA Rules not processed for user `bf2097572ee74ddaa7a96ae606c13ad1`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:25.999745 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-7929784c-c134-4004-843b-4281a88cc80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:26.004226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:26.065404 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1136/2283] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:26.069722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e9877-4dc2-4f94-a71d-352d8eddae41 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:26.131892 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e9877-4dc2-4f94-a71d-352d8eddae41 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:26.136716 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68235f1-0543-42fe-aa4c-a20d751879aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:26.137373 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68235f1-0543-42fe-aa4c-a20d751879aa admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:26.137653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68235f1-0543-42fe-aa4c-a20d751879aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:26.137928 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68235f1-0543-42fe-aa4c-a20d751879aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:26.138619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68235f1-0543-42fe-aa4c-a20d751879aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:26.140660 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68235f1-0543-42fe-aa4c-a20d751879aa admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:26.171365 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1148/2284] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:40:26 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:26.175304 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929784c-c134-4004-843b-4281a88cc80d None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:26.186218 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929784c-c134-4004-843b-4281a88cc80d None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:26.244222 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42e84a-5643-4040-b737-46c5b48ae736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:26.244895 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42e84a-5643-4040-b737-46c5b48ae736 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:26.245176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42e84a-5643-4040-b737-46c5b48ae736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:26.245450 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42e84a-5643-4040-b737-46c5b48ae736 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:26.246141 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42e84a-5643-4040-b737-46c5b48ae736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:26.248087 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42e84a-5643-4040-b737-46c5b48ae736 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:26.271642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1137/2285] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:40:26 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:40:26.272882 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68235f1-0543-42fe-aa4c-a20d751879aa admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:26.283361 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68235f1-0543-42fe-aa4c-a20d751879aa admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:26.288106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a02c8d-c054-4ea5-99c0-4d30632a6d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:26.288766 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a02c8d-c054-4ea5-99c0-4d30632a6d1a admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:26.289049 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a02c8d-c054-4ea5-99c0-4d30632a6d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:26.289327 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a02c8d-c054-4ea5-99c0-4d30632a6d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:26.290047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a02c8d-c054-4ea5-99c0-4d30632a6d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:26.291714 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a02c8d-c054-4ea5-99c0-4d30632a6d1a admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:26.302792 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1149/2286] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:26.306894 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42e84a-5643-4040-b737-46c5b48ae736 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:26.317462 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42e84a-5643-4040-b737-46c5b48ae736 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:26.321920 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc172f-d608-4d4b-ac3f-0803b7e3d7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:26.322790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc172f-d608-4d4b-ac3f-0803b7e3d7a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:26.323072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc172f-d608-4d4b-ac3f-0803b7e3d7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:26.323382 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc172f-d608-4d4b-ac3f-0803b7e3d7a0 admin admin] PATH_INFO: `/v3/projects/bc894a668e994d099ee5bfd789ee06fc/users/02429ccb0194421ebceb0edc66d25ff1/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:26.337746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc172f-d608-4d4b-ac3f-0803b7e3d7a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc894a668e994d099ee5bfd789ee06fc, user_id=02429ccb0194421ebceb0edc66d25ff1, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:26.340438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc172f-d608-4d4b-ac3f-0803b7e3d7a0 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:26.353514 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1138/2287] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:26 2022] PUT /identity/v3/projects/bc894a668e994d099ee5bfd789ee06fc/users/02429ccb0194421ebceb0edc66d25ff1/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:26.357790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a02c8d-c054-4ea5-99c0-4d30632a6d1a admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:26.368389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a02c8d-c054-4ea5-99c0-4d30632a6d1a admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:26.423207 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e71fd-7a8e-445a-93ac-f19fd5c53384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:26.423918 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e71fd-7a8e-445a-93ac-f19fd5c53384 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:26.424198 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e71fd-7a8e-445a-93ac-f19fd5c53384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:26.424470 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e71fd-7a8e-445a-93ac-f19fd5c53384 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:26.425176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e71fd-7a8e-445a-93ac-f19fd5c53384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:26.426767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e71fd-7a8e-445a-93ac-f19fd5c53384 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:26.436207 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1150/2288] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:26.440304 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc172f-d608-4d4b-ac3f-0803b7e3d7a0 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:26.450412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc172f-d608-4d4b-ac3f-0803b7e3d7a0 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:26.455539 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e285ad-78c5-40e6-905a-0190ff720667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:26.456406 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e285ad-78c5-40e6-905a-0190ff720667 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:26.456687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e285ad-78c5-40e6-905a-0190ff720667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:26.456962 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e285ad-78c5-40e6-905a-0190ff720667 admin admin] PATH_INFO: `/v3/projects/bc894a668e994d099ee5bfd789ee06fc/users/02429ccb0194421ebceb0edc66d25ff1/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:26.458929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e285ad-78c5-40e6-905a-0190ff720667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc894a668e994d099ee5bfd789ee06fc, user_id=02429ccb0194421ebceb0edc66d25ff1, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:26.461589 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e285ad-78c5-40e6-905a-0190ff720667 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:26.472745 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1139/2289] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:26 2022] PUT /identity/v3/projects/bc894a668e994d099ee5bfd789ee06fc/users/02429ccb0194421ebceb0edc66d25ff1/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:26.483710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd61005-2035-4030-8b7b-3119cd7938ce None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:26.484007 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd61005-2035-4030-8b7b-3119cd7938ce None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:26.484293 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd61005-2035-4030-8b7b-3119cd7938ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:26.509728 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-3bd61005-2035-4030-8b7b-3119cd7938ce None None] MFA Rules not processed for user `02429ccb0194421ebceb0edc66d25ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:26.510930 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-3bd61005-2035-4030-8b7b-3119cd7938ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:26.519889 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:26.580283 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1151/2290] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:26.593556 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e285ad-78c5-40e6-905a-0190ff720667 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:26.596074 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-90e285ad-78c5-40e6-905a-0190ff720667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:26.654761 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e285ad-78c5-40e6-905a-0190ff720667 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:26.658976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b87908-9e45-4fe5-8732-23f23e0a4bc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:26.659644 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b87908-9e45-4fe5-8732-23f23e0a4bc6 service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:26.659931 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b87908-9e45-4fe5-8732-23f23e0a4bc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:26.660208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b87908-9e45-4fe5-8732-23f23e0a4bc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:26.669454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:26.722930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b87908-9e45-4fe5-8732-23f23e0a4bc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:26.724410 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b87908-9e45-4fe5-8732-23f23e0a4bc6 service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:26.733219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1140/2291] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:31.368454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd61005-2035-4030-8b7b-3119cd7938ce None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:31.369834 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-3bd61005-2035-4030-8b7b-3119cd7938ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:31.382179 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd61005-2035-4030-8b7b-3119cd7938ce None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:31.385707 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45698d85-3add-4d95-a22f-a9d751e9ec80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:31.386365 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45698d85-3add-4d95-a22f-a9d751e9ec80 service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:31.386646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45698d85-3add-4d95-a22f-a9d751e9ec80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:31.386921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45698d85-3add-4d95-a22f-a9d751e9ec80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:31.441013 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45698d85-3add-4d95-a22f-a9d751e9ec80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:31.442603 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45698d85-3add-4d95-a22f-a9d751e9ec80 service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:31.451234 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1152/2292] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:32.139107 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b87908-9e45-4fe5-8732-23f23e0a4bc6 service cinder] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:32.148401 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b87908-9e45-4fe5-8732-23f23e0a4bc6 service cinder] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:32.152153 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7a542-f0b6-4ef6-bb30-2258123bb00d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:32.152855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7a542-f0b6-4ef6-bb30-2258123bb00d service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:32.153457 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7a542-f0b6-4ef6-bb30-2258123bb00d service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:32.153828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7a542-f0b6-4ef6-bb30-2258123bb00d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:32.164275 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7a542-f0b6-4ef6-bb30-2258123bb00d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:32.165708 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7a542-f0b6-4ef6-bb30-2258123bb00d service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:32.175680 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1141/2293] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:32.720318 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45698d85-3add-4d95-a22f-a9d751e9ec80 service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:32.721789 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-45698d85-3add-4d95-a22f-a9d751e9ec80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:32.791645 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45698d85-3add-4d95-a22f-a9d751e9ec80 service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:32.796419 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb9492-6276-43d2-bfaf-e7db75471a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:32.797303 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb9492-6276-43d2-bfaf-e7db75471a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:32.797585 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb9492-6276-43d2-bfaf-e7db75471a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:32.797862 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb9492-6276-43d2-bfaf-e7db75471a8b admin admin] PATH_INFO: `/v3/users/2f377fef4f8d48679bc16ca61e45fdc1` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:32.799093 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb9492-6276-43d2-bfaf-e7db75471a8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f377fef4f8d48679bc16ca61e45fdc1)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:32.801132 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb9492-6276-43d2-bfaf-e7db75471a8b admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:32.849857 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:32.851615 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-50fb9492-6276-43d2-bfaf-e7db75471a8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f377fef4f8d48679bc16ca61e45fdc1'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:32.852595 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-50fb9492-6276-43d2-bfaf-e7db75471a8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f377fef4f8d48679bc16ca61e45fdc1'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:32.862181 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-50fb9492-6276-43d2-bfaf-e7db75471a8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f377fef4f8d48679bc16ca61e45fdc1'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:32.862862 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-50fb9492-6276-43d2-bfaf-e7db75471a8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f377fef4f8d48679bc16ca61e45fdc1'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:32.874619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-50fb9492-6276-43d2-bfaf-e7db75471a8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f377fef4f8d48679bc16ca61e45fdc1'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:32.888420 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1153/2294] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:40:32 2022] DELETE /identity/v3/users/2f377fef4f8d48679bc16ca61e45fdc1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:32.895342 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfb552-3960-41e8-af20-b71e1827a422 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:32.895723 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfb552-3960-41e8-af20-b71e1827a422 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:32.896011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfb552-3960-41e8-af20-b71e1827a422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:32.913185 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-bdbfb552-3960-41e8-af20-b71e1827a422 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:32.914424 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-bdbfb552-3960-41e8-af20-b71e1827a422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:32.980493 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1142/2295] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:32.987853 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb9492-6276-43d2-bfaf-e7db75471a8b admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:32.989332 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-50fb9492-6276-43d2-bfaf-e7db75471a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:33.053102 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb9492-6276-43d2-bfaf-e7db75471a8b admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:33.056922 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37271a2-9edb-4102-878b-12719808603d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:33.057582 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37271a2-9edb-4102-878b-12719808603d service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:33.057985 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37271a2-9edb-4102-878b-12719808603d service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:33.058271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37271a2-9edb-4102-878b-12719808603d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:33.070044 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37271a2-9edb-4102-878b-12719808603d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:33.071529 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37271a2-9edb-4102-878b-12719808603d service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:33.082052 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1154/2296] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:33.751936 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfb552-3960-41e8-af20-b71e1827a422 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:33.753905 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-bdbfb552-3960-41e8-af20-b71e1827a422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:33.779478 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfb552-3960-41e8-af20-b71e1827a422 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:33.788071 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdff43-8b15-4bba-9a4d-7356d74ff79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:33.788969 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdff43-8b15-4bba-9a4d-7356d74ff79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:33.789312 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdff43-8b15-4bba-9a4d-7356d74ff79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:33.789523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdff43-8b15-4bba-9a4d-7356d74ff79a admin admin] PATH_INFO: `/v3/projects/6f8cea4b2c364af1abc57e5872f0ef44` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:33.796061 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fdff43-8b15-4bba-9a4d-7356d74ff79a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f8cea4b2c364af1abc57e5872f0ef44)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:33.798666 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fdff43-8b15-4bba-9a4d-7356d74ff79a admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:33.858303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-13fdff43-8b15-4bba-9a4d-7356d74ff79a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f8cea4b2c364af1abc57e5872f0ef44', 'request_id': 'req-13fdff43-8b15-4bba-9a4d-7356d74ff79a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:33.866739 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-13fdff43-8b15-4bba-9a4d-7356d74ff79a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f8cea4b2c364af1abc57e5872f0ef44', 'request_id': 'req-13fdff43-8b15-4bba-9a4d-7356d74ff79a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:33.875609 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-13fdff43-8b15-4bba-9a4d-7356d74ff79a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f8cea4b2c364af1abc57e5872f0ef44', 'request_id': 'req-13fdff43-8b15-4bba-9a4d-7356d74ff79a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:33.885817 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-13fdff43-8b15-4bba-9a4d-7356d74ff79a admin admin] The token cache is being invalidate because project 6f8cea4b2c364af1abc57e5872f0ef44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:33.886105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-13fdff43-8b15-4bba-9a4d-7356d74ff79a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:33.886750 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-13fdff43-8b15-4bba-9a4d-7356d74ff79a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:33.888721 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1143/2297] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:40:33 2022] DELETE /identity/v3/projects/6f8cea4b2c364af1abc57e5872f0ef44 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:33.897772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe8df5-dac0-435a-a958-031e9de21204 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:33.897772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe8df5-dac0-435a-a958-031e9de21204 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:33.897772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe8df5-dac0-435a-a958-031e9de21204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:33.914480 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-f7fe8df5-dac0-435a-a958-031e9de21204 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:33.915836 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f7fe8df5-dac0-435a-a958-031e9de21204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:33.977550 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1155/2298] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:33.985629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c981577-f935-4b51-8b69-a074e05e9a5a None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:33.985995 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c981577-f935-4b51-8b69-a074e05e9a5a None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:33.986407 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c981577-f935-4b51-8b69-a074e05e9a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:34.006109 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-0c981577-f935-4b51-8b69-a074e05e9a5a None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:34.008559 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-0c981577-f935-4b51-8b69-a074e05e9a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:34.016844 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1144/2299] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:40:34.021161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe8df5-dac0-435a-a958-031e9de21204 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:34.031434 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe8df5-dac0-435a-a958-031e9de21204 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:34.043133 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d666824-ea35-4be9-ab3e-c923e360f8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:34.043852 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d666824-ea35-4be9-ab3e-c923e360f8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:34.044142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d666824-ea35-4be9-ab3e-c923e360f8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:34.044455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d666824-ea35-4be9-ab3e-c923e360f8a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:34.045193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d666824-ea35-4be9-ab3e-c923e360f8a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:40:34.045510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d666824-ea35-4be9-ab3e-c923e360f8a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:34.047673 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d666824-ea35-4be9-ab3e-c923e360f8a3 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:34.063881 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1156/2300] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:40:34.064995 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c981577-f935-4b51-8b69-a074e05e9a5a None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:34.074443 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c981577-f935-4b51-8b69-a074e05e9a5a None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:34.079382 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11613df-475c-46af-a600-2af1c62436bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:34.080233 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11613df-475c-46af-a600-2af1c62436bf admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:34.080520 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11613df-475c-46af-a600-2af1c62436bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:34.080799 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11613df-475c-46af-a600-2af1c62436bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:34.081487 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11613df-475c-46af-a600-2af1c62436bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:34.083587 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11613df-475c-46af-a600-2af1c62436bf admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:34.097268 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:34.114662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1145/2301] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:40:34 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:34.115819 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d666824-ea35-4be9-ab3e-c923e360f8a3 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:34.126667 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d666824-ea35-4be9-ab3e-c923e360f8a3 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:34.176276 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:34.186462 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4798ed-4071-444f-bbf6-4201e99dd114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:34.187210 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4798ed-4071-444f-bbf6-4201e99dd114 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:34.187760 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4798ed-4071-444f-bbf6-4201e99dd114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:34.188044 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4798ed-4071-444f-bbf6-4201e99dd114 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:34.188744 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4798ed-4071-444f-bbf6-4201e99dd114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:34.190681 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4798ed-4071-444f-bbf6-4201e99dd114 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:34.211320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1157/2302] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:40:34 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:34.214348 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11613df-475c-46af-a600-2af1c62436bf admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:34.225535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11613df-475c-46af-a600-2af1c62436bf admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:34.230201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ed737-1c73-4646-af33-d3918601d485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:34.230868 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ed737-1c73-4646-af33-d3918601d485 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:34.231155 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ed737-1c73-4646-af33-d3918601d485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:34.231463 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ed737-1c73-4646-af33-d3918601d485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:34.232187 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ed737-1c73-4646-af33-d3918601d485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:34.233797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ed737-1c73-4646-af33-d3918601d485 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:34.245029 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1146/2303] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:34.249314 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4798ed-4071-444f-bbf6-4201e99dd114 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:34.259175 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4798ed-4071-444f-bbf6-4201e99dd114 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:34.263803 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167a66d-a101-4b41-905e-e66935ab6c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:34.264462 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167a66d-a101-4b41-905e-e66935ab6c03 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:34.264746 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167a66d-a101-4b41-905e-e66935ab6c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:34.265024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167a66d-a101-4b41-905e-e66935ab6c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:34.265779 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167a66d-a101-4b41-905e-e66935ab6c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:34.267408 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167a66d-a101-4b41-905e-e66935ab6c03 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:34.282933 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1158/2304] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:34.284096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ed737-1c73-4646-af33-d3918601d485 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:34.294463 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ed737-1c73-4646-af33-d3918601d485 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:34.300127 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1ee0c-9877-4b1d-a496-265a422f6b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:34.301009 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1ee0c-9877-4b1d-a496-265a422f6b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:34.301289 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1ee0c-9877-4b1d-a496-265a422f6b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:34.301561 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1ee0c-9877-4b1d-a496-265a422f6b64 admin admin] PATH_INFO: `/v3/projects/eee129f5d82e42688c3f05621e9ef165/users/e31ae891fbd344918d4338a4430e60af/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:34.316408 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1ee0c-9877-4b1d-a496-265a422f6b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee129f5d82e42688c3f05621e9ef165, user_id=e31ae891fbd344918d4338a4430e60af, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:34.319832 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1ee0c-9877-4b1d-a496-265a422f6b64 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:34.333246 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1147/2305] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:34 2022] PUT /identity/v3/projects/eee129f5d82e42688c3f05621e9ef165/users/e31ae891fbd344918d4338a4430e60af/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:34.347789 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50baf26c-d9b6-471e-8ee9-3178b80c9e65 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:34.348085 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50baf26c-d9b6-471e-8ee9-3178b80c9e65 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:34.348364 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50baf26c-d9b6-471e-8ee9-3178b80c9e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:34.376690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-50baf26c-d9b6-471e-8ee9-3178b80c9e65 None None] MFA Rules not processed for user `e31ae891fbd344918d4338a4430e60af`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:34.377899 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-50baf26c-d9b6-471e-8ee9-3178b80c9e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:34.443350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1159/2306] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:34.457701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1ee0c-9877-4b1d-a496-265a422f6b64 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:34.459460 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-1ea1ee0c-9877-4b1d-a496-265a422f6b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:34.516726 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1ee0c-9877-4b1d-a496-265a422f6b64 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:34.520460 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8595a-eed0-4bf5-8be1-0c17071ea5ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e04575437341df8127860a5e5abc50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:34.521103 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8595a-eed0-4bf5-8be1-0c17071ea5ee service glance] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:34.521387 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8595a-eed0-4bf5-8be1-0c17071ea5ee service glance] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:34.521671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8595a-eed0-4bf5-8be1-0c17071ea5ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:34.529891 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8595a-eed0-4bf5-8be1-0c17071ea5ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:34.531975 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8595a-eed0-4bf5-8be1-0c17071ea5ee service glance] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:34.540853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1148/2307] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:34 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:36.281765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50baf26c-d9b6-471e-8ee9-3178b80c9e65 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:36.283490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-50baf26c-d9b6-471e-8ee9-3178b80c9e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:36.394973 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50baf26c-d9b6-471e-8ee9-3178b80c9e65 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:36.400868 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373b3d0-f630-42e2-8475-2529cf675e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:36.401764 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373b3d0-f630-42e2-8475-2529cf675e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:36.402051 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373b3d0-f630-42e2-8475-2529cf675e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:36.402328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373b3d0-f630-42e2-8475-2529cf675e8c admin admin] PATH_INFO: `/v3/users/73cce4bc138849a68e9fc403756425ba` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:36.403564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373b3d0-f630-42e2-8475-2529cf675e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=73cce4bc138849a68e9fc403756425ba)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:36.405509 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373b3d0-f630-42e2-8475-2529cf675e8c admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:36.456536 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4373b3d0-f630-42e2-8475-2529cf675e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73cce4bc138849a68e9fc403756425ba'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:36.457255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4373b3d0-f630-42e2-8475-2529cf675e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73cce4bc138849a68e9fc403756425ba'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:36.464420 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4373b3d0-f630-42e2-8475-2529cf675e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73cce4bc138849a68e9fc403756425ba'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:36.465045 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4373b3d0-f630-42e2-8475-2529cf675e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73cce4bc138849a68e9fc403756425ba'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:36.471196 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:36.481959 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4373b3d0-f630-42e2-8475-2529cf675e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73cce4bc138849a68e9fc403756425ba'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:36.495723 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1160/2308] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:40:36 2022] DELETE /identity/v3/users/73cce4bc138849a68e9fc403756425ba => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:36.500498 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e870905-e387-48b6-b9af-cd14a75c5d08 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:36.500939 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e870905-e387-48b6-b9af-cd14a75c5d08 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:36.501118 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e870905-e387-48b6-b9af-cd14a75c5d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:36.523946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-9e870905-e387-48b6-b9af-cd14a75c5d08 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:36.525427 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-9e870905-e387-48b6-b9af-cd14a75c5d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:36.594274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1149/2309] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:36.605253 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373b3d0-f630-42e2-8475-2529cf675e8c admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:36.607593 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-4373b3d0-f630-42e2-8475-2529cf675e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:36.692673 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373b3d0-f630-42e2-8475-2529cf675e8c admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:36.696454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df2057-452f-41f5-9d7b-9e7dcdb646c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:36.697106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df2057-452f-41f5-9d7b-9e7dcdb646c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:36.697392 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df2057-452f-41f5-9d7b-9e7dcdb646c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:36.697698 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df2057-452f-41f5-9d7b-9e7dcdb646c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:36.708385 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df2057-452f-41f5-9d7b-9e7dcdb646c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:36.709998 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df2057-452f-41f5-9d7b-9e7dcdb646c7 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:36.720390 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1161/2310] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:40:37.016394 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e870905-e387-48b6-b9af-cd14a75c5d08 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:37.018007 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-9e870905-e387-48b6-b9af-cd14a75c5d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:37.051579 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e870905-e387-48b6-b9af-cd14a75c5d08 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:37.057459 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62348431-0a61-4542-8cc9-893ce183dc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:37.058591 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62348431-0a61-4542-8cc9-893ce183dc93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:37.059178 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62348431-0a61-4542-8cc9-893ce183dc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:37.059594 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62348431-0a61-4542-8cc9-893ce183dc93 admin admin] PATH_INFO: `/v3/projects/ec7c77a6b40342498c9568b43986716c` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:37.067242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62348431-0a61-4542-8cc9-893ce183dc93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec7c77a6b40342498c9568b43986716c)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:37.069773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62348431-0a61-4542-8cc9-893ce183dc93 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:37.132121 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-62348431-0a61-4542-8cc9-893ce183dc93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec7c77a6b40342498c9568b43986716c', 'request_id': 'req-62348431-0a61-4542-8cc9-893ce183dc93'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.141870 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-62348431-0a61-4542-8cc9-893ce183dc93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec7c77a6b40342498c9568b43986716c', 'request_id': 'req-62348431-0a61-4542-8cc9-893ce183dc93'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.143434 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:37.159864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-62348431-0a61-4542-8cc9-893ce183dc93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec7c77a6b40342498c9568b43986716c', 'request_id': 'req-62348431-0a61-4542-8cc9-893ce183dc93'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.193911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-62348431-0a61-4542-8cc9-893ce183dc93 admin admin] The token cache is being invalidate because project ec7c77a6b40342498c9568b43986716c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:37.194232 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-62348431-0a61-4542-8cc9-893ce183dc93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.195170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-62348431-0a61-4542-8cc9-893ce183dc93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.196795 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1150/2311] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:40:37 2022] DELETE /identity/v3/projects/ec7c77a6b40342498c9568b43986716c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:37.200711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df2057-452f-41f5-9d7b-9e7dcdb646c7 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:37.211990 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df2057-452f-41f5-9d7b-9e7dcdb646c7 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:37.275006 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2e7e8-d6b9-4b3e-b564-a054933101b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:37.275940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2e7e8-d6b9-4b3e-b564-a054933101b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:37.276214 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2e7e8-d6b9-4b3e-b564-a054933101b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:37.276565 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2e7e8-d6b9-4b3e-b564-a054933101b7 admin admin] PATH_INFO: `/v3/users/bf2097572ee74ddaa7a96ae606c13ad1` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:37.277687 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2e7e8-d6b9-4b3e-b564-a054933101b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf2097572ee74ddaa7a96ae606c13ad1)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:37.279664 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2e7e8-d6b9-4b3e-b564-a054933101b7 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:37.332642 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-62b2e7e8-d6b9-4b3e-b564-a054933101b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf2097572ee74ddaa7a96ae606c13ad1'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.333608 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-62b2e7e8-d6b9-4b3e-b564-a054933101b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf2097572ee74ddaa7a96ae606c13ad1'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.342779 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-62b2e7e8-d6b9-4b3e-b564-a054933101b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf2097572ee74ddaa7a96ae606c13ad1'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.343591 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-62b2e7e8-d6b9-4b3e-b564-a054933101b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf2097572ee74ddaa7a96ae606c13ad1'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.357215 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-62b2e7e8-d6b9-4b3e-b564-a054933101b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf2097572ee74ddaa7a96ae606c13ad1'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.378375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1162/2312] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:40:37 2022] DELETE /identity/v3/users/bf2097572ee74ddaa7a96ae606c13ad1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:37.675021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62348431-0a61-4542-8cc9-893ce183dc93 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:37.679895 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-62348431-0a61-4542-8cc9-893ce183dc93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:37.700670 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2e7e8-d6b9-4b3e-b564-a054933101b7 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:37.702789 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-62b2e7e8-d6b9-4b3e-b564-a054933101b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:37.707510 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62348431-0a61-4542-8cc9-893ce183dc93 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:37.710244 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:37.784714 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13fd61-7de8-4675-b4d6-9810de530247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:37.785109 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13fd61-7de8-4675-b4d6-9810de530247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:37.785453 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13fd61-7de8-4675-b4d6-9810de530247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:37.785793 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13fd61-7de8-4675-b4d6-9810de530247 admin admin] PATH_INFO: `/v3/projects/badbaa11d0354ea1ae0ef88272ebc0a6` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:37.787042 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13fd61-7de8-4675-b4d6-9810de530247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=badbaa11d0354ea1ae0ef88272ebc0a6)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:37.788048 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2e7e8-d6b9-4b3e-b564-a054933101b7 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:37.789123 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13fd61-7de8-4675-b4d6-9810de530247 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:37.792731 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df316a-c574-4eb1-b4e6-ec12f670cf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:37.793605 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df316a-c574-4eb1-b4e6-ec12f670cf37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:37.793893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df316a-c574-4eb1-b4e6-ec12f670cf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:37.794173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df316a-c574-4eb1-b4e6-ec12f670cf37 admin admin] PATH_INFO: `/v3/users/f11db409960b47bab310605d0bfcc34d` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:37.795391 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df316a-c574-4eb1-b4e6-ec12f670cf37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f11db409960b47bab310605d0bfcc34d)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:37.798048 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df316a-c574-4eb1-b4e6-ec12f670cf37 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:37.852082 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-0d13fd61-7de8-4675-b4d6-9810de530247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'badbaa11d0354ea1ae0ef88272ebc0a6', 'request_id': 'req-0d13fd61-7de8-4675-b4d6-9810de530247'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.855367 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-21df316a-c574-4eb1-b4e6-ec12f670cf37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f11db409960b47bab310605d0bfcc34d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.856187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-21df316a-c574-4eb1-b4e6-ec12f670cf37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f11db409960b47bab310605d0bfcc34d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.861342 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-0d13fd61-7de8-4675-b4d6-9810de530247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'badbaa11d0354ea1ae0ef88272ebc0a6', 'request_id': 'req-0d13fd61-7de8-4675-b4d6-9810de530247'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.864303 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-21df316a-c574-4eb1-b4e6-ec12f670cf37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f11db409960b47bab310605d0bfcc34d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.864948 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-21df316a-c574-4eb1-b4e6-ec12f670cf37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f11db409960b47bab310605d0bfcc34d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.869280 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-0d13fd61-7de8-4675-b4d6-9810de530247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'badbaa11d0354ea1ae0ef88272ebc0a6', 'request_id': 'req-0d13fd61-7de8-4675-b4d6-9810de530247'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.880892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-0d13fd61-7de8-4675-b4d6-9810de530247 admin admin] The token cache is being invalidate because project badbaa11d0354ea1ae0ef88272ebc0a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:37.881265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-0d13fd61-7de8-4675-b4d6-9810de530247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.881374 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-21df316a-c574-4eb1-b4e6-ec12f670cf37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f11db409960b47bab310605d0bfcc34d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.882034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-0d13fd61-7de8-4675-b4d6-9810de530247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:37.883604 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1151/2313] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:40:37 2022] DELETE /identity/v3/projects/badbaa11d0354ea1ae0ef88272ebc0a6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:37.887707 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13fd61-7de8-4675-b4d6-9810de530247 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:37.889164 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-0d13fd61-7de8-4675-b4d6-9810de530247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:37.895006 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1163/2314] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:40:37 2022] DELETE /identity/v3/users/f11db409960b47bab310605d0bfcc34d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:40:37.899204 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c06e0-559a-4e7b-b473-a43aea89906d None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:37.899540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c06e0-559a-4e7b-b473-a43aea89906d None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:37.899827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c06e0-559a-4e7b-b473-a43aea89906d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:37.917430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-358c06e0-559a-4e7b-b473-a43aea89906d None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:37.918634 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-358c06e0-559a-4e7b-b473-a43aea89906d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:37.955755 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13fd61-7de8-4675-b4d6-9810de530247 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:37.975794 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:37.982608 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1164/2315] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:40:37.993812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c06e0-559a-4e7b-b473-a43aea89906d None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:37.995159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-358c06e0-559a-4e7b-b473-a43aea89906d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:38.020933 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5d529-0de3-44cf-b5d9-156f88de3c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:38.021937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5d529-0de3-44cf-b5d9-156f88de3c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:38.022225 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5d529-0de3-44cf-b5d9-156f88de3c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:38.022502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5d529-0de3-44cf-b5d9-156f88de3c7e admin admin] PATH_INFO: `/v3/users/02429ccb0194421ebceb0edc66d25ff1` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:38.023729 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5d529-0de3-44cf-b5d9-156f88de3c7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=02429ccb0194421ebceb0edc66d25ff1)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:38.025645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5d529-0de3-44cf-b5d9-156f88de3c7e admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:38.026212 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:38.072342 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c06e0-559a-4e7b-b473-a43aea89906d None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:38.076728 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc08346-6ac6-4eec-9eee-2a51688ad7ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:38.077394 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc08346-6ac6-4eec-9eee-2a51688ad7ab service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:38.077702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc08346-6ac6-4eec-9eee-2a51688ad7ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:38.077993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc08346-6ac6-4eec-9eee-2a51688ad7ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:38.089637 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc08346-6ac6-4eec-9eee-2a51688ad7ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:38.091089 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a7f5d529-0de3-44cf-b5d9-156f88de3c7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02429ccb0194421ebceb0edc66d25ff1'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:38.091208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc08346-6ac6-4eec-9eee-2a51688ad7ab service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:38.103198 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1165/2316] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:40:38.104021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a7f5d529-0de3-44cf-b5d9-156f88de3c7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02429ccb0194421ebceb0edc66d25ff1'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:38.105144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a7f5d529-0de3-44cf-b5d9-156f88de3c7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02429ccb0194421ebceb0edc66d25ff1'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:38.121525 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a7f5d529-0de3-44cf-b5d9-156f88de3c7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02429ccb0194421ebceb0edc66d25ff1'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:38.130528 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a7f5d529-0de3-44cf-b5d9-156f88de3c7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02429ccb0194421ebceb0edc66d25ff1'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:38.139718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1152/2317] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:40:37 2022] DELETE /identity/v3/users/02429ccb0194421ebceb0edc66d25ff1 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:40:38.251444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4011f-079f-4bf0-a9fb-fd83c8161a8c None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:38.251811 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4011f-079f-4bf0-a9fb-fd83c8161a8c None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:38.253930 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4011f-079f-4bf0-a9fb-fd83c8161a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:38.298954 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-c2b4011f-079f-4bf0-a9fb-fd83c8161a8c None None] MFA Rules not processed for user `b35535c6b1c74a0baf58c8ccdbf30772`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:38.300370 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-c2b4011f-079f-4bf0-a9fb-fd83c8161a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:38.399553 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1166/2318] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:38.484047 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5d529-0de3-44cf-b5d9-156f88de3c7e admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:38.491425 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-a7f5d529-0de3-44cf-b5d9-156f88de3c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:38.523939 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4011f-079f-4bf0-a9fb-fd83c8161a8c None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:38.525652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-c2b4011f-079f-4bf0-a9fb-fd83c8161a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:38.601695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5d529-0de3-44cf-b5d9-156f88de3c7e admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:38.608325 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d66f58-d401-405f-bdaa-b484b414837b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:38.608325 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d66f58-d401-405f-bdaa-b484b414837b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:38.608325 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d66f58-d401-405f-bdaa-b484b414837b admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:38.608325 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d66f58-d401-405f-bdaa-b484b414837b admin admin] PATH_INFO: `/v3/projects/bc894a668e994d099ee5bfd789ee06fc` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:38.609665 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d66f58-d401-405f-bdaa-b484b414837b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc894a668e994d099ee5bfd789ee06fc)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:38.611622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d66f58-d401-405f-bdaa-b484b414837b admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:38.627804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4011f-079f-4bf0-a9fb-fd83c8161a8c None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:38.634517 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484fa53-a969-4159-b2a4-9ed4c8c0393d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:38.636188 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484fa53-a969-4159-b2a4-9ed4c8c0393d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:38.636779 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484fa53-a969-4159-b2a4-9ed4c8c0393d admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:38.637513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484fa53-a969-4159-b2a4-9ed4c8c0393d admin admin] PATH_INFO: `/v3/projects/1e1a71d909a04cf2834df4dc1837e69d` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:38.639387 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484fa53-a969-4159-b2a4-9ed4c8c0393d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e1a71d909a04cf2834df4dc1837e69d)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:38.642029 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484fa53-a969-4159-b2a4-9ed4c8c0393d admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:38.662236 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:38.667092 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e2d66f58-d401-405f-bdaa-b484b414837b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc894a668e994d099ee5bfd789ee06fc', 'request_id': 'req-e2d66f58-d401-405f-bdaa-b484b414837b'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:38.677668 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e2d66f58-d401-405f-bdaa-b484b414837b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc894a668e994d099ee5bfd789ee06fc', 'request_id': 'req-e2d66f58-d401-405f-bdaa-b484b414837b'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:38.685997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e2d66f58-d401-405f-bdaa-b484b414837b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc894a668e994d099ee5bfd789ee06fc', 'request_id': 'req-e2d66f58-d401-405f-bdaa-b484b414837b'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:38.700365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e2d66f58-d401-405f-bdaa-b484b414837b admin admin] The token cache is being invalidate because project bc894a668e994d099ee5bfd789ee06fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:38.700680 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e2d66f58-d401-405f-bdaa-b484b414837b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:38.702039 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e2d66f58-d401-405f-bdaa-b484b414837b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:38.704160 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1153/2319] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:40:38 2022] DELETE /identity/v3/projects/bc894a668e994d099ee5bfd789ee06fc => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:38.708474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864bef2-7d70-4824-972b-44cd61489e12 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:38.708642 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3484fa53-a969-4159-b2a4-9ed4c8c0393d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e1a71d909a04cf2834df4dc1837e69d', 'request_id': 'req-3484fa53-a969-4159-b2a4-9ed4c8c0393d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:38.708949 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864bef2-7d70-4824-972b-44cd61489e12 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:38.709325 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864bef2-7d70-4824-972b-44cd61489e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:38.720454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3484fa53-a969-4159-b2a4-9ed4c8c0393d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e1a71d909a04cf2834df4dc1837e69d', 'request_id': 'req-3484fa53-a969-4159-b2a4-9ed4c8c0393d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:38.727984 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3484fa53-a969-4159-b2a4-9ed4c8c0393d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e1a71d909a04cf2834df4dc1837e69d', 'request_id': 'req-3484fa53-a969-4159-b2a4-9ed4c8c0393d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:38.736382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:38.737587 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-8864bef2-7d70-4824-972b-44cd61489e12 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:38.739470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-8864bef2-7d70-4824-972b-44cd61489e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:38.740519 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3484fa53-a969-4159-b2a4-9ed4c8c0393d admin admin] The token cache is being invalidate because project 1e1a71d909a04cf2834df4dc1837e69d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:38.740805 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3484fa53-a969-4159-b2a4-9ed4c8c0393d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:38.741969 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3484fa53-a969-4159-b2a4-9ed4c8c0393d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:38.744524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1167/2320] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:40:38 2022] DELETE /identity/v3/projects/1e1a71d909a04cf2834df4dc1837e69d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:38.750096 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc0683-873a-42dc-ba22-bdfc5fe83ebc None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:38.753120 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc0683-873a-42dc-ba22-bdfc5fe83ebc None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:38.753441 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc0683-873a-42dc-ba22-bdfc5fe83ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:38.780719 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-f4fc0683-873a-42dc-ba22-bdfc5fe83ebc None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:38.782352 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f4fc0683-873a-42dc-ba22-bdfc5fe83ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:38.818568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1154/2321] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:40:38.826389 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074111a-8427-4186-87cf-10ef23b842e9 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:38.826684 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074111a-8427-4186-87cf-10ef23b842e9 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:38.826964 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074111a-8427-4186-87cf-10ef23b842e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:38.849271 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-b074111a-8427-4186-87cf-10ef23b842e9 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:38.850491 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-b074111a-8427-4186-87cf-10ef23b842e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:38.859988 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1168/2322] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:38.860721 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1155/2323] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:38.868122 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240b2a3-f502-48b8-b124-fc446baa6cbd None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:38.868122 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240b2a3-f502-48b8-b124-fc446baa6cbd None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:38.868368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240b2a3-f502-48b8-b124-fc446baa6cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:38.869484 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074111a-8427-4186-87cf-10ef23b842e9 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:38.881406 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074111a-8427-4186-87cf-10ef23b842e9 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:38.887165 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe8ea6-4796-43f3-a18b-1fbd6b8446fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:38.887960 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe8ea6-4796-43f3-a18b-1fbd6b8446fe admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:38.888308 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe8ea6-4796-43f3-a18b-1fbd6b8446fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:38.888665 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe8ea6-4796-43f3-a18b-1fbd6b8446fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:38.889489 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe8ea6-4796-43f3-a18b-1fbd6b8446fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:40:38.889862 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe8ea6-4796-43f3-a18b-1fbd6b8446fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:38.892486 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-0240b2a3-f502-48b8-b124-fc446baa6cbd None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:38.892780 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe8ea6-4796-43f3-a18b-1fbd6b8446fe admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:38.894112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-0240b2a3-f502-48b8-b124-fc446baa6cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:38.908464 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1169/2324] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:38.914596 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1156/2325] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:40:38.915235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240b2a3-f502-48b8-b124-fc446baa6cbd None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:38.915648 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe8ea6-4796-43f3-a18b-1fbd6b8446fe admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:38.925234 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240b2a3-f502-48b8-b124-fc446baa6cbd None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:38.931360 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe8ea6-4796-43f3-a18b-1fbd6b8446fe admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:38.932087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb90b28-7567-48b2-99d5-c572704ca81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:38.933105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb90b28-7567-48b2-99d5-c572704ca81e admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:38.933483 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb90b28-7567-48b2-99d5-c572704ca81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:38.933767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb90b28-7567-48b2-99d5-c572704ca81e admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:38.934607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb90b28-7567-48b2-99d5-c572704ca81e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:40:38.934921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb90b28-7567-48b2-99d5-c572704ca81e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:38.936885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb90b28-7567-48b2-99d5-c572704ca81e admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:38.938809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4410490-0dcf-4c29-8e45-52a23dac5b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:38.939746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4410490-0dcf-4c29-8e45-52a23dac5b94 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:38.940275 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4410490-0dcf-4c29-8e45-52a23dac5b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:38.940628 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4410490-0dcf-4c29-8e45-52a23dac5b94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:38.941655 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4410490-0dcf-4c29-8e45-52a23dac5b94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:38.943729 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4410490-0dcf-4c29-8e45-52a23dac5b94 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:38.959493 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1170/2326] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:40:38.964533 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb90b28-7567-48b2-99d5-c572704ca81e admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:38.986023 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb90b28-7567-48b2-99d5-c572704ca81e admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:38.991325 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1157/2327] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:40:38 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:38.991464 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070cf91-3ed4-40db-baa8-bfd50457d313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:38.991464 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070cf91-3ed4-40db-baa8-bfd50457d313 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:38.992360 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070cf91-3ed4-40db-baa8-bfd50457d313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:38.992643 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070cf91-3ed4-40db-baa8-bfd50457d313 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:38.992756 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4410490-0dcf-4c29-8e45-52a23dac5b94 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:38.993339 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070cf91-3ed4-40db-baa8-bfd50457d313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:38.995410 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070cf91-3ed4-40db-baa8-bfd50457d313 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:39.031462 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1171/2328] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:40:38 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:39.033230 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070cf91-3ed4-40db-baa8-bfd50457d313 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:39.082560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4410490-0dcf-4c29-8e45-52a23dac5b94 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:39.117589 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070cf91-3ed4-40db-baa8-bfd50457d313 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:39.122571 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d06eb6-213c-4485-ae26-3bcaad35bf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:39.123182 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d06eb6-213c-4485-ae26-3bcaad35bf91 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:39.123503 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d06eb6-213c-4485-ae26-3bcaad35bf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:39.123841 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d06eb6-213c-4485-ae26-3bcaad35bf91 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:39.125185 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d06eb6-213c-4485-ae26-3bcaad35bf91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:39.126588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:39.127136 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d06eb6-213c-4485-ae26-3bcaad35bf91 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:39.173384 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1172/2329] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:40:39 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:39.173517 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca45e26-f791-4030-aa37-6cff1e11fd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:39.174114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca45e26-f791-4030-aa37-6cff1e11fd57 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:39.174302 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d06eb6-213c-4485-ae26-3bcaad35bf91 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:39.174619 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca45e26-f791-4030-aa37-6cff1e11fd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:39.174899 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca45e26-f791-4030-aa37-6cff1e11fd57 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:39.175926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca45e26-f791-4030-aa37-6cff1e11fd57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:39.178502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca45e26-f791-4030-aa37-6cff1e11fd57 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:39.187873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d06eb6-213c-4485-ae26-3bcaad35bf91 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:39.194208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c57b11-8a29-4263-8d1c-288e69e34e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:39.195045 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c57b11-8a29-4263-8d1c-288e69e34e7e admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:39.195453 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c57b11-8a29-4263-8d1c-288e69e34e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:39.195804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c57b11-8a29-4263-8d1c-288e69e34e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:39.197009 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c57b11-8a29-4263-8d1c-288e69e34e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:39.198975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c57b11-8a29-4263-8d1c-288e69e34e7e admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:39.211003 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1158/2330] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:40:38 2022] POST /identity/v3/users => generated 292 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:40:39.212733 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1173/2331] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:39.215768 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca45e26-f791-4030-aa37-6cff1e11fd57 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:39.216864 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c57b11-8a29-4263-8d1c-288e69e34e7e admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:39.230735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca45e26-f791-4030-aa37-6cff1e11fd57 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:39.235744 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c57b11-8a29-4263-8d1c-288e69e34e7e admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:39.236698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a347b-67ba-4a77-bd07-7104684be785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:39.237385 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a347b-67ba-4a77-bd07-7104684be785 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:39.237669 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a347b-67ba-4a77-bd07-7104684be785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:39.237943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a347b-67ba-4a77-bd07-7104684be785 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:39.238664 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a347b-67ba-4a77-bd07-7104684be785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:39.240283 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a347b-67ba-4a77-bd07-7104684be785 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:39.241657 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8a916-8a19-43db-9d44-0569c49e5aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:39.242904 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8a916-8a19-43db-9d44-0569c49e5aee admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:39.243224 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8a916-8a19-43db-9d44-0569c49e5aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:39.243542 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8a916-8a19-43db-9d44-0569c49e5aee admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:39.244525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8a916-8a19-43db-9d44-0569c49e5aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:39.247100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8a916-8a19-43db-9d44-0569c49e5aee admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:39.254584 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1159/2332] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:39.256607 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a347b-67ba-4a77-bd07-7104684be785 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:39.263193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1174/2333] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:40:39.268017 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8a916-8a19-43db-9d44-0569c49e5aee admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:39.271162 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a347b-67ba-4a77-bd07-7104684be785 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:39.276392 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079ad80-c7eb-4407-bcc1-c621e55276e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:39.277065 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079ad80-c7eb-4407-bcc1-c621e55276e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:39.277351 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079ad80-c7eb-4407-bcc1-c621e55276e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:39.277692 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079ad80-c7eb-4407-bcc1-c621e55276e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:39.278325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8a916-8a19-43db-9d44-0569c49e5aee admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:39.278432 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079ad80-c7eb-4407-bcc1-c621e55276e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:39.280096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079ad80-c7eb-4407-bcc1-c621e55276e4 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:39.283237 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907f99b-42b5-4c47-b66a-16980a9a6477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:39.284146 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907f99b-42b5-4c47-b66a-16980a9a6477 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:39.284435 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907f99b-42b5-4c47-b66a-16980a9a6477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:39.284710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907f99b-42b5-4c47-b66a-16980a9a6477 admin admin] PATH_INFO: `/v3/projects/050fc8655bd34646b1b3f211b6fd912a/users/68b32d9217954d72a2b7aa3ba893f942/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:39.294902 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1160/2334] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:40:39.296240 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079ad80-c7eb-4407-bcc1-c621e55276e4 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:39.301383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907f99b-42b5-4c47-b66a-16980a9a6477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=050fc8655bd34646b1b3f211b6fd912a, user_id=68b32d9217954d72a2b7aa3ba893f942, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:39.304206 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907f99b-42b5-4c47-b66a-16980a9a6477 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:39.307300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079ad80-c7eb-4407-bcc1-c621e55276e4 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:39.313350 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d98ab-1ce4-4b03-89db-b713155e2ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:39.314232 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d98ab-1ce4-4b03-89db-b713155e2ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:39.314514 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d98ab-1ce4-4b03-89db-b713155e2ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:39.314787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d98ab-1ce4-4b03-89db-b713155e2ae7 admin admin] PATH_INFO: `/v3/projects/096873e060324e8fb065a488b65a5461/users/d56bc81dc1c84f10bb2d5d11a6eac8b7/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:39.318470 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1175/2335] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:39 2022] PUT /identity/v3/projects/050fc8655bd34646b1b3f211b6fd912a/users/68b32d9217954d72a2b7aa3ba893f942/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:40:39.323430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a7235-4ca8-4b9e-8130-f143994dfafe None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:39.323727 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a7235-4ca8-4b9e-8130-f143994dfafe None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:39.324005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a7235-4ca8-4b9e-8130-f143994dfafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:39.329822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:39.331079 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d98ab-1ce4-4b03-89db-b713155e2ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=096873e060324e8fb065a488b65a5461, user_id=d56bc81dc1c84f10bb2d5d11a6eac8b7, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:39.334002 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d98ab-1ce4-4b03-89db-b713155e2ae7 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:39.343953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-930a7235-4ca8-4b9e-8130-f143994dfafe None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:39.345288 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-930a7235-4ca8-4b9e-8130-f143994dfafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:39.347867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1161/2336] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:39 2022] PUT /identity/v3/projects/096873e060324e8fb065a488b65a5461/users/d56bc81dc1c84f10bb2d5d11a6eac8b7/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:40:39.358302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f66885-1555-41ca-a086-f8974ba4755e None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:39.358593 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f66885-1555-41ca-a086-f8974ba4755e None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:39.359529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f66885-1555-41ca-a086-f8974ba4755e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:39.385904 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-f1f66885-1555-41ca-a086-f8974ba4755e None None] MFA Rules not processed for user `d56bc81dc1c84f10bb2d5d11a6eac8b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:39.387194 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f1f66885-1555-41ca-a086-f8974ba4755e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:39.415107 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1176/2337] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:40:39.425272 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a7235-4ca8-4b9e-8130-f143994dfafe None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:39.426729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-930a7235-4ca8-4b9e-8130-f143994dfafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:39.471911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1162/2338] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:39.485509 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f66885-1555-41ca-a086-f8974ba4755e None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:39.486945 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f1f66885-1555-41ca-a086-f8974ba4755e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:39.492652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a7235-4ca8-4b9e-8130-f143994dfafe None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:39.496671 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ef050-56fc-4f2c-8ab9-62e68ff35764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:39.497395 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ef050-56fc-4f2c-8ab9-62e68ff35764 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:39.497748 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ef050-56fc-4f2c-8ab9-62e68ff35764 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:39.498093 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ef050-56fc-4f2c-8ab9-62e68ff35764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:39.507624 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ef050-56fc-4f2c-8ab9-62e68ff35764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:39.509762 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ef050-56fc-4f2c-8ab9-62e68ff35764 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:39.522670 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1177/2339] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:40:39.551133 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f66885-1555-41ca-a086-f8974ba4755e None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:39.555639 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c931a0-0604-41f2-8008-20dc164cbcb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:39.556399 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c931a0-0604-41f2-8008-20dc164cbcb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:39.556682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c931a0-0604-41f2-8008-20dc164cbcb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:39.556956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c931a0-0604-41f2-8008-20dc164cbcb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:39.566905 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c931a0-0604-41f2-8008-20dc164cbcb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:39.568548 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c931a0-0604-41f2-8008-20dc164cbcb9 service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:39.579045 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1163/2340] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:40:43.319321 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ef050-56fc-4f2c-8ab9-62e68ff35764 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:43.331685 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ef050-56fc-4f2c-8ab9-62e68ff35764 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:43.339541 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a3493-f200-4e34-aebb-ed221b0f5976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:43.341359 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a3493-f200-4e34-aebb-ed221b0f5976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:43.341754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a3493-f200-4e34-aebb-ed221b0f5976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:43.342134 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a3493-f200-4e34-aebb-ed221b0f5976 admin admin] PATH_INFO: `/v3/users/d56bc81dc1c84f10bb2d5d11a6eac8b7` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:43.343698 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a3493-f200-4e34-aebb-ed221b0f5976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d56bc81dc1c84f10bb2d5d11a6eac8b7)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:43.346012 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a3493-f200-4e34-aebb-ed221b0f5976 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:43.410986 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-108a3493-f200-4e34-aebb-ed221b0f5976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd56bc81dc1c84f10bb2d5d11a6eac8b7'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:43.412360 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-108a3493-f200-4e34-aebb-ed221b0f5976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd56bc81dc1c84f10bb2d5d11a6eac8b7'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:43.421867 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-108a3493-f200-4e34-aebb-ed221b0f5976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd56bc81dc1c84f10bb2d5d11a6eac8b7'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:43.422688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-108a3493-f200-4e34-aebb-ed221b0f5976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd56bc81dc1c84f10bb2d5d11a6eac8b7'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:43.434931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-108a3493-f200-4e34-aebb-ed221b0f5976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd56bc81dc1c84f10bb2d5d11a6eac8b7'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:43.449509 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1178/2341] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:40:43 2022] DELETE /identity/v3/users/d56bc81dc1c84f10bb2d5d11a6eac8b7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:43.454830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb53afe-add7-4cdd-9cee-8a5fbf06ce0a None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:43.455494 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb53afe-add7-4cdd-9cee-8a5fbf06ce0a None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:43.455606 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb53afe-add7-4cdd-9cee-8a5fbf06ce0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:43.481261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-ccb53afe-add7-4cdd-9cee-8a5fbf06ce0a None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:43.482950 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-ccb53afe-add7-4cdd-9cee-8a5fbf06ce0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:43.496908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:43.565686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1164/2342] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:43.575421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a3493-f200-4e34-aebb-ed221b0f5976 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:43.577810 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-108a3493-f200-4e34-aebb-ed221b0f5976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:43.612280 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:43.675979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a3493-f200-4e34-aebb-ed221b0f5976 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:43.679778 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642a0cf-6476-4471-ab62-70d47cac4232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:43.680566 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642a0cf-6476-4471-ab62-70d47cac4232 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:43.680957 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642a0cf-6476-4471-ab62-70d47cac4232 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:43.681366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642a0cf-6476-4471-ab62-70d47cac4232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:43.692233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642a0cf-6476-4471-ab62-70d47cac4232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:43.693829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642a0cf-6476-4471-ab62-70d47cac4232 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:43.704828 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1179/2343] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:40:44.085072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb53afe-add7-4cdd-9cee-8a5fbf06ce0a None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:44.090458 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-ccb53afe-add7-4cdd-9cee-8a5fbf06ce0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:44.120658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb53afe-add7-4cdd-9cee-8a5fbf06ce0a None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:44.125993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4561f-08c7-4195-a684-005609a7d2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:44.126969 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4561f-08c7-4195-a684-005609a7d2cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:44.127369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4561f-08c7-4195-a684-005609a7d2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:44.127717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4561f-08c7-4195-a684-005609a7d2cc admin admin] PATH_INFO: `/v3/projects/096873e060324e8fb065a488b65a5461` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:44.131472 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4561f-08c7-4195-a684-005609a7d2cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=096873e060324e8fb065a488b65a5461)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:44.133856 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4561f-08c7-4195-a684-005609a7d2cc admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:44.216105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e2a4561f-08c7-4195-a684-005609a7d2cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '096873e060324e8fb065a488b65a5461', 'request_id': 'req-e2a4561f-08c7-4195-a684-005609a7d2cc'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:44.227832 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e2a4561f-08c7-4195-a684-005609a7d2cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '096873e060324e8fb065a488b65a5461', 'request_id': 'req-e2a4561f-08c7-4195-a684-005609a7d2cc'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:44.240768 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e2a4561f-08c7-4195-a684-005609a7d2cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '096873e060324e8fb065a488b65a5461', 'request_id': 'req-e2a4561f-08c7-4195-a684-005609a7d2cc'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:44.262106 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e2a4561f-08c7-4195-a684-005609a7d2cc admin admin] The token cache is being invalidate because project 096873e060324e8fb065a488b65a5461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:40:44.262747 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e2a4561f-08c7-4195-a684-005609a7d2cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:44.263707 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e2a4561f-08c7-4195-a684-005609a7d2cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:40:44.265991 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1165/2344] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:40:44 2022] DELETE /identity/v3/projects/096873e060324e8fb065a488b65a5461 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:44.271098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5292f3-451b-4036-8e6c-ca6529de69a5 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:44.271550 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5292f3-451b-4036-8e6c-ca6529de69a5 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:44.271915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5292f3-451b-4036-8e6c-ca6529de69a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:44.297850 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-8b5292f3-451b-4036-8e6c-ca6529de69a5 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:44.299570 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-8b5292f3-451b-4036-8e6c-ca6529de69a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:44.422152 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1180/2345] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:40:44.431072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccdfe7a-e413-48c8-a08a-e760fd1d7720 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:44.431391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccdfe7a-e413-48c8-a08a-e760fd1d7720 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:44.431674 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccdfe7a-e413-48c8-a08a-e760fd1d7720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:44.452965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-2ccdfe7a-e413-48c8-a08a-e760fd1d7720 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:44.454202 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-2ccdfe7a-e413-48c8-a08a-e760fd1d7720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:44.463780 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1166/2346] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:44.467822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5292f3-451b-4036-8e6c-ca6529de69a5 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:44.485510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5292f3-451b-4036-8e6c-ca6529de69a5 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:44.490779 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919bd99-e290-4444-be66-f0c88b2e8d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:44.491516 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919bd99-e290-4444-be66-f0c88b2e8d27 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:44.491808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919bd99-e290-4444-be66-f0c88b2e8d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:44.492096 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919bd99-e290-4444-be66-f0c88b2e8d27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:44.492860 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919bd99-e290-4444-be66-f0c88b2e8d27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:40:44.493177 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919bd99-e290-4444-be66-f0c88b2e8d27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:44.494811 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919bd99-e290-4444-be66-f0c88b2e8d27 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:44.509876 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1181/2347] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:40:44.513949 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccdfe7a-e413-48c8-a08a-e760fd1d7720 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:44.524673 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccdfe7a-e413-48c8-a08a-e760fd1d7720 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:44.534607 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecb653-1bb1-46fd-b56b-7af507b4e87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:44.535468 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecb653-1bb1-46fd-b56b-7af507b4e87c admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:44.535611 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecb653-1bb1-46fd-b56b-7af507b4e87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:44.535883 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecb653-1bb1-46fd-b56b-7af507b4e87c admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:44.536588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aecb653-1bb1-46fd-b56b-7af507b4e87c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:44.538992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aecb653-1bb1-46fd-b56b-7af507b4e87c admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:44.578818 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1167/2348] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:40:44 2022] POST /identity/v3/projects => generated 365 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:44.583110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919bd99-e290-4444-be66-f0c88b2e8d27 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:44.595834 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919bd99-e290-4444-be66-f0c88b2e8d27 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:44.671902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a8e21-a202-43dd-971e-883531a57e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:44.672703 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a8e21-a202-43dd-971e-883531a57e3e admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:44.673060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a8e21-a202-43dd-971e-883531a57e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:44.673409 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a8e21-a202-43dd-971e-883531a57e3e admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:44.674192 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a8e21-a202-43dd-971e-883531a57e3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:44.676504 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a8e21-a202-43dd-971e-883531a57e3e admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:44.712303 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1182/2349] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:40:44 2022] POST /identity/v3/users => generated 283 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:44.714028 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecb653-1bb1-46fd-b56b-7af507b4e87c admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:44.734160 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecb653-1bb1-46fd-b56b-7af507b4e87c admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:44.739104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa06e1-d38a-4ef5-a599-9598e10c4c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:44.739930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa06e1-d38a-4ef5-a599-9598e10c4c07 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:44.740278 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa06e1-d38a-4ef5-a599-9598e10c4c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:44.740619 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa06e1-d38a-4ef5-a599-9598e10c4c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:44.741410 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa06e1-d38a-4ef5-a599-9598e10c4c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:44.743093 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa06e1-d38a-4ef5-a599-9598e10c4c07 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:44.767301 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1168/2350] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:44.768622 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a8e21-a202-43dd-971e-883531a57e3e admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:44.794163 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a8e21-a202-43dd-971e-883531a57e3e admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:44.811162 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbc0b2-fece-4063-918d-46004d79a867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:44.813640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbc0b2-fece-4063-918d-46004d79a867 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:44.814048 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbc0b2-fece-4063-918d-46004d79a867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:44.815027 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbc0b2-fece-4063-918d-46004d79a867 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:44.816059 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbc0b2-fece-4063-918d-46004d79a867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:44.818856 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbc0b2-fece-4063-918d-46004d79a867 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:44.833961 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1183/2351] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:44.850771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa06e1-d38a-4ef5-a599-9598e10c4c07 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:44.869840 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa06e1-d38a-4ef5-a599-9598e10c4c07 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:44.876228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22183404-c0a8-4f6e-8601-e41b80bc14a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:44.877144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22183404-c0a8-4f6e-8601-e41b80bc14a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:44.877425 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22183404-c0a8-4f6e-8601-e41b80bc14a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:44.877707 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22183404-c0a8-4f6e-8601-e41b80bc14a6 admin admin] PATH_INFO: `/v3/projects/ecbadcdbcfc54371a21871a945f82010/users/d189806e11734d2ab723932928f3e44d/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:44.896578 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22183404-c0a8-4f6e-8601-e41b80bc14a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbadcdbcfc54371a21871a945f82010, user_id=d189806e11734d2ab723932928f3e44d, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:44.901614 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22183404-c0a8-4f6e-8601-e41b80bc14a6 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:44.933217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1169/2352] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:44 2022] PUT /identity/v3/projects/ecbadcdbcfc54371a21871a945f82010/users/d189806e11734d2ab723932928f3e44d/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:44.933411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444a893-8563-4895-9f9c-b1c35e05ce11 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:44.933802 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444a893-8563-4895-9f9c-b1c35e05ce11 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:44.934183 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444a893-8563-4895-9f9c-b1c35e05ce11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:44.967806 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-9444a893-8563-4895-9f9c-b1c35e05ce11 None None] MFA Rules not processed for user `d189806e11734d2ab723932928f3e44d`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:44.969991 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-9444a893-8563-4895-9f9c-b1c35e05ce11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:44.993760 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:45.086502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a8fe1-3830-444b-9a43-c86361a64d5a None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:45.086792 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a8fe1-3830-444b-9a43-c86361a64d5a None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:45.087069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a8fe1-3830-444b-9a43-c86361a64d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:45.087637 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1184/2353] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:45.099368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444a893-8563-4895-9f9c-b1c35e05ce11 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:45.101566 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-9444a893-8563-4895-9f9c-b1c35e05ce11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:45.125034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-064a8fe1-3830-444b-9a43-c86361a64d5a None None] MFA Rules not processed for user `68b32d9217954d72a2b7aa3ba893f942`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:45.126275 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-064a8fe1-3830-444b-9a43-c86361a64d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:45.151884 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:45.192676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444a893-8563-4895-9f9c-b1c35e05ce11 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:45.198376 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4df40f-06ff-427d-8f77-813da841ceb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:45.199044 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4df40f-06ff-427d-8f77-813da841ceb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:45.199362 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4df40f-06ff-427d-8f77-813da841ceb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:45.199965 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4df40f-06ff-427d-8f77-813da841ceb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:45.221952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4df40f-06ff-427d-8f77-813da841ceb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:45.223084 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4df40f-06ff-427d-8f77-813da841ceb4 service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:45.248539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1185/2354] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:45 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:40:45.251866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1170/2355] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:45.256118 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4df40f-06ff-427d-8f77-813da841ceb4 service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:45.257491 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-2c4df40f-06ff-427d-8f77-813da841ceb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:45.337056 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4df40f-06ff-427d-8f77-813da841ceb4 service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:45.342270 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b636d8e-593b-4824-8d40-ea60d0488805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:45.342784 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b636d8e-593b-4824-8d40-ea60d0488805 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:45.343644 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b636d8e-593b-4824-8d40-ea60d0488805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:45.343936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b636d8e-593b-4824-8d40-ea60d0488805 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:45.344674 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b636d8e-593b-4824-8d40-ea60d0488805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:45.348336 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b636d8e-593b-4824-8d40-ea60d0488805 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:45.385845 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a8fe1-3830-444b-9a43-c86361a64d5a None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:45.392615 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1186/2356] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:40:45 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:40:45.397497 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a8fe1-3830-444b-9a43-c86361a64d5a None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:45.465455 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f65442-db21-4d00-9f2f-56f765372e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:45.466189 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f65442-db21-4d00-9f2f-56f765372e92 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:45.466411 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f65442-db21-4d00-9f2f-56f765372e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:45.466698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f65442-db21-4d00-9f2f-56f765372e92 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:45.467427 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f65442-db21-4d00-9f2f-56f765372e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:45.469907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f65442-db21-4d00-9f2f-56f765372e92 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:45.499514 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1171/2357] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:40:45 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:40:45.503587 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b636d8e-593b-4824-8d40-ea60d0488805 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:45.518503 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b636d8e-593b-4824-8d40-ea60d0488805 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:45.523804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20604e23-1da2-4e72-8372-ce007a749ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:45.524634 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20604e23-1da2-4e72-8372-ce007a749ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:45.524918 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20604e23-1da2-4e72-8372-ce007a749ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:45.525273 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20604e23-1da2-4e72-8372-ce007a749ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:45.526000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20604e23-1da2-4e72-8372-ce007a749ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:45.527796 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20604e23-1da2-4e72-8372-ce007a749ffe admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:45.539844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1187/2358] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:45.543942 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f65442-db21-4d00-9f2f-56f765372e92 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:45.562717 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f65442-db21-4d00-9f2f-56f765372e92 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:45.567733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37c064-c52c-4be5-84ac-d08989a7e07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:45.568792 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37c064-c52c-4be5-84ac-d08989a7e07b admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:45.569088 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37c064-c52c-4be5-84ac-d08989a7e07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:45.569424 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37c064-c52c-4be5-84ac-d08989a7e07b admin admin] PATH_INFO: `/v3/projects/da2160cfd845436b813871795986d876/users/43fec2f999c748e0a7266455dddbc7e0/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:45.586801 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37c064-c52c-4be5-84ac-d08989a7e07b admin admin] RBAC: Authorizing `identity:create_grant(project_id=da2160cfd845436b813871795986d876, user_id=43fec2f999c748e0a7266455dddbc7e0, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:45.590463 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37c064-c52c-4be5-84ac-d08989a7e07b admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:45.609499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1172/2359] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:45 2022] PUT /identity/v3/projects/da2160cfd845436b813871795986d876/users/43fec2f999c748e0a7266455dddbc7e0/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:40:45.613355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20604e23-1da2-4e72-8372-ce007a749ffe admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:45.623923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20604e23-1da2-4e72-8372-ce007a749ffe admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:45.655981 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:45.684475 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd0abc-1be1-4831-91de-b7cbc76cc21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:45.685155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd0abc-1be1-4831-91de-b7cbc76cc21b admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:45.685444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd0abc-1be1-4831-91de-b7cbc76cc21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:45.685856 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd0abc-1be1-4831-91de-b7cbc76cc21b admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:45.686596 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd0abc-1be1-4831-91de-b7cbc76cc21b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:45.688270 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd0abc-1be1-4831-91de-b7cbc76cc21b admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:45.698283 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1188/2360] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:40:45.702291 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37c064-c52c-4be5-84ac-d08989a7e07b admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:45.712771 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37c064-c52c-4be5-84ac-d08989a7e07b admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:45.717609 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce06348-b2d9-464c-8166-a8f81c67297b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:45.719033 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce06348-b2d9-464c-8166-a8f81c67297b admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:45.719350 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce06348-b2d9-464c-8166-a8f81c67297b admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:45.719632 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce06348-b2d9-464c-8166-a8f81c67297b admin admin] PATH_INFO: `/v3/projects/da2160cfd845436b813871795986d876/users/43fec2f999c748e0a7266455dddbc7e0/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:45.721630 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce06348-b2d9-464c-8166-a8f81c67297b admin admin] RBAC: Authorizing `identity:create_grant(project_id=da2160cfd845436b813871795986d876, user_id=43fec2f999c748e0a7266455dddbc7e0, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:45.724617 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce06348-b2d9-464c-8166-a8f81c67297b admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:45.737011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1173/2361] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:40:45 2022] PUT /identity/v3/projects/da2160cfd845436b813871795986d876/users/43fec2f999c748e0a7266455dddbc7e0/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:40:50.798121 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4f612-0027-429f-96a9-f1a949872124 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:50.798650 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4f612-0027-429f-96a9-f1a949872124 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:50.798650 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4f612-0027-429f-96a9-f1a949872124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:50.836008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-eda4f612-0027-429f-96a9-f1a949872124 None None] MFA Rules not processed for user `43fec2f999c748e0a7266455dddbc7e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:50.837404 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-eda4f612-0027-429f-96a9-f1a949872124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:50.961554 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1189/2362] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:40:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:40:53.890867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce06348-b2d9-464c-8166-a8f81c67297b admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:53.893850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-1ce06348-b2d9-464c-8166-a8f81c67297b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:53.989712 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:53.992643 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce06348-b2d9-464c-8166-a8f81c67297b admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:53.997379 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754e778-b9ab-444d-9d30-07038558f427 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e04575437341df8127860a5e5abc50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:53.998097 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754e778-b9ab-444d-9d30-07038558f427 service glance] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:53.998577 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754e778-b9ab-444d-9d30-07038558f427 service glance] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:53.999692 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754e778-b9ab-444d-9d30-07038558f427 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:54.132683 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754e778-b9ab-444d-9d30-07038558f427 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:54.134356 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754e778-b9ab-444d-9d30-07038558f427 service glance] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:54.168813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1174/2363] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:40:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:40:54.341815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302576d-63ff-45bd-8275-a6ea096ef590 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:54.342387 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302576d-63ff-45bd-8275-a6ea096ef590 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:54.342387 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302576d-63ff-45bd-8275-a6ea096ef590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:54.375376 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-1302576d-63ff-45bd-8275-a6ea096ef590 None None] MFA Rules not processed for user `f52f0a03cc0f494d82a091bd885478e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:40:54.376598 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-1302576d-63ff-45bd-8275-a6ea096ef590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:54.488108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1190/2364] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 09:40:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:40:54.540674 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754e778-b9ab-444d-9d30-07038558f427 service glance] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:40:54.542583 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-3754e778-b9ab-444d-9d30-07038558f427 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:40:54.658579 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754e778-b9ab-444d-9d30-07038558f427 service glance] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:40:54.664317 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ee7a1-dec0-40d0-a25c-e7f8c6c01d2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '351f74222d394f39bda0663e0e4ebde6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:40:54.665726 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ee7a1-dec0-40d0-a25c-e7f8c6c01d2a service swift] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:40:54.666092 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ee7a1-dec0-40d0-a25c-e7f8c6c01d2a service swift] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:40:54.666635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ee7a1-dec0-40d0-a25c-e7f8c6c01d2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:40:54.677202 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ee7a1-dec0-40d0-a25c-e7f8c6c01d2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:40:54.683118 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ee7a1-dec0-40d0-a25c-e7f8c6c01d2a service swift] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:40:54.693885 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1175/2365] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 09:40:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:41:04.460338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=73 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:04.551385 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5a1ed-5b8c-4fdd-8ca2-9e143300f5be None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:04.551676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5a1ed-5b8c-4fdd-8ca2-9e143300f5be None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:04.551958 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5a1ed-5b8c-4fdd-8ca2-9e143300f5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:04.568982 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-6fc5a1ed-5b8c-4fdd-8ca2-9e143300f5be None None] MFA Rules not processed for user `68b32d9217954d72a2b7aa3ba893f942`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:41:04.570160 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-6fc5a1ed-5b8c-4fdd-8ca2-9e143300f5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:04.577556 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1191/2366] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:41:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:41:04.690020 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=68 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:14.563852 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:15.054275 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9760613-b1ab-4d07-ba46-19bf2af10929 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:15.054275 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9760613-b1ab-4d07-ba46-19bf2af10929 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:15.054810 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9760613-b1ab-4d07-ba46-19bf2af10929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:15.090263 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-a9760613-b1ab-4d07-ba46-19bf2af10929 None None] MFA Rules not processed for user `f52f0a03cc0f494d82a091bd885478e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:41:15.091850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-a9760613-b1ab-4d07-ba46-19bf2af10929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:41:15.109228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1176/2367] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 09:41:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:41:15.131107 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5a1ed-5b8c-4fdd-8ca2-9e143300f5be None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:41:15.151901 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5a1ed-5b8c-4fdd-8ca2-9e143300f5be None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:41:15.169935 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1176225-848a-4adf-a539-05846656ba9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '351f74222d394f39bda0663e0e4ebde6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:41:15.171001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1176225-848a-4adf-a539-05846656ba9b service swift] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:41:15.171535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1176225-848a-4adf-a539-05846656ba9b service swift] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:41:15.172011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1176225-848a-4adf-a539-05846656ba9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:41:15.185919 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1176225-848a-4adf-a539-05846656ba9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:41:15.188334 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1176225-848a-4adf-a539-05846656ba9b service swift] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:41:15.211507 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1192/2368] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 09:41:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:41:25.102146 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=10 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:25.194767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=6 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:03.026910 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9760613-b1ab-4d07-ba46-19bf2af10929 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:03.028957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-a9760613-b1ab-4d07-ba46-19bf2af10929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:03.127045 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9760613-b1ab-4d07-ba46-19bf2af10929 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:03.131564 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac13862-31b2-438f-8cf2-c8f4fccb79b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:03.132433 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac13862-31b2-438f-8cf2-c8f4fccb79b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:03.132714 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac13862-31b2-438f-8cf2-c8f4fccb79b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:03.132987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac13862-31b2-438f-8cf2-c8f4fccb79b9 admin admin] PATH_INFO: `/v3/users/e31ae891fbd344918d4338a4430e60af` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:03.134165 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac13862-31b2-438f-8cf2-c8f4fccb79b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e31ae891fbd344918d4338a4430e60af)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:03.136100 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac13862-31b2-438f-8cf2-c8f4fccb79b9 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:03.181126 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-2ac13862-31b2-438f-8cf2-c8f4fccb79b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e31ae891fbd344918d4338a4430e60af'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:03.188440 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-2ac13862-31b2-438f-8cf2-c8f4fccb79b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e31ae891fbd344918d4338a4430e60af'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:03.189094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-2ac13862-31b2-438f-8cf2-c8f4fccb79b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e31ae891fbd344918d4338a4430e60af'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:03.200795 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-2ac13862-31b2-438f-8cf2-c8f4fccb79b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e31ae891fbd344918d4338a4430e60af'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:03.207551 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-2ac13862-31b2-438f-8cf2-c8f4fccb79b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e31ae891fbd344918d4338a4430e60af'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:03.218499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1177/2369] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:42:03 2022] DELETE /identity/v3/users/e31ae891fbd344918d4338a4430e60af => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:03.223341 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376dea0-4885-4135-9dbd-638e8a73eddd None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:03.223857 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376dea0-4885-4135-9dbd-638e8a73eddd None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:03.223960 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376dea0-4885-4135-9dbd-638e8a73eddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:03.250088 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-d376dea0-4885-4135-9dbd-638e8a73eddd None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:03.251995 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d376dea0-4885-4135-9dbd-638e8a73eddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:03.312853 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1193/2370] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:03.342195 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac13862-31b2-438f-8cf2-c8f4fccb79b9 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:03.343861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-2ac13862-31b2-438f-8cf2-c8f4fccb79b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:03.403669 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:03.430556 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac13862-31b2-438f-8cf2-c8f4fccb79b9 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:03.434295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca97ab9-b18f-40b2-aed2-8ea8a314e731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:03.434882 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca97ab9-b18f-40b2-aed2-8ea8a314e731 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:03.435167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca97ab9-b18f-40b2-aed2-8ea8a314e731 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:03.435475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca97ab9-b18f-40b2-aed2-8ea8a314e731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:03.444497 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca97ab9-b18f-40b2-aed2-8ea8a314e731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:03.445911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca97ab9-b18f-40b2-aed2-8ea8a314e731 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:03.455206 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1178/2371] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:03.719817 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376dea0-4885-4135-9dbd-638e8a73eddd None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:03.722292 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d376dea0-4885-4135-9dbd-638e8a73eddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:03.740856 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376dea0-4885-4135-9dbd-638e8a73eddd None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:03.746136 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f602d-8f3b-4d26-8772-1fc0b9e5fd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:03.747629 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f602d-8f3b-4d26-8772-1fc0b9e5fd7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:03.748134 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f602d-8f3b-4d26-8772-1fc0b9e5fd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:03.748566 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f602d-8f3b-4d26-8772-1fc0b9e5fd7c admin admin] PATH_INFO: `/v3/projects/eee129f5d82e42688c3f05621e9ef165` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:03.750931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f602d-8f3b-4d26-8772-1fc0b9e5fd7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eee129f5d82e42688c3f05621e9ef165)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:03.753987 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f602d-8f3b-4d26-8772-1fc0b9e5fd7c admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:03.870162 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3c1f602d-8f3b-4d26-8772-1fc0b9e5fd7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eee129f5d82e42688c3f05621e9ef165', 'request_id': 'req-3c1f602d-8f3b-4d26-8772-1fc0b9e5fd7c'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:03.880322 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3c1f602d-8f3b-4d26-8772-1fc0b9e5fd7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eee129f5d82e42688c3f05621e9ef165', 'request_id': 'req-3c1f602d-8f3b-4d26-8772-1fc0b9e5fd7c'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:03.890547 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3c1f602d-8f3b-4d26-8772-1fc0b9e5fd7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eee129f5d82e42688c3f05621e9ef165', 'request_id': 'req-3c1f602d-8f3b-4d26-8772-1fc0b9e5fd7c'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:03.913397 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3c1f602d-8f3b-4d26-8772-1fc0b9e5fd7c admin admin] The token cache is being invalidate because project eee129f5d82e42688c3f05621e9ef165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:42:03.913993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3c1f602d-8f3b-4d26-8772-1fc0b9e5fd7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:03.914861 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3c1f602d-8f3b-4d26-8772-1fc0b9e5fd7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:03.916759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1194/2372] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:42:03 2022] DELETE /identity/v3/projects/eee129f5d82e42688c3f05621e9ef165 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:03.924981 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff604c1-7c4f-4e4f-9b79-1d1355b61ebb None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:03.925298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff604c1-7c4f-4e4f-9b79-1d1355b61ebb None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:03.925581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff604c1-7c4f-4e4f-9b79-1d1355b61ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:03.992170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-0ff604c1-7c4f-4e4f-9b79-1d1355b61ebb None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:03.993398 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-0ff604c1-7c4f-4e4f-9b79-1d1355b61ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:04.072629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1179/2373] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:04.081685 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee7f49-e7ec-4053-adea-b38c7f088ce8 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:04.081685 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee7f49-e7ec-4053-adea-b38c7f088ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:04.081945 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee7f49-e7ec-4053-adea-b38c7f088ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:04.113743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-ffee7f49-e7ec-4053-adea-b38c7f088ce8 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:04.115688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-ffee7f49-e7ec-4053-adea-b38c7f088ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:04.124624 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1195/2374] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:04.129206 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff604c1-7c4f-4e4f-9b79-1d1355b61ebb None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:04.139234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff604c1-7c4f-4e4f-9b79-1d1355b61ebb None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:04.144429 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2d5ad-7fe0-4100-9f63-defd50b44226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:04.145084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2d5ad-7fe0-4100-9f63-defd50b44226 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:04.145366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2d5ad-7fe0-4100-9f63-defd50b44226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:04.145639 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2d5ad-7fe0-4100-9f63-defd50b44226 admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:04.146360 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2d5ad-7fe0-4100-9f63-defd50b44226 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:42:04.146699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2d5ad-7fe0-4100-9f63-defd50b44226 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:04.148381 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2d5ad-7fe0-4100-9f63-defd50b44226 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:04.160712 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1180/2375] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:42:04.164902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee7f49-e7ec-4053-adea-b38c7f088ce8 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:04.176462 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee7f49-e7ec-4053-adea-b38c7f088ce8 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:04.182412 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5eced4-caff-4194-a66b-62cafbfccf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:04.183089 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5eced4-caff-4194-a66b-62cafbfccf16 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:04.183402 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5eced4-caff-4194-a66b-62cafbfccf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:04.183681 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5eced4-caff-4194-a66b-62cafbfccf16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:04.184374 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5eced4-caff-4194-a66b-62cafbfccf16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:04.186300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5eced4-caff-4194-a66b-62cafbfccf16 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:04.221970 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1196/2376] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:42:04 2022] POST /identity/v3/projects => generated 389 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:04.226410 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2d5ad-7fe0-4100-9f63-defd50b44226 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:04.237988 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2d5ad-7fe0-4100-9f63-defd50b44226 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:04.311853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b556e0f-57e8-4b26-9470-61eb622758f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:04.313269 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b556e0f-57e8-4b26-9470-61eb622758f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:04.313549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b556e0f-57e8-4b26-9470-61eb622758f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:04.313847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b556e0f-57e8-4b26-9470-61eb622758f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:04.314683 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b556e0f-57e8-4b26-9470-61eb622758f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:04.316848 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b556e0f-57e8-4b26-9470-61eb622758f7 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:04.343973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1181/2377] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:42:04 2022] POST /identity/v3/users => generated 295 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:04.347357 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5eced4-caff-4194-a66b-62cafbfccf16 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:04.359170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5eced4-caff-4194-a66b-62cafbfccf16 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:04.365805 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e1ec6-d30e-40d3-9e85-30b541c12401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:04.366540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e1ec6-d30e-40d3-9e85-30b541c12401 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:04.366892 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e1ec6-d30e-40d3-9e85-30b541c12401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:04.367236 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e1ec6-d30e-40d3-9e85-30b541c12401 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:04.368104 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e1ec6-d30e-40d3-9e85-30b541c12401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:04.369771 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e1ec6-d30e-40d3-9e85-30b541c12401 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:04.382248 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1197/2378] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:04.386587 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b556e0f-57e8-4b26-9470-61eb622758f7 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:04.399639 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b556e0f-57e8-4b26-9470-61eb622758f7 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:04.404590 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfe8f1-132c-4548-a5ef-08b26a561315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:04.405287 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfe8f1-132c-4548-a5ef-08b26a561315 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:04.405571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfe8f1-132c-4548-a5ef-08b26a561315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:04.405887 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfe8f1-132c-4548-a5ef-08b26a561315 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:04.406622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcfe8f1-132c-4548-a5ef-08b26a561315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:04.408276 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcfe8f1-132c-4548-a5ef-08b26a561315 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:04.422700 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1182/2379] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:04.424100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e1ec6-d30e-40d3-9e85-30b541c12401 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:04.434848 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e1ec6-d30e-40d3-9e85-30b541c12401 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:04.440120 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ac787-5328-4f91-8bd1-843b632b883b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:04.441193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ac787-5328-4f91-8bd1-843b632b883b admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:04.441471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ac787-5328-4f91-8bd1-843b632b883b admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:04.441964 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ac787-5328-4f91-8bd1-843b632b883b admin admin] PATH_INFO: `/v3/projects/eb742ed888294ccfba81cb742c53669b/users/3675aa8190aa4ed780f340ddfa308dc0/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:04.458424 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ac787-5328-4f91-8bd1-843b632b883b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb742ed888294ccfba81cb742c53669b, user_id=3675aa8190aa4ed780f340ddfa308dc0, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:04.461522 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ac787-5328-4f91-8bd1-843b632b883b admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:04.476990 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1198/2380] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:42:04 2022] PUT /identity/v3/projects/eb742ed888294ccfba81cb742c53669b/users/3675aa8190aa4ed780f340ddfa308dc0/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:04.488006 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134839f-c5a6-40ff-9e42-ecd3dc695bc1 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:04.488388 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134839f-c5a6-40ff-9e42-ecd3dc695bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:04.488784 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134839f-c5a6-40ff-9e42-ecd3dc695bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:04.517141 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-d134839f-c5a6-40ff-9e42-ecd3dc695bc1 None None] MFA Rules not processed for user `3675aa8190aa4ed780f340ddfa308dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:04.518370 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-d134839f-c5a6-40ff-9e42-ecd3dc695bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:04.523229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:04.601201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1183/2381] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:42:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:04.613077 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ac787-5328-4f91-8bd1-843b632b883b admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:04.615526 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-036ac787-5328-4f91-8bd1-843b632b883b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:04.637071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:04.710370 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ac787-5328-4f91-8bd1-843b632b883b admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:04.715644 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7158d9-77f1-4d6b-881a-ccd8070ca15d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:04.716485 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7158d9-77f1-4d6b-881a-ccd8070ca15d service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:04.716776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7158d9-77f1-4d6b-881a-ccd8070ca15d service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:04.717057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7158d9-77f1-4d6b-881a-ccd8070ca15d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:04.734097 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7158d9-77f1-4d6b-881a-ccd8070ca15d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:04.742677 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7158d9-77f1-4d6b-881a-ccd8070ca15d service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:04.758223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1199/2382] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:42:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:05.190489 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134839f-c5a6-40ff-9e42-ecd3dc695bc1 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:05.191621 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-d134839f-c5a6-40ff-9e42-ecd3dc695bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:05.293113 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134839f-c5a6-40ff-9e42-ecd3dc695bc1 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:05.298297 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e85fa-a876-4487-ae6f-1d8bd27f14cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746fd8ed517446fe89c53df873abb2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:05.298947 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e85fa-a876-4487-ae6f-1d8bd27f14cf service placement] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:05.299234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e85fa-a876-4487-ae6f-1d8bd27f14cf service placement] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:05.299547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e85fa-a876-4487-ae6f-1d8bd27f14cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:05.301451 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f85e85fa-a876-4487-ae6f-1d8bd27f14cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:05.312947 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e85fa-a876-4487-ae6f-1d8bd27f14cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:05.314561 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e85fa-a876-4487-ae6f-1d8bd27f14cf service placement] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:05.324521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1184/2383] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:42:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:08.599225 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d67c4-ce7d-420d-8929-c723e7979caf None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:08.599754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d67c4-ce7d-420d-8929-c723e7979caf None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:08.599870 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d67c4-ce7d-420d-8929-c723e7979caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:08.618468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-766d67c4-ce7d-420d-8929-c723e7979caf None None] MFA Rules not processed for user `1331ba69eaec44dd9bd8f8db7d53ba5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:08.619722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-766d67c4-ce7d-420d-8929-c723e7979caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:08.674756 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1200/2384] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:42:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:13.802210 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e85fa-a876-4487-ae6f-1d8bd27f14cf service placement] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:13.804041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f85e85fa-a876-4487-ae6f-1d8bd27f14cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:13.909392 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e85fa-a876-4487-ae6f-1d8bd27f14cf service placement] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:13.914605 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e114e-09bc-4009-aaa2-52b5a2f31e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:13.915829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e114e-09bc-4009-aaa2-52b5a2f31e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:13.916121 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e114e-09bc-4009-aaa2-52b5a2f31e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:13.916394 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e114e-09bc-4009-aaa2-52b5a2f31e57 admin admin] PATH_INFO: `/v3/users/d189806e11734d2ab723932928f3e44d` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:13.917626 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e114e-09bc-4009-aaa2-52b5a2f31e57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d189806e11734d2ab723932928f3e44d)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:13.919605 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e114e-09bc-4009-aaa2-52b5a2f31e57 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:13.943837 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:13.990400 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c22e114e-09bc-4009-aaa2-52b5a2f31e57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd189806e11734d2ab723932928f3e44d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:14.000118 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c22e114e-09bc-4009-aaa2-52b5a2f31e57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd189806e11734d2ab723932928f3e44d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:14.001700 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c22e114e-09bc-4009-aaa2-52b5a2f31e57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd189806e11734d2ab723932928f3e44d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:14.019361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c22e114e-09bc-4009-aaa2-52b5a2f31e57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd189806e11734d2ab723932928f3e44d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:14.035317 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-c22e114e-09bc-4009-aaa2-52b5a2f31e57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd189806e11734d2ab723932928f3e44d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:14.043410 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1185/2385] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:42:13 2022] DELETE /identity/v3/users/d189806e11734d2ab723932928f3e44d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:14.049419 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89712fed-270f-4a9b-9544-e85fe67f1d4a None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.049867 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89712fed-270f-4a9b-9544-e85fe67f1d4a None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.050038 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89712fed-270f-4a9b-9544-e85fe67f1d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.073497 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-89712fed-270f-4a9b-9544-e85fe67f1d4a None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:14.074840 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-89712fed-270f-4a9b-9544-e85fe67f1d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:14.197676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1201/2386] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:14.199544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e114e-09bc-4009-aaa2-52b5a2f31e57 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.202310 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-c22e114e-09bc-4009-aaa2-52b5a2f31e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:14.280545 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e114e-09bc-4009-aaa2-52b5a2f31e57 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.285158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ee86e-67a6-4ccc-b311-340015c299cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.285884 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ee86e-67a6-4ccc-b311-340015c299cb service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.286168 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ee86e-67a6-4ccc-b311-340015c299cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.286444 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ee86e-67a6-4ccc-b311-340015c299cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.296296 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ee86e-67a6-4ccc-b311-340015c299cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.297744 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ee86e-67a6-4ccc-b311-340015c299cb service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.308637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1186/2387] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:42:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:14.608946 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89712fed-270f-4a9b-9544-e85fe67f1d4a None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.610969 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-89712fed-270f-4a9b-9544-e85fe67f1d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:14.623384 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89712fed-270f-4a9b-9544-e85fe67f1d4a None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.628366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fd060-d387-4618-a481-6f0caaa12ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.629373 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fd060-d387-4618-a481-6f0caaa12ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.629822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fd060-d387-4618-a481-6f0caaa12ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.630099 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fd060-d387-4618-a481-6f0caaa12ddc admin admin] PATH_INFO: `/v3/projects/ecbadcdbcfc54371a21871a945f82010` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.632342 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fd060-d387-4618-a481-6f0caaa12ddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecbadcdbcfc54371a21871a945f82010)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.634407 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fd060-d387-4618-a481-6f0caaa12ddc admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.677235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:14.688185 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-7e4fd060-d387-4618-a481-6f0caaa12ddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecbadcdbcfc54371a21871a945f82010', 'request_id': 'req-7e4fd060-d387-4618-a481-6f0caaa12ddc'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:14.695482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-7e4fd060-d387-4618-a481-6f0caaa12ddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecbadcdbcfc54371a21871a945f82010', 'request_id': 'req-7e4fd060-d387-4618-a481-6f0caaa12ddc'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:14.700951 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-7e4fd060-d387-4618-a481-6f0caaa12ddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecbadcdbcfc54371a21871a945f82010', 'request_id': 'req-7e4fd060-d387-4618-a481-6f0caaa12ddc'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:14.711897 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-7e4fd060-d387-4618-a481-6f0caaa12ddc admin admin] The token cache is being invalidate because project ecbadcdbcfc54371a21871a945f82010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:42:14.712193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-7e4fd060-d387-4618-a481-6f0caaa12ddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:14.712831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-7e4fd060-d387-4618-a481-6f0caaa12ddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:14.714454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1202/2388] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:42:14 2022] DELETE /identity/v3/projects/ecbadcdbcfc54371a21871a945f82010 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:14.719439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a7df1-0578-4d98-8ee9-84fcf24fedf7 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.720277 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a7df1-0578-4d98-8ee9-84fcf24fedf7 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.720829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a7df1-0578-4d98-8ee9-84fcf24fedf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.738449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-3d6a7df1-0578-4d98-8ee9-84fcf24fedf7 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:14.739674 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-3d6a7df1-0578-4d98-8ee9-84fcf24fedf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:14.803047 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1187/2389] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:14.810590 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649715ce-72ca-4ab5-b573-8249bc3bf9f4 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.810884 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649715ce-72ca-4ab5-b573-8249bc3bf9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.811171 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649715ce-72ca-4ab5-b573-8249bc3bf9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.829275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-649715ce-72ca-4ab5-b573-8249bc3bf9f4 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:14.830479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-649715ce-72ca-4ab5-b573-8249bc3bf9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:14.838799 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1203/2390] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:14.843499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a7df1-0578-4d98-8ee9-84fcf24fedf7 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.853863 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a7df1-0578-4d98-8ee9-84fcf24fedf7 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.858379 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d39e5-d8da-4f6e-ad87-93db5ca6f60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.859054 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d39e5-d8da-4f6e-ad87-93db5ca6f60a admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.859368 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d39e5-d8da-4f6e-ad87-93db5ca6f60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.859646 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d39e5-d8da-4f6e-ad87-93db5ca6f60a admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.860437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d39e5-d8da-4f6e-ad87-93db5ca6f60a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:42:14.861301 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d39e5-d8da-4f6e-ad87-93db5ca6f60a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.862878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d39e5-d8da-4f6e-ad87-93db5ca6f60a admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.874214 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1188/2391] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:42:14.878325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649715ce-72ca-4ab5-b573-8249bc3bf9f4 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.887515 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649715ce-72ca-4ab5-b573-8249bc3bf9f4 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.892686 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e21fc-c557-4fca-adea-d95eb944ba3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.893334 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e21fc-c557-4fca-adea-d95eb944ba3e admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.893617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e21fc-c557-4fca-adea-d95eb944ba3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.893894 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e21fc-c557-4fca-adea-d95eb944ba3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.894584 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e21fc-c557-4fca-adea-d95eb944ba3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:14.896528 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e21fc-c557-4fca-adea-d95eb944ba3e admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:14.924660 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1204/2392] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:42:14 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:14.927162 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d39e5-d8da-4f6e-ad87-93db5ca6f60a admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:14.937178 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d39e5-d8da-4f6e-ad87-93db5ca6f60a admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:14.958861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:14.998080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3347f-c967-4cff-a99f-9d201c8ea171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:14.998429 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3347f-c967-4cff-a99f-9d201c8ea171 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:14.998712 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3347f-c967-4cff-a99f-9d201c8ea171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:14.999060 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3347f-c967-4cff-a99f-9d201c8ea171 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:14.999701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3347f-c967-4cff-a99f-9d201c8ea171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:15.001637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3347f-c967-4cff-a99f-9d201c8ea171 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:15.022796 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1189/2393] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:42:14 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:15.026924 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e21fc-c557-4fca-adea-d95eb944ba3e admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:15.038236 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e21fc-c557-4fca-adea-d95eb944ba3e admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:15.043291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d16b2-0a54-41a5-a896-d471b2b30f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:15.044035 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d16b2-0a54-41a5-a896-d471b2b30f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:15.044382 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d16b2-0a54-41a5-a896-d471b2b30f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:15.044659 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d16b2-0a54-41a5-a896-d471b2b30f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:15.045380 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d16b2-0a54-41a5-a896-d471b2b30f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:15.047023 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d16b2-0a54-41a5-a896-d471b2b30f6b admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:15.058179 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1205/2394] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:42:15.062190 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3347f-c967-4cff-a99f-9d201c8ea171 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:15.072681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3347f-c967-4cff-a99f-9d201c8ea171 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:15.077284 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc2477-5e24-4ecf-ae98-d099ab6ac13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:15.077935 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc2477-5e24-4ecf-ae98-d099ab6ac13a admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:15.078217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc2477-5e24-4ecf-ae98-d099ab6ac13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:15.078491 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc2477-5e24-4ecf-ae98-d099ab6ac13a admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:15.079235 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc2477-5e24-4ecf-ae98-d099ab6ac13a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:15.080837 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc2477-5e24-4ecf-ae98-d099ab6ac13a admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:15.090575 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1190/2395] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:15.094547 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d16b2-0a54-41a5-a896-d471b2b30f6b admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:15.104497 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d16b2-0a54-41a5-a896-d471b2b30f6b admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:15.109024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687b8e0-f0fa-4ac4-b02b-2e8caa698ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:15.109885 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687b8e0-f0fa-4ac4-b02b-2e8caa698ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:15.110162 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687b8e0-f0fa-4ac4-b02b-2e8caa698ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:15.110960 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687b8e0-f0fa-4ac4-b02b-2e8caa698ee4 admin admin] PATH_INFO: `/v3/projects/d51656e5a4ab48a98dad3b48f3b550d9/users/b857644c1450464b8132b85271368aad/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:15.125110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687b8e0-f0fa-4ac4-b02b-2e8caa698ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51656e5a4ab48a98dad3b48f3b550d9, user_id=b857644c1450464b8132b85271368aad, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:15.128438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687b8e0-f0fa-4ac4-b02b-2e8caa698ee4 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:15.141137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1206/2396] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:42:15 2022] PUT /identity/v3/projects/d51656e5a4ab48a98dad3b48f3b550d9/users/b857644c1450464b8132b85271368aad/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:15.151170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33ce71-9285-4931-8d46-bce15397a1e8 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:15.151492 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33ce71-9285-4931-8d46-bce15397a1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:15.151768 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33ce71-9285-4931-8d46-bce15397a1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:15.177957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-cd33ce71-9285-4931-8d46-bce15397a1e8 None None] MFA Rules not processed for user `b857644c1450464b8132b85271368aad`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:15.179163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-cd33ce71-9285-4931-8d46-bce15397a1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:15.244173 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1191/2397] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:42:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:15.254785 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687b8e0-f0fa-4ac4-b02b-2e8caa698ee4 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:15.256475 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-4687b8e0-f0fa-4ac4-b02b-2e8caa698ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:15.311890 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687b8e0-f0fa-4ac4-b02b-2e8caa698ee4 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:15.315955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b17e1b-228a-43e1-868e-b57014a91253 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:15.316598 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b17e1b-228a-43e1-868e-b57014a91253 service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:15.316883 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b17e1b-228a-43e1-868e-b57014a91253 service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:15.317160 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b17e1b-228a-43e1-868e-b57014a91253 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:15.325505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b17e1b-228a-43e1-868e-b57014a91253 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:15.326935 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b17e1b-228a-43e1-868e-b57014a91253 service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:15.339488 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1207/2398] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:42:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:25.241147 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=55,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:25.334838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=64,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:39.865208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890fbbb-4337-4498-89d9-aa1b267ac597 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:39.865722 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890fbbb-4337-4498-89d9-aa1b267ac597 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:39.865817 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890fbbb-4337-4498-89d9-aa1b267ac597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:39.884206 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-e890fbbb-4337-4498-89d9-aa1b267ac597 None None] MFA Rules not processed for user `b857644c1450464b8132b85271368aad`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:39.885400 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e890fbbb-4337-4498-89d9-aa1b267ac597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:39.892351 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1192/2399] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:42:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:42:49.877802 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:51.991080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac142c-5dbf-4627-90a0-6d77804a456d None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:51.991613 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac142c-5dbf-4627-90a0-6d77804a456d None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:51.991716 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac142c-5dbf-4627-90a0-6d77804a456d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:52.038717 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-8eac142c-5dbf-4627-90a0-6d77804a456d None None] MFA Rules not processed for user `f52f0a03cc0f494d82a091bd885478e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:52.040000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-8eac142c-5dbf-4627-90a0-6d77804a456d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:52.105912 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1208/2400] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 09:42:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:52.153112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890fbbb-4337-4498-89d9-aa1b267ac597 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:52.157406 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e890fbbb-4337-4498-89d9-aa1b267ac597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:52.266511 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890fbbb-4337-4498-89d9-aa1b267ac597 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:52.271515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030c2fe-d021-497b-b3b4-51bb1d9884bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '351f74222d394f39bda0663e0e4ebde6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:52.272158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030c2fe-d021-497b-b3b4-51bb1d9884bf service swift] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:52.272439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030c2fe-d021-497b-b3b4-51bb1d9884bf service swift] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:52.272716 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030c2fe-d021-497b-b3b4-51bb1d9884bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:52.281768 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030c2fe-d021-497b-b3b4-51bb1d9884bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:52.283544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030c2fe-d021-497b-b3b4-51bb1d9884bf service swift] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:52.291719 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1193/2401] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 09:42:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:42:55.534316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac142c-5dbf-4627-90a0-6d77804a456d None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:55.536389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-8eac142c-5dbf-4627-90a0-6d77804a456d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:55.614080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac142c-5dbf-4627-90a0-6d77804a456d None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:55.618695 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5aa4eb-d0a2-4bcc-8117-90c6f7f5f667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:55.619609 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5aa4eb-d0a2-4bcc-8117-90c6f7f5f667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:55.619897 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5aa4eb-d0a2-4bcc-8117-90c6f7f5f667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:55.620291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5aa4eb-d0a2-4bcc-8117-90c6f7f5f667 admin admin] PATH_INFO: `/v3/users/3675aa8190aa4ed780f340ddfa308dc0` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:55.621529 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5aa4eb-d0a2-4bcc-8117-90c6f7f5f667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3675aa8190aa4ed780f340ddfa308dc0)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:55.623522 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5aa4eb-d0a2-4bcc-8117-90c6f7f5f667 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:55.676615 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ef5aa4eb-d0a2-4bcc-8117-90c6f7f5f667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3675aa8190aa4ed780f340ddfa308dc0'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:55.677292 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ef5aa4eb-d0a2-4bcc-8117-90c6f7f5f667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3675aa8190aa4ed780f340ddfa308dc0'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:55.684662 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ef5aa4eb-d0a2-4bcc-8117-90c6f7f5f667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3675aa8190aa4ed780f340ddfa308dc0'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:55.685378 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ef5aa4eb-d0a2-4bcc-8117-90c6f7f5f667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3675aa8190aa4ed780f340ddfa308dc0'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:55.699792 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ef5aa4eb-d0a2-4bcc-8117-90c6f7f5f667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3675aa8190aa4ed780f340ddfa308dc0'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:55.701464 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:55.717624 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1209/2402] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:42:55 2022] DELETE /identity/v3/users/3675aa8190aa4ed780f340ddfa308dc0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:55.722548 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38995a1b-83bb-4954-8e56-f7b97b94bfa9 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:55.723653 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38995a1b-83bb-4954-8e56-f7b97b94bfa9 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:55.723739 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38995a1b-83bb-4954-8e56-f7b97b94bfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:55.742869 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-38995a1b-83bb-4954-8e56-f7b97b94bfa9 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:55.744127 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-38995a1b-83bb-4954-8e56-f7b97b94bfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:55.814302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1194/2403] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:55.821785 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5aa4eb-d0a2-4bcc-8117-90c6f7f5f667 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:55.823341 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-ef5aa4eb-d0a2-4bcc-8117-90c6f7f5f667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:55.910632 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5aa4eb-d0a2-4bcc-8117-90c6f7f5f667 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:55.914386 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385dd78f-3303-45be-b5a5-978fc648757a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:55.915267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385dd78f-3303-45be-b5a5-978fc648757a service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:55.915614 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385dd78f-3303-45be-b5a5-978fc648757a service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:55.915898 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385dd78f-3303-45be-b5a5-978fc648757a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:55.928644 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385dd78f-3303-45be-b5a5-978fc648757a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:55.930341 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385dd78f-3303-45be-b5a5-978fc648757a service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:55.945602 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1210/2404] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:42:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:42:56.397439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38995a1b-83bb-4954-8e56-f7b97b94bfa9 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:56.399009 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-38995a1b-83bb-4954-8e56-f7b97b94bfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:56.416365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38995a1b-83bb-4954-8e56-f7b97b94bfa9 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:56.426670 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1685756-d574-4516-9262-e8502b1b736d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:56.428592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1685756-d574-4516-9262-e8502b1b736d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:56.429275 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1685756-d574-4516-9262-e8502b1b736d admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:56.429961 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1685756-d574-4516-9262-e8502b1b736d admin admin] PATH_INFO: `/v3/projects/eb742ed888294ccfba81cb742c53669b` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:56.431591 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1685756-d574-4516-9262-e8502b1b736d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb742ed888294ccfba81cb742c53669b)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:56.433946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1685756-d574-4516-9262-e8502b1b736d admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:56.531368 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-d1685756-d574-4516-9262-e8502b1b736d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb742ed888294ccfba81cb742c53669b', 'request_id': 'req-d1685756-d574-4516-9262-e8502b1b736d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:56.541875 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-d1685756-d574-4516-9262-e8502b1b736d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb742ed888294ccfba81cb742c53669b', 'request_id': 'req-d1685756-d574-4516-9262-e8502b1b736d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:56.549300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-d1685756-d574-4516-9262-e8502b1b736d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb742ed888294ccfba81cb742c53669b', 'request_id': 'req-d1685756-d574-4516-9262-e8502b1b736d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:56.557390 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:56.569308 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-d1685756-d574-4516-9262-e8502b1b736d admin admin] The token cache is being invalidate because project eb742ed888294ccfba81cb742c53669b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:42:56.570732 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-d1685756-d574-4516-9262-e8502b1b736d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:56.572326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-d1685756-d574-4516-9262-e8502b1b736d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:42:56.575268 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1195/2405] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:42:56 2022] DELETE /identity/v3/projects/eb742ed888294ccfba81cb742c53669b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:42:56.581345 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d214704-d6f7-4d25-bad0-b5aa0b3e3f6a None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:56.582342 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d214704-d6f7-4d25-bad0-b5aa0b3e3f6a None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:56.582788 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d214704-d6f7-4d25-bad0-b5aa0b3e3f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:56.620709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-6d214704-d6f7-4d25-bad0-b5aa0b3e3f6a None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:56.622140 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-6d214704-d6f7-4d25-bad0-b5aa0b3e3f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:56.703992 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1211/2406] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:56.712354 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c5f53-a5a6-4d0e-873b-599032de6cd0 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:56.712722 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c5f53-a5a6-4d0e-873b-599032de6cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:56.712952 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c5f53-a5a6-4d0e-873b-599032de6cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:56.735600 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-a16c5f53-a5a6-4d0e-873b-599032de6cd0 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:56.737058 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-a16c5f53-a5a6-4d0e-873b-599032de6cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:56.745698 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1196/2407] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:42:56.750197 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d214704-d6f7-4d25-bad0-b5aa0b3e3f6a None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:56.761087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d214704-d6f7-4d25-bad0-b5aa0b3e3f6a None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:56.766513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a16161-5b89-489a-9981-2a19178e28c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:56.767410 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a16161-5b89-489a-9981-2a19178e28c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:56.767846 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a16161-5b89-489a-9981-2a19178e28c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:56.768268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a16161-5b89-489a-9981-2a19178e28c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:56.769166 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a16161-5b89-489a-9981-2a19178e28c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:42:56.770174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a16161-5b89-489a-9981-2a19178e28c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:56.771812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a16161-5b89-489a-9981-2a19178e28c9 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:56.787698 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1212/2408] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:42:56.788892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c5f53-a5a6-4d0e-873b-599032de6cd0 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:56.801928 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c5f53-a5a6-4d0e-873b-599032de6cd0 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:56.807175 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5ca96-9357-410a-94dc-93542de04346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:56.807870 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5ca96-9357-410a-94dc-93542de04346 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:56.808152 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5ca96-9357-410a-94dc-93542de04346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:56.808428 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5ca96-9357-410a-94dc-93542de04346 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:56.809113 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5ca96-9357-410a-94dc-93542de04346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:56.811019 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5ca96-9357-410a-94dc-93542de04346 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:56.843322 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1197/2409] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:42:56 2022] POST /identity/v3/projects => generated 399 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:56.848832 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a16161-5b89-489a-9981-2a19178e28c9 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:56.860940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a16161-5b89-489a-9981-2a19178e28c9 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:56.978307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ae9a6-ad3a-4a7e-84c2-968cfce8dbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:56.979364 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ae9a6-ad3a-4a7e-84c2-968cfce8dbbd admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:56.979792 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ae9a6-ad3a-4a7e-84c2-968cfce8dbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:56.980245 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ae9a6-ad3a-4a7e-84c2-968cfce8dbbd admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:56.981030 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ae9a6-ad3a-4a7e-84c2-968cfce8dbbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:56.983601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ae9a6-ad3a-4a7e-84c2-968cfce8dbbd admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:57.015324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1213/2410] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:42:56 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:42:57.018925 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5ca96-9357-410a-94dc-93542de04346 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:57.039449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5ca96-9357-410a-94dc-93542de04346 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:57.049163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae439c4-afc8-4cc5-beab-4dd67d126289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:57.049994 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae439c4-afc8-4cc5-beab-4dd67d126289 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:57.050397 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae439c4-afc8-4cc5-beab-4dd67d126289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:57.051120 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae439c4-afc8-4cc5-beab-4dd67d126289 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:57.051843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae439c4-afc8-4cc5-beab-4dd67d126289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:57.053796 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae439c4-afc8-4cc5-beab-4dd67d126289 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:57.067711 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1198/2411] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:57.071457 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ae9a6-ad3a-4a7e-84c2-968cfce8dbbd admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:57.084172 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ae9a6-ad3a-4a7e-84c2-968cfce8dbbd admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:57.089926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e881c2-7bf5-4714-a0e4-f7c00e6bbe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:57.090877 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e881c2-7bf5-4714-a0e4-f7c00e6bbe99 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:57.091323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e881c2-7bf5-4714-a0e4-f7c00e6bbe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:57.091653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e881c2-7bf5-4714-a0e4-f7c00e6bbe99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:57.092658 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e881c2-7bf5-4714-a0e4-f7c00e6bbe99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:57.095310 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e881c2-7bf5-4714-a0e4-f7c00e6bbe99 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:57.104114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:57.115498 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1214/2412] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:42:57.119703 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae439c4-afc8-4cc5-beab-4dd67d126289 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:57.131589 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae439c4-afc8-4cc5-beab-4dd67d126289 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:57.136817 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01707ba4-3135-491a-bc15-90c0e657ac27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:57.137708 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01707ba4-3135-491a-bc15-90c0e657ac27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:57.138118 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01707ba4-3135-491a-bc15-90c0e657ac27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:57.138396 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01707ba4-3135-491a-bc15-90c0e657ac27 admin admin] PATH_INFO: `/v3/projects/bde96f43cfff4c13a50955b2967f72e7/users/44416385e19c49e79e169b33a444cc68/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:57.157710 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01707ba4-3135-491a-bc15-90c0e657ac27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bde96f43cfff4c13a50955b2967f72e7, user_id=44416385e19c49e79e169b33a444cc68, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:57.161541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01707ba4-3135-491a-bc15-90c0e657ac27 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:57.187339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1199/2413] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:42:57 2022] PUT /identity/v3/projects/bde96f43cfff4c13a50955b2967f72e7/users/44416385e19c49e79e169b33a444cc68/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:42:57.197659 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fc532-1704-4c09-ac55-6685461db38c None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:57.197943 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fc532-1704-4c09-ac55-6685461db38c None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:57.198221 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fc532-1704-4c09-ac55-6685461db38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:57.228588 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-df5fc532-1704-4c09-ac55-6685461db38c None None] MFA Rules not processed for user `44416385e19c49e79e169b33a444cc68`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:42:57.229836 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-df5fc532-1704-4c09-ac55-6685461db38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:57.306678 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1215/2414] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:42:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:42:57.317915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01707ba4-3135-491a-bc15-90c0e657ac27 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:42:57.326619 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-01707ba4-3135-491a-bc15-90c0e657ac27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:42:57.489988 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01707ba4-3135-491a-bc15-90c0e657ac27 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:42:57.518486 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92b49a-5e25-4262-9ba7-b6dc2bfe807a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:42:57.519169 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92b49a-5e25-4262-9ba7-b6dc2bfe807a service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:42:57.520045 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92b49a-5e25-4262-9ba7-b6dc2bfe807a service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:42:57.520473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92b49a-5e25-4262-9ba7-b6dc2bfe807a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:42:57.533646 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92b49a-5e25-4262-9ba7-b6dc2bfe807a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:42:57.535821 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92b49a-5e25-4262-9ba7-b6dc2bfe807a service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:42:57.549970 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1200/2415] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:42:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:07.302726 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=32 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:07.544278 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:DELETE=1,keystone:SELECT=55,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:10.174532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fc532-1704-4c09-ac55-6685461db38c None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:10.237679 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fc532-1704-4c09-ac55-6685461db38c None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:10.242775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a31367-f4ed-47e2-a882-25b442be3d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:10.243803 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a31367-f4ed-47e2-a882-25b442be3d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:10.244089 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a31367-f4ed-47e2-a882-25b442be3d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:10.244366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a31367-f4ed-47e2-a882-25b442be3d55 admin admin] PATH_INFO: `/v3/users/44416385e19c49e79e169b33a444cc68` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:10.245552 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a31367-f4ed-47e2-a882-25b442be3d55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44416385e19c49e79e169b33a444cc68)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:10.247523 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a31367-f4ed-47e2-a882-25b442be3d55 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:10.291934 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e7a31367-f4ed-47e2-a882-25b442be3d55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44416385e19c49e79e169b33a444cc68'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.292580 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e7a31367-f4ed-47e2-a882-25b442be3d55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44416385e19c49e79e169b33a444cc68'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.299961 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e7a31367-f4ed-47e2-a882-25b442be3d55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44416385e19c49e79e169b33a444cc68'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.301174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e7a31367-f4ed-47e2-a882-25b442be3d55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44416385e19c49e79e169b33a444cc68'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.313650 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e7a31367-f4ed-47e2-a882-25b442be3d55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44416385e19c49e79e169b33a444cc68'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:10.330062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1216/2416] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:43:10 2022] DELETE /identity/v3/users/44416385e19c49e79e169b33a444cc68 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:10.335250 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b90e08-aa0d-4d1c-915e-6010d29b8221 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:10.335817 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b90e08-aa0d-4d1c-915e-6010d29b8221 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:10.335920 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b90e08-aa0d-4d1c-915e-6010d29b8221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:10.352902 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-b8b90e08-aa0d-4d1c-915e-6010d29b8221 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:10.354096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-b8b90e08-aa0d-4d1c-915e-6010d29b8221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:10.432623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1201/2417] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:43:10.442317 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a31367-f4ed-47e2-a882-25b442be3d55 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:10.443854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-e7a31367-f4ed-47e2-a882-25b442be3d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:10.502202 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a31367-f4ed-47e2-a882-25b442be3d55 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:10.506584 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c8d40-1fa4-44ef-aa82-087fafb6d8e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:10.507237 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c8d40-1fa4-44ef-aa82-087fafb6d8e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:10.507549 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c8d40-1fa4-44ef-aa82-087fafb6d8e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:10.507828 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c8d40-1fa4-44ef-aa82-087fafb6d8e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:10.517342 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c8d40-1fa4-44ef-aa82-087fafb6d8e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:10.518779 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c8d40-1fa4-44ef-aa82-087fafb6d8e7 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:10.528871 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1217/2418] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:10.866013 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3416b52-46ef-450d-ba48-f5a18a559be0 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:10.866317 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3416b52-46ef-450d-ba48-f5a18a559be0 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:10.866602 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3416b52-46ef-450d-ba48-f5a18a559be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:10.889327 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-e3416b52-46ef-450d-ba48-f5a18a559be0 None None] MFA Rules not processed for user `f52f0a03cc0f494d82a091bd885478e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:10.890611 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e3416b52-46ef-450d-ba48-f5a18a559be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:10.903367 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c8d40-1fa4-44ef-aa82-087fafb6d8e7 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:10.905098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-8a1c8d40-1fa4-44ef-aa82-087fafb6d8e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:10.919438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c8d40-1fa4-44ef-aa82-087fafb6d8e7 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:10.927700 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482f319-6221-45f7-94cf-cf2f5b07e089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:10.929107 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482f319-6221-45f7-94cf-cf2f5b07e089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:10.929828 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482f319-6221-45f7-94cf-cf2f5b07e089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:10.930239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482f319-6221-45f7-94cf-cf2f5b07e089 admin admin] PATH_INFO: `/v3/projects/bde96f43cfff4c13a50955b2967f72e7` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:10.931795 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482f319-6221-45f7-94cf-cf2f5b07e089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bde96f43cfff4c13a50955b2967f72e7)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:10.935425 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482f319-6221-45f7-94cf-cf2f5b07e089 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:10.964036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:10.980840 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1202/2419] 10.222.0.41 () {58 vars in 967 bytes} [Fri May 27 09:43:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:10.995064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3416b52-46ef-450d-ba48-f5a18a559be0 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:10.996479 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e3416b52-46ef-450d-ba48-f5a18a559be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:11.006307 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4482f319-6221-45f7-94cf-cf2f5b07e089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bde96f43cfff4c13a50955b2967f72e7', 'request_id': 'req-4482f319-6221-45f7-94cf-cf2f5b07e089'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:11.015928 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4482f319-6221-45f7-94cf-cf2f5b07e089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bde96f43cfff4c13a50955b2967f72e7', 'request_id': 'req-4482f319-6221-45f7-94cf-cf2f5b07e089'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:11.022356 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4482f319-6221-45f7-94cf-cf2f5b07e089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bde96f43cfff4c13a50955b2967f72e7', 'request_id': 'req-4482f319-6221-45f7-94cf-cf2f5b07e089'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:11.033830 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4482f319-6221-45f7-94cf-cf2f5b07e089 admin admin] The token cache is being invalidate because project bde96f43cfff4c13a50955b2967f72e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:43:11.034281 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4482f319-6221-45f7-94cf-cf2f5b07e089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:11.035658 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4482f319-6221-45f7-94cf-cf2f5b07e089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:11.039873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1218/2420] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:43:10 2022] DELETE /identity/v3/projects/bde96f43cfff4c13a50955b2967f72e7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:11.080285 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3416b52-46ef-450d-ba48-f5a18a559be0 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:11.145059 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:11.165738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4398be-34c3-4fd0-893d-b12231b46fb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '351f74222d394f39bda0663e0e4ebde6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:11.166427 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4398be-34c3-4fd0-893d-b12231b46fb4 service swift] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:11.166718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4398be-34c3-4fd0-893d-b12231b46fb4 service swift] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:11.167000 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4398be-34c3-4fd0-893d-b12231b46fb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:11.169795 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-ed4398be-34c3-4fd0-893d-b12231b46fb4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:11.237695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4398be-34c3-4fd0-893d-b12231b46fb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:11.239320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4398be-34c3-4fd0-893d-b12231b46fb4 service swift] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:11.248662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1203/2421] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 09:43:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 09:43:13.244437 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482f319-6221-45f7-94cf-cf2f5b07e089 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:13.245985 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-4482f319-6221-45f7-94cf-cf2f5b07e089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:13.319478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482f319-6221-45f7-94cf-cf2f5b07e089 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:13.324026 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec52e1-cafc-4290-b31d-a5940e952123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:13.325044 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec52e1-cafc-4290-b31d-a5940e952123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:13.325331 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec52e1-cafc-4290-b31d-a5940e952123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:13.325632 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec52e1-cafc-4290-b31d-a5940e952123 admin admin] PATH_INFO: `/v3/users/b35535c6b1c74a0baf58c8ccdbf30772` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:13.326882 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec52e1-cafc-4290-b31d-a5940e952123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b35535c6b1c74a0baf58c8ccdbf30772)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:13.328863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec52e1-cafc-4290-b31d-a5940e952123 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:13.380201 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-73ec52e1-cafc-4290-b31d-a5940e952123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b35535c6b1c74a0baf58c8ccdbf30772'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:13.380851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-73ec52e1-cafc-4290-b31d-a5940e952123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b35535c6b1c74a0baf58c8ccdbf30772'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:13.387827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-73ec52e1-cafc-4290-b31d-a5940e952123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b35535c6b1c74a0baf58c8ccdbf30772'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:13.388448 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-73ec52e1-cafc-4290-b31d-a5940e952123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b35535c6b1c74a0baf58c8ccdbf30772'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:13.401383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-73ec52e1-cafc-4290-b31d-a5940e952123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b35535c6b1c74a0baf58c8ccdbf30772'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:13.417971 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1219/2422] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:43:13 2022] DELETE /identity/v3/users/b35535c6b1c74a0baf58c8ccdbf30772 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:13.464764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4398be-34c3-4fd0-893d-b12231b46fb4 service swift] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:13.466135 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-ed4398be-34c3-4fd0-893d-b12231b46fb4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:13.524252 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4398be-34c3-4fd0-893d-b12231b46fb4 service swift] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:13.589301 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79f3d3-1c02-4bd1-ac22-6a5652711afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:13.590134 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79f3d3-1c02-4bd1-ac22-6a5652711afe service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:13.590420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79f3d3-1c02-4bd1-ac22-6a5652711afe service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:13.590697 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79f3d3-1c02-4bd1-ac22-6a5652711afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:13.592504 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-be79f3d3-1c02-4bd1-ac22-6a5652711afe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:13.606591 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec52e1-cafc-4290-b31d-a5940e952123 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:13.608146 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-73ec52e1-cafc-4290-b31d-a5940e952123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:13.642214 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:13.664722 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:13.667887 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79f3d3-1c02-4bd1-ac22-6a5652711afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:13.669857 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79f3d3-1c02-4bd1-ac22-6a5652711afe service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:13.680365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1204/2423] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:43:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:13.684575 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec52e1-cafc-4290-b31d-a5940e952123 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:13.689147 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d845f-51f0-4c27-9fbd-064e97ac3794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:13.690015 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d845f-51f0-4c27-9fbd-064e97ac3794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:13.690297 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d845f-51f0-4c27-9fbd-064e97ac3794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:13.690574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d845f-51f0-4c27-9fbd-064e97ac3794 admin admin] PATH_INFO: `/v3/projects/4b17fac30e6a469a8e0ca8b6e2fcdc1d` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:13.691874 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d845f-51f0-4c27-9fbd-064e97ac3794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b17fac30e6a469a8e0ca8b6e2fcdc1d)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:13.693806 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d845f-51f0-4c27-9fbd-064e97ac3794 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:13.743132 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ad0d845f-51f0-4c27-9fbd-064e97ac3794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'request_id': 'req-ad0d845f-51f0-4c27-9fbd-064e97ac3794'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:13.750290 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ad0d845f-51f0-4c27-9fbd-064e97ac3794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'request_id': 'req-ad0d845f-51f0-4c27-9fbd-064e97ac3794'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:13.756086 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ad0d845f-51f0-4c27-9fbd-064e97ac3794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'request_id': 'req-ad0d845f-51f0-4c27-9fbd-064e97ac3794'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:13.766993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ad0d845f-51f0-4c27-9fbd-064e97ac3794 admin admin] The token cache is being invalidate because project 4b17fac30e6a469a8e0ca8b6e2fcdc1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:43:13.767293 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ad0d845f-51f0-4c27-9fbd-064e97ac3794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:13.767942 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ad0d845f-51f0-4c27-9fbd-064e97ac3794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:13.771357 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1220/2424] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:43:13 2022] DELETE /identity/v3/projects/4b17fac30e6a469a8e0ca8b6e2fcdc1d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:18.257058 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c06d2-3c50-4ce9-b55c-67458bb275ea None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:18.257572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c06d2-3c50-4ce9-b55c-67458bb275ea None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:18.258115 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c06d2-3c50-4ce9-b55c-67458bb275ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:18.276575 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-518c06d2-3c50-4ce9-b55c-67458bb275ea None None] MFA Rules not processed for user `f52f0a03cc0f494d82a091bd885478e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:18.278816 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-518c06d2-3c50-4ce9-b55c-67458bb275ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:18.340873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1205/2425] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 09:43:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:18.354096 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d845f-51f0-4c27-9fbd-064e97ac3794 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:18.356077 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-ad0d845f-51f0-4c27-9fbd-064e97ac3794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:18.429622 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d845f-51f0-4c27-9fbd-064e97ac3794 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:18.435321 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce79186-089c-4df6-996a-46bd6c059fec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '351f74222d394f39bda0663e0e4ebde6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:18.435995 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce79186-089c-4df6-996a-46bd6c059fec service swift] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:18.436283 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce79186-089c-4df6-996a-46bd6c059fec service swift] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:18.436565 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce79186-089c-4df6-996a-46bd6c059fec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:18.445636 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce79186-089c-4df6-996a-46bd6c059fec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:18.447186 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce79186-089c-4df6-996a-46bd6c059fec service swift] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:18.455965 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1221/2426] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 09:43:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:43:19.120721 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b58487-2f86-4b4b-967e-376818b76c06 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:19.121244 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b58487-2f86-4b4b-967e-376818b76c06 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:19.121478 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b58487-2f86-4b4b-967e-376818b76c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:19.139633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-84b58487-2f86-4b4b-967e-376818b76c06 None None] MFA Rules not processed for user `f52f0a03cc0f494d82a091bd885478e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:19.140938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-84b58487-2f86-4b4b-967e-376818b76c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:19.148893 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1206/2427] 10.222.0.41 () {58 vars in 967 bytes} [Fri May 27 09:43:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:19.165798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce79186-089c-4df6-996a-46bd6c059fec service swift] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:19.178963 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce79186-089c-4df6-996a-46bd6c059fec service swift] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:19.186368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14397df-93f1-41e3-baf7-affa540712ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '351f74222d394f39bda0663e0e4ebde6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:19.187016 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14397df-93f1-41e3-baf7-affa540712ad service swift] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:19.187344 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14397df-93f1-41e3-baf7-affa540712ad service swift] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:19.187797 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14397df-93f1-41e3-baf7-affa540712ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:19.199476 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14397df-93f1-41e3-baf7-affa540712ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:19.201184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14397df-93f1-41e3-baf7-affa540712ad service swift] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:19.211923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1222/2428] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 09:43:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:43:19.443637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697eebf-53e3-43a3-8ffe-45794c232718 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:19.444103 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697eebf-53e3-43a3-8ffe-45794c232718 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:19.444197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697eebf-53e3-43a3-8ffe-45794c232718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:19.461989 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-5697eebf-53e3-43a3-8ffe-45794c232718 None None] MFA Rules not processed for user `f52f0a03cc0f494d82a091bd885478e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:19.463163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-5697eebf-53e3-43a3-8ffe-45794c232718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:19.470430 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1207/2429] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 09:43:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:19.482267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14397df-93f1-41e3-baf7-affa540712ad service swift] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:19.492653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14397df-93f1-41e3-baf7-affa540712ad service swift] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:19.497597 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29a2a1-d874-43c9-848f-3e0b776c5a15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '351f74222d394f39bda0663e0e4ebde6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:19.498231 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29a2a1-d874-43c9-848f-3e0b776c5a15 service swift] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:19.498513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29a2a1-d874-43c9-848f-3e0b776c5a15 service swift] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:19.498789 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29a2a1-d874-43c9-848f-3e0b776c5a15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:19.506824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29a2a1-d874-43c9-848f-3e0b776c5a15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:19.508434 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29a2a1-d874-43c9-848f-3e0b776c5a15 service swift] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:19.516413 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1223/2430] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 09:43:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:43:19.830929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d531b-3ed4-4b9f-960f-4c78b11e3c0c None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:19.831218 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d531b-3ed4-4b9f-960f-4c78b11e3c0c None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:19.831523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d531b-3ed4-4b9f-960f-4c78b11e3c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:19.850455 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-2b5d531b-3ed4-4b9f-960f-4c78b11e3c0c None None] MFA Rules not processed for user `f52f0a03cc0f494d82a091bd885478e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:19.851691 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-2b5d531b-3ed4-4b9f-960f-4c78b11e3c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:19.858668 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1208/2431] 10.222.0.41 () {58 vars in 967 bytes} [Fri May 27 09:43:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:19.870691 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29a2a1-d874-43c9-848f-3e0b776c5a15 service swift] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:19.881796 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29a2a1-d874-43c9-848f-3e0b776c5a15 service swift] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:19.886943 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91e7cb-d617-44ce-85c1-9093dfb7fc38 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '351f74222d394f39bda0663e0e4ebde6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:19.887619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91e7cb-d617-44ce-85c1-9093dfb7fc38 service swift] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:19.888073 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91e7cb-d617-44ce-85c1-9093dfb7fc38 service swift] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:19.888354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91e7cb-d617-44ce-85c1-9093dfb7fc38 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:19.897715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91e7cb-d617-44ce-85c1-9093dfb7fc38 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:19.899423 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91e7cb-d617-44ce-85c1-9093dfb7fc38 service swift] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:19.907965 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1224/2432] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 09:43:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:43:25.074045 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d531b-3ed4-4b9f-960f-4c78b11e3c0c None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:25.075448 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-2b5d531b-3ed4-4b9f-960f-4c78b11e3c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:25.139005 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d531b-3ed4-4b9f-960f-4c78b11e3c0c None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:25.143447 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1e5fc-2c6d-4284-b708-546645656761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:25.144326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1e5fc-2c6d-4284-b708-546645656761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:25.144609 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1e5fc-2c6d-4284-b708-546645656761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:25.144881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1e5fc-2c6d-4284-b708-546645656761 admin admin] PATH_INFO: `/v3/users/b857644c1450464b8132b85271368aad` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:25.146061 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1e5fc-2c6d-4284-b708-546645656761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b857644c1450464b8132b85271368aad)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:25.148000 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1e5fc-2c6d-4284-b708-546645656761 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:25.192489 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-8ea1e5fc-2c6d-4284-b708-546645656761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b857644c1450464b8132b85271368aad'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:25.199115 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-8ea1e5fc-2c6d-4284-b708-546645656761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b857644c1450464b8132b85271368aad'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:25.199785 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-8ea1e5fc-2c6d-4284-b708-546645656761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b857644c1450464b8132b85271368aad'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:25.211221 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-8ea1e5fc-2c6d-4284-b708-546645656761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b857644c1450464b8132b85271368aad'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:25.221178 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-8ea1e5fc-2c6d-4284-b708-546645656761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b857644c1450464b8132b85271368aad'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:25.223766 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:25.228867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1209/2433] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:43:25 2022] DELETE /identity/v3/users/b857644c1450464b8132b85271368aad => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:25.233588 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86571c66-1cb0-4e7f-acef-f4e427b8999a None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:25.234097 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86571c66-1cb0-4e7f-acef-f4e427b8999a None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:25.234196 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86571c66-1cb0-4e7f-acef-f4e427b8999a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:25.241541 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:25.252993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-86571c66-1cb0-4e7f-acef-f4e427b8999a None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:25.254203 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-86571c66-1cb0-4e7f-acef-f4e427b8999a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:25.310515 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1225/2434] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:25.319968 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1e5fc-2c6d-4284-b708-546645656761 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:25.321399 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-8ea1e5fc-2c6d-4284-b708-546645656761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:25.379566 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1e5fc-2c6d-4284-b708-546645656761 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:25.383405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb4a08-71dd-48f2-9094-7911b438c9ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:25.384053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb4a08-71dd-48f2-9094-7911b438c9ed service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:25.384335 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb4a08-71dd-48f2-9094-7911b438c9ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:25.384609 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb4a08-71dd-48f2-9094-7911b438c9ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:25.393716 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb4a08-71dd-48f2-9094-7911b438c9ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:25.395666 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb4a08-71dd-48f2-9094-7911b438c9ed service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:25.404871 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1210/2435] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:43:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:25.564870 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86571c66-1cb0-4e7f-acef-f4e427b8999a None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:25.566415 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-86571c66-1cb0-4e7f-acef-f4e427b8999a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:25.579729 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86571c66-1cb0-4e7f-acef-f4e427b8999a None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:25.585597 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d777d-c513-4ac0-a45e-8007bcfcd130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:25.586691 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d777d-c513-4ac0-a45e-8007bcfcd130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:25.586940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d777d-c513-4ac0-a45e-8007bcfcd130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:25.587215 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d777d-c513-4ac0-a45e-8007bcfcd130 admin admin] PATH_INFO: `/v3/projects/d51656e5a4ab48a98dad3b48f3b550d9` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:25.588434 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d777d-c513-4ac0-a45e-8007bcfcd130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d51656e5a4ab48a98dad3b48f3b550d9)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:25.590341 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d777d-c513-4ac0-a45e-8007bcfcd130 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:25.637786 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-d37d777d-c513-4ac0-a45e-8007bcfcd130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51656e5a4ab48a98dad3b48f3b550d9', 'request_id': 'req-d37d777d-c513-4ac0-a45e-8007bcfcd130'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:25.648268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-d37d777d-c513-4ac0-a45e-8007bcfcd130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51656e5a4ab48a98dad3b48f3b550d9', 'request_id': 'req-d37d777d-c513-4ac0-a45e-8007bcfcd130'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:25.659203 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-d37d777d-c513-4ac0-a45e-8007bcfcd130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51656e5a4ab48a98dad3b48f3b550d9', 'request_id': 'req-d37d777d-c513-4ac0-a45e-8007bcfcd130'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:25.670132 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-d37d777d-c513-4ac0-a45e-8007bcfcd130 admin admin] The token cache is being invalidate because project d51656e5a4ab48a98dad3b48f3b550d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:43:25.670420 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-d37d777d-c513-4ac0-a45e-8007bcfcd130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:25.671060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-d37d777d-c513-4ac0-a45e-8007bcfcd130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:43:25.672610 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1226/2436] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:43:25 2022] DELETE /identity/v3/projects/d51656e5a4ab48a98dad3b48f3b550d9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:43:31.049006 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6103fc-dd5b-40cf-97ec-df7ca21436ff None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:31.049473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6103fc-dd5b-40cf-97ec-df7ca21436ff None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:31.049567 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6103fc-dd5b-40cf-97ec-df7ca21436ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:31.072695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-af6103fc-dd5b-40cf-97ec-df7ca21436ff None None] MFA Rules not processed for user `52e6eb075ba742e68bab4ab79eb37e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:43:31.073935 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-af6103fc-dd5b-40cf-97ec-df7ca21436ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:31.147878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1211/2437] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:43:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:43:35.667153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:41.141294 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=51 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:49.802866 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d777d-c513-4ac0-a45e-8007bcfcd130 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:49.804402 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d37d777d-c513-4ac0-a45e-8007bcfcd130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:49.862653 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d777d-c513-4ac0-a45e-8007bcfcd130 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:49.866894 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290ca7a-3889-4cf9-ae04-dcf8652437c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:49.867624 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290ca7a-3889-4cf9-ae04-dcf8652437c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:49.867910 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290ca7a-3889-4cf9-ae04-dcf8652437c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:49.868212 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290ca7a-3889-4cf9-ae04-dcf8652437c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:49.869968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-c290ca7a-3889-4cf9-ae04-dcf8652437c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:49.950175 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290ca7a-3889-4cf9-ae04-dcf8652437c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:49.951656 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290ca7a-3889-4cf9-ae04-dcf8652437c8 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:49.980439 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1227/2438] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:43:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:51.082651 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6103fc-dd5b-40cf-97ec-df7ca21436ff None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:43:51.084066 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-af6103fc-dd5b-40cf-97ec-df7ca21436ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:51.142180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6103fc-dd5b-40cf-97ec-df7ca21436ff None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:43:51.145725 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76264870-29f2-4501-b64d-e1aac2265f1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:43:51.146368 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76264870-29f2-4501-b64d-e1aac2265f1b service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:43:51.146649 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76264870-29f2-4501-b64d-e1aac2265f1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:43:51.146917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76264870-29f2-4501-b64d-e1aac2265f1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:43:51.149257 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-76264870-29f2-4501-b64d-e1aac2265f1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:43:51.163153 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76264870-29f2-4501-b64d-e1aac2265f1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:43:51.164641 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76264870-29f2-4501-b64d-e1aac2265f1b service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:43:51.175638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1212/2439] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:43:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:43:59.970142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=63 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:01.170629 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=26 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:06.313891 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290ca7a-3889-4cf9-ae04-dcf8652437c8 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:06.315498 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-c290ca7a-3889-4cf9-ae04-dcf8652437c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:06.329248 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290ca7a-3889-4cf9-ae04-dcf8652437c8 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:06.336294 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1252dc7-24ef-4875-9f5b-8fce8332df64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:06.338075 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1252dc7-24ef-4875-9f5b-8fce8332df64 service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:06.339995 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1252dc7-24ef-4875-9f5b-8fce8332df64 service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:06.340540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1252dc7-24ef-4875-9f5b-8fce8332df64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:06.342897 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-b1252dc7-24ef-4875-9f5b-8fce8332df64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:06.417516 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1252dc7-24ef-4875-9f5b-8fce8332df64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:06.419169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1252dc7-24ef-4875-9f5b-8fce8332df64 service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:06.438673 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1228/2440] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:44:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:44:06.988452 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76264870-29f2-4501-b64d-e1aac2265f1b service cinder] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:06.997839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76264870-29f2-4501-b64d-e1aac2265f1b service cinder] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:07.001403 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d549a-acd8-4c3a-947c-48fb2f934ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:07.002037 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d549a-acd8-4c3a-947c-48fb2f934ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:07.002319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d549a-acd8-4c3a-947c-48fb2f934ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:07.002596 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d549a-acd8-4c3a-947c-48fb2f934ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:07.004355 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-be5d549a-acd8-4c3a-947c-48fb2f934ba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:07.014240 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d549a-acd8-4c3a-947c-48fb2f934ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:07.015686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d549a-acd8-4c3a-947c-48fb2f934ba6 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:07.023510 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1213/2441] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:44:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:44:10.401039 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1252dc7-24ef-4875-9f5b-8fce8332df64 service nova] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:10.402559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-b1252dc7-24ef-4875-9f5b-8fce8332df64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:10.423087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1252dc7-24ef-4875-9f5b-8fce8332df64 service nova] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:10.431085 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53777a67-3762-471e-a7bb-ed416eb867ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:10.432379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53777a67-3762-471e-a7bb-ed416eb867ea service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:10.432665 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53777a67-3762-471e-a7bb-ed416eb867ea service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:10.432942 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53777a67-3762-471e-a7bb-ed416eb867ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:10.435010 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-53777a67-3762-471e-a7bb-ed416eb867ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:10.501058 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53777a67-3762-471e-a7bb-ed416eb867ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:10.502678 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53777a67-3762-471e-a7bb-ed416eb867ea service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:10.512255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1229/2442] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:44:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:44:17.019958 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=6 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:17.215304 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d549a-acd8-4c3a-947c-48fb2f934ba6 service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:17.229652 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d549a-acd8-4c3a-947c-48fb2f934ba6 service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:17.235087 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4456a-8665-41c4-9a3d-bbf5245b990f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:17.235759 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4456a-8665-41c4-9a3d-bbf5245b990f service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:17.236045 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4456a-8665-41c4-9a3d-bbf5245b990f service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:17.236319 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4456a-8665-41c4-9a3d-bbf5245b990f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:17.238063 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-67d4456a-8665-41c4-9a3d-bbf5245b990f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:17.250022 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4456a-8665-41c4-9a3d-bbf5245b990f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:17.251646 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4456a-8665-41c4-9a3d-bbf5245b990f service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:17.263262 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1214/2443] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:44:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:44:19.303738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654c41a-542e-4e1c-8948-26e683f11fdc None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:19.304237 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654c41a-542e-4e1c-8948-26e683f11fdc None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:19.304339 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654c41a-542e-4e1c-8948-26e683f11fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:19.330275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-d654c41a-542e-4e1c-8948-26e683f11fdc None None] MFA Rules not processed for user `f52f0a03cc0f494d82a091bd885478e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:44:19.331549 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d654c41a-542e-4e1c-8948-26e683f11fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:19.392571 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1230/2444] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 09:44:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:44:19.439034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4456a-8665-41c4-9a3d-bbf5245b990f service nova] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:19.440470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-67d4456a-8665-41c4-9a3d-bbf5245b990f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:19.511120 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4456a-8665-41c4-9a3d-bbf5245b990f service nova] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:19.516195 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6b726-25da-4670-95c1-6752533ffbb3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '351f74222d394f39bda0663e0e4ebde6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:19.516880 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6b726-25da-4670-95c1-6752533ffbb3 service swift] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:19.517166 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6b726-25da-4670-95c1-6752533ffbb3 service swift] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:19.517447 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6b726-25da-4670-95c1-6752533ffbb3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:19.526026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6b726-25da-4670-95c1-6752533ffbb3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:19.527660 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6b726-25da-4670-95c1-6752533ffbb3 service swift] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:19.535630 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1215/2445] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 09:44:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:44:29.385388 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=81 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:29.532415 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=38 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:35.658927 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654c41a-542e-4e1c-8948-26e683f11fdc None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:35.673224 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654c41a-542e-4e1c-8948-26e683f11fdc None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:35.678643 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160629f4-44a8-4e66-87be-16c383e99267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:35.679365 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160629f4-44a8-4e66-87be-16c383e99267 service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:35.679651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160629f4-44a8-4e66-87be-16c383e99267 service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:35.679930 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160629f4-44a8-4e66-87be-16c383e99267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:35.681720 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-160629f4-44a8-4e66-87be-16c383e99267 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:35.694007 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160629f4-44a8-4e66-87be-16c383e99267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:35.695669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160629f4-44a8-4e66-87be-16c383e99267 service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:35.706606 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1231/2446] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:44:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:44:39.326272 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6b726-25da-4670-95c1-6752533ffbb3 service swift] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:39.335666 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6b726-25da-4670-95c1-6752533ffbb3 service swift] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:39.339171 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b0fd2-5a51-4f4f-92c5-a369d732c4f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:39.339845 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b0fd2-5a51-4f4f-92c5-a369d732c4f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:39.340104 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b0fd2-5a51-4f4f-92c5-a369d732c4f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:39.340402 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b0fd2-5a51-4f4f-92c5-a369d732c4f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:39.342105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e46b0fd2-5a51-4f4f-92c5-a369d732c4f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:39.351708 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b0fd2-5a51-4f4f-92c5-a369d732c4f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:39.353112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b0fd2-5a51-4f4f-92c5-a369d732c4f1 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:39.361096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1216/2447] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:44:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:44:39.459218 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8c79c-4f2e-4dfe-8e82-b0fbdd2bfde1 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:39.459796 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8c79c-4f2e-4dfe-8e82-b0fbdd2bfde1 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:39.459796 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8c79c-4f2e-4dfe-8e82-b0fbdd2bfde1 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:39.461174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1232/2448] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 09:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:44:39.466852 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3211e8-df6a-482f-a94a-222dea645aaf None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:39.467146 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3211e8-df6a-482f-a94a-222dea645aaf None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:39.467455 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3211e8-df6a-482f-a94a-222dea645aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:39.506526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-bc3211e8-df6a-482f-a94a-222dea645aaf None None] MFA Rules not processed for user `d2b1c12e88c549208894fc0dd0c60b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:44:39.507854 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-bc3211e8-df6a-482f-a94a-222dea645aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:39.518176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1217/2449] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 09:44:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:44:39.531002 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8c79c-4f2e-4dfe-8e82-b0fbdd2bfde1 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:39.532782 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-bbc8c79c-4f2e-4dfe-8e82-b0fbdd2bfde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:39.612421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8c79c-4f2e-4dfe-8e82-b0fbdd2bfde1 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:39.616168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fb19a-424b-4194-802e-0ce27d69b692 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e04575437341df8127860a5e5abc50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:39.616821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fb19a-424b-4194-802e-0ce27d69b692 service glance] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:39.617109 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fb19a-424b-4194-802e-0ce27d69b692 service glance] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:39.617408 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fb19a-424b-4194-802e-0ce27d69b692 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:39.628167 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fb19a-424b-4194-802e-0ce27d69b692 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:39.629656 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fb19a-424b-4194-802e-0ce27d69b692 service glance] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:39.641514 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1233/2450] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:44:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:44:39.710543 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb1a0b-fd4b-4485-9512-cc2cffeae624 None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:39.710870 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb1a0b-fd4b-4485-9512-cc2cffeae624 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:39.711150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb1a0b-fd4b-4485-9512-cc2cffeae624 None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:39.712589 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1218/2451] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 09:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:44:39.720677 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d36ee-fc5b-4d2c-93db-dbf7c638e173 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:39.720972 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d36ee-fc5b-4d2c-93db-dbf7c638e173 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:39.721252 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d36ee-fc5b-4d2c-93db-dbf7c638e173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:39.739915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-863d36ee-fc5b-4d2c-93db-dbf7c638e173 None None] MFA Rules not processed for user `c1103a08484048da82c5e4627552253e`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:44:39.741179 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-863d36ee-fc5b-4d2c-93db-dbf7c638e173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:39.748891 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1234/2452] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 09:44:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:44:39.765650 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb1a0b-fd4b-4485-9512-cc2cffeae624 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:39.767464 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-29fb1a0b-fd4b-4485-9512-cc2cffeae624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:39.782004 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb1a0b-fd4b-4485-9512-cc2cffeae624 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:39.786122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f13e5b-e527-4274-80ca-37462259803b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:39.786825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f13e5b-e527-4274-80ca-37462259803b service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:39.787197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f13e5b-e527-4274-80ca-37462259803b service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:39.787534 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f13e5b-e527-4274-80ca-37462259803b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:39.796305 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f13e5b-e527-4274-80ca-37462259803b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:39.797783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f13e5b-e527-4274-80ca-37462259803b service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:39.806620 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1219/2453] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:44:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:44:39.904411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab12cd9-1632-49f4-a832-53e1fd39decd None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:39.904788 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab12cd9-1632-49f4-a832-53e1fd39decd None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:39.905073 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab12cd9-1632-49f4-a832-53e1fd39decd None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:39.906459 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1235/2454] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 09:44:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:44:39.911846 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7a6d5-1ed9-436b-b672-626e949ecd1b None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:39.912139 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7a6d5-1ed9-436b-b672-626e949ecd1b None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:39.912422 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7a6d5-1ed9-436b-b672-626e949ecd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:39.931464 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-a9e7a6d5-1ed9-436b-b672-626e949ecd1b None None] MFA Rules not processed for user `d2b1c12e88c549208894fc0dd0c60b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:44:39.932665 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-a9e7a6d5-1ed9-436b-b672-626e949ecd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:39.941993 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1220/2455] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 09:44:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:44:39.952606 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab12cd9-1632-49f4-a832-53e1fd39decd None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:39.963412 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab12cd9-1632-49f4-a832-53e1fd39decd None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:39.967571 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca67f06-165b-4d9a-8315-bec7215e5790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:39.968455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca67f06-165b-4d9a-8315-bec7215e5790 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:39.968737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca67f06-165b-4d9a-8315-bec7215e5790 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:39.969013 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca67f06-165b-4d9a-8315-bec7215e5790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:39.979015 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca67f06-165b-4d9a-8315-bec7215e5790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:39.980477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca67f06-165b-4d9a-8315-bec7215e5790 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:39.991512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1236/2456] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:44:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:44:40.060531 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7a6d5-1ed9-436b-b672-626e949ecd1b None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:40.062052 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-a9e7a6d5-1ed9-436b-b672-626e949ecd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:40.136430 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7a6d5-1ed9-436b-b672-626e949ecd1b None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:40.144234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcbc33-eebc-4ce9-9972-3734e01d008b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746fd8ed517446fe89c53df873abb2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:40.144893 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcbc33-eebc-4ce9-9972-3734e01d008b service placement] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:40.145177 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcbc33-eebc-4ce9-9972-3734e01d008b service placement] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:40.145453 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcbc33-eebc-4ce9-9972-3734e01d008b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:40.154988 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e9dcbc33-eebc-4ce9-9972-3734e01d008b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:40.172534 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dcbc33-eebc-4ce9-9972-3734e01d008b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:40.174503 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dcbc33-eebc-4ce9-9972-3734e01d008b service placement] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:40.185718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1221/2457] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:44:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:44:42.909975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f20d0e-c7d1-4985-b795-9faf3058376b None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:42.910451 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f20d0e-c7d1-4985-b795-9faf3058376b None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:42.910562 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f20d0e-c7d1-4985-b795-9faf3058376b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:42.927901 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-40f20d0e-c7d1-4985-b795-9faf3058376b None None] MFA Rules not processed for user `f52f0a03cc0f494d82a091bd885478e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:44:42.929093 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-40f20d0e-c7d1-4985-b795-9faf3058376b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:42.936816 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1237/2458] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 09:44:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:44:42.949207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcbc33-eebc-4ce9-9972-3734e01d008b service placement] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:42.961099 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcbc33-eebc-4ce9-9972-3734e01d008b service placement] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:42.966380 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b03f0-c41e-4435-aed5-25bc6305adc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '351f74222d394f39bda0663e0e4ebde6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:42.967026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b03f0-c41e-4435-aed5-25bc6305adc5 service swift] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:42.967335 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b03f0-c41e-4435-aed5-25bc6305adc5 service swift] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:42.968031 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b03f0-c41e-4435-aed5-25bc6305adc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:42.976542 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b03f0-c41e-4435-aed5-25bc6305adc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:42.978144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b03f0-c41e-4435-aed5-25bc6305adc5 service swift] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:42.986465 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1222/2459] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 09:44:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:44:48.393498 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f20d0e-c7d1-4985-b795-9faf3058376b None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:48.405877 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f20d0e-c7d1-4985-b795-9faf3058376b None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:48.410795 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ed3a3-06ae-4260-afe9-3cb8ceac6840 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746fd8ed517446fe89c53df873abb2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:48.411759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ed3a3-06ae-4260-afe9-3cb8ceac6840 service placement] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:48.412044 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ed3a3-06ae-4260-afe9-3cb8ceac6840 service placement] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:48.412318 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ed3a3-06ae-4260-afe9-3cb8ceac6840 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:48.414066 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d99ed3a3-06ae-4260-afe9-3cb8ceac6840 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:48.427814 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ed3a3-06ae-4260-afe9-3cb8ceac6840 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:48.429572 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ed3a3-06ae-4260-afe9-3cb8ceac6840 service placement] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:48.444943 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1238/2460] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:44:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:44:48.452243 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b03f0-c41e-4435-aed5-25bc6305adc5 service swift] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:48.453793 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-2c8b03f0-c41e-4435-aed5-25bc6305adc5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:48.541689 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b03f0-c41e-4435-aed5-25bc6305adc5 service swift] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:48.546310 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6df97-07cb-4485-be4a-c6918383c03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:48.547204 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6df97-07cb-4485-be4a-c6918383c03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:48.547525 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6df97-07cb-4485-be4a-c6918383c03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:48.547807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6df97-07cb-4485-be4a-c6918383c03a admin admin] PATH_INFO: `/v3/users/52e6eb075ba742e68bab4ab79eb37e1d` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:48.549012 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6df97-07cb-4485-be4a-c6918383c03a admin admin] RBAC: Authorizing `identity:delete_user(user_id=52e6eb075ba742e68bab4ab79eb37e1d)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:48.551199 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6df97-07cb-4485-be4a-c6918383c03a admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:48.583668 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:48.617632 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ace6df97-07cb-4485-be4a-c6918383c03a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52e6eb075ba742e68bab4ab79eb37e1d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:48.628241 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ace6df97-07cb-4485-be4a-c6918383c03a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52e6eb075ba742e68bab4ab79eb37e1d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:48.629439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ace6df97-07cb-4485-be4a-c6918383c03a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52e6eb075ba742e68bab4ab79eb37e1d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:48.644278 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ace6df97-07cb-4485-be4a-c6918383c03a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52e6eb075ba742e68bab4ab79eb37e1d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:48.652542 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-ace6df97-07cb-4485-be4a-c6918383c03a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52e6eb075ba742e68bab4ab79eb37e1d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:48.659224 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1223/2461] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:44:48 2022] DELETE /identity/v3/users/52e6eb075ba742e68bab4ab79eb37e1d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:44:48.837676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ed3a3-06ae-4260-afe9-3cb8ceac6840 service placement] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:48.853996 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ed3a3-06ae-4260-afe9-3cb8ceac6840 service placement] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:48.936862 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3d92b-0700-4581-a8e1-aaefec36dbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:48.937802 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3d92b-0700-4581-a8e1-aaefec36dbe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:48.938137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3d92b-0700-4581-a8e1-aaefec36dbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:48.938574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3d92b-0700-4581-a8e1-aaefec36dbe9 admin admin] PATH_INFO: `/v3/projects/fd5b7a3a6f5942b49b847f5d9ee9802a` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:48.939937 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b3d92b-0700-4581-a8e1-aaefec36dbe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd5b7a3a6f5942b49b847f5d9ee9802a)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:48.941898 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b3d92b-0700-4581-a8e1-aaefec36dbe9 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:48.984266 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:49.000624 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e8b3d92b-0700-4581-a8e1-aaefec36dbe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'request_id': 'req-e8b3d92b-0700-4581-a8e1-aaefec36dbe9'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:49.011553 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e8b3d92b-0700-4581-a8e1-aaefec36dbe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'request_id': 'req-e8b3d92b-0700-4581-a8e1-aaefec36dbe9'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:49.018395 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e8b3d92b-0700-4581-a8e1-aaefec36dbe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'request_id': 'req-e8b3d92b-0700-4581-a8e1-aaefec36dbe9'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:49.045990 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e8b3d92b-0700-4581-a8e1-aaefec36dbe9 admin admin] The token cache is being invalidate because project fd5b7a3a6f5942b49b847f5d9ee9802a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:44:49.045990 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e8b3d92b-0700-4581-a8e1-aaefec36dbe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:49.045990 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e8b3d92b-0700-4581-a8e1-aaefec36dbe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:44:49.056155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1239/2462] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:44:48 2022] DELETE /identity/v3/projects/fd5b7a3a6f5942b49b847f5d9ee9802a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:44:49.061224 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73da3bb-6584-4049-889d-113d74f66027 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:49.061539 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73da3bb-6584-4049-889d-113d74f66027 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:49.061813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73da3bb-6584-4049-889d-113d74f66027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:49.081970 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-c73da3bb-6584-4049-889d-113d74f66027 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:44:49.083380 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-c73da3bb-6584-4049-889d-113d74f66027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:49.154318 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1224/2463] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:44:49.167406 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462febd0-8c07-4a70-b9c6-ba08a0f7f207 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:49.167706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462febd0-8c07-4a70-b9c6-ba08a0f7f207 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:49.167992 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462febd0-8c07-4a70-b9c6-ba08a0f7f207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:49.190886 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-462febd0-8c07-4a70-b9c6-ba08a0f7f207 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:44:49.192218 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-462febd0-8c07-4a70-b9c6-ba08a0f7f207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:49.200592 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1240/2464] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:44:49.205027 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73da3bb-6584-4049-889d-113d74f66027 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:49.215632 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73da3bb-6584-4049-889d-113d74f66027 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:49.221229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c009f-eded-43d2-bb05-24e73940763c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:49.221946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c009f-eded-43d2-bb05-24e73940763c admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:49.222279 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c009f-eded-43d2-bb05-24e73940763c admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:49.222562 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c009f-eded-43d2-bb05-24e73940763c admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:49.223728 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c009f-eded-43d2-bb05-24e73940763c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:44:49.224044 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c009f-eded-43d2-bb05-24e73940763c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:49.225913 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c009f-eded-43d2-bb05-24e73940763c admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:49.240647 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1225/2465] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:44:49.245071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462febd0-8c07-4a70-b9c6-ba08a0f7f207 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:49.256804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462febd0-8c07-4a70-b9c6-ba08a0f7f207 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:49.261552 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad9888-d072-44f7-bcb6-edca14ae4f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:49.262203 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad9888-d072-44f7-bcb6-edca14ae4f00 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:49.262484 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad9888-d072-44f7-bcb6-edca14ae4f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:49.262783 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad9888-d072-44f7-bcb6-edca14ae4f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:49.263513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad9888-d072-44f7-bcb6-edca14ae4f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:49.265413 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad9888-d072-44f7-bcb6-edca14ae4f00 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:49.300208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1241/2466] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:44:49 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:44:49.305583 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c009f-eded-43d2-bb05-24e73940763c admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:49.315965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c009f-eded-43d2-bb05-24e73940763c admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:49.376721 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1ed32-a986-4a2a-b0ed-5b53b3d3f3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:49.377374 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1ed32-a986-4a2a-b0ed-5b53b3d3f3b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:49.377660 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1ed32-a986-4a2a-b0ed-5b53b3d3f3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:49.377934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1ed32-a986-4a2a-b0ed-5b53b3d3f3b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:49.378623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1ed32-a986-4a2a-b0ed-5b53b3d3f3b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:49.380580 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1ed32-a986-4a2a-b0ed-5b53b3d3f3b7 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:49.402103 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1226/2467] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:44:49 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:44:49.406973 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad9888-d072-44f7-bcb6-edca14ae4f00 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:49.417879 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad9888-d072-44f7-bcb6-edca14ae4f00 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:49.422674 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af2d2e-8493-4b44-89ec-f37dcb014180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:49.423454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af2d2e-8493-4b44-89ec-f37dcb014180 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:49.423804 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af2d2e-8493-4b44-89ec-f37dcb014180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:49.424145 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af2d2e-8493-4b44-89ec-f37dcb014180 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:49.424944 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af2d2e-8493-4b44-89ec-f37dcb014180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:49.426625 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af2d2e-8493-4b44-89ec-f37dcb014180 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:49.438189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1242/2468] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:44:49.442128 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1ed32-a986-4a2a-b0ed-5b53b3d3f3b7 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:49.452533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1ed32-a986-4a2a-b0ed-5b53b3d3f3b7 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:49.457161 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176e9cd-1684-493b-bdd5-a3f9d7b84cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:49.457808 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176e9cd-1684-493b-bdd5-a3f9d7b84cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:49.458091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176e9cd-1684-493b-bdd5-a3f9d7b84cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:49.458500 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176e9cd-1684-493b-bdd5-a3f9d7b84cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:49.459385 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176e9cd-1684-493b-bdd5-a3f9d7b84cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:49.461145 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176e9cd-1684-493b-bdd5-a3f9d7b84cf2 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:49.473173 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1227/2469] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:44:49.477241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af2d2e-8493-4b44-89ec-f37dcb014180 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:49.491547 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af2d2e-8493-4b44-89ec-f37dcb014180 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:49.496210 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9436c-3c99-4fee-aca8-202a3202b04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:49.497317 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9436c-3c99-4fee-aca8-202a3202b04b admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:49.497660 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9436c-3c99-4fee-aca8-202a3202b04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:49.498085 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9436c-3c99-4fee-aca8-202a3202b04b admin admin] PATH_INFO: `/v3/projects/2ed0733b1ce342f2a6ecac960523f85f/users/5b1a972ace154e93aeb19a53930fd306/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:49.514434 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9436c-3c99-4fee-aca8-202a3202b04b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed0733b1ce342f2a6ecac960523f85f, user_id=5b1a972ace154e93aeb19a53930fd306, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:49.517153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9436c-3c99-4fee-aca8-202a3202b04b admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:49.531058 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1243/2470] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:44:49 2022] PUT /identity/v3/projects/2ed0733b1ce342f2a6ecac960523f85f/users/5b1a972ace154e93aeb19a53930fd306/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:44:49.536115 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8722dd-aa66-42a3-b967-d181b1778aeb None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:49.536409 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8722dd-aa66-42a3-b967-d181b1778aeb None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:49.536686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8722dd-aa66-42a3-b967-d181b1778aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:49.567714 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-7f8722dd-aa66-42a3-b967-d181b1778aeb None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:44:49.569092 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-7f8722dd-aa66-42a3-b967-d181b1778aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:49.573200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:49.637955 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1228/2471] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:44:49.648066 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9436c-3c99-4fee-aca8-202a3202b04b admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:49.649778 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-b8e9436c-3c99-4fee-aca8-202a3202b04b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:49.710208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9436c-3c99-4fee-aca8-202a3202b04b admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:49.714081 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1b075-6f5f-4431-a29a-336e19333247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:49.714751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1b075-6f5f-4431-a29a-336e19333247 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:49.715033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1b075-6f5f-4431-a29a-336e19333247 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:49.715334 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1b075-6f5f-4431-a29a-336e19333247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:49.725469 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1b075-6f5f-4431-a29a-336e19333247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:49.727223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1b075-6f5f-4431-a29a-336e19333247 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:49.738976 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1244/2472] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:44:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:44:54.644176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fda60-e1cf-43e9-8d63-54f80ac1ff2a None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:54.644798 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fda60-e1cf-43e9-8d63-54f80ac1ff2a None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:54.644798 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fda60-e1cf-43e9-8d63-54f80ac1ff2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:54.690101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-c55fda60-e1cf-43e9-8d63-54f80ac1ff2a None None] MFA Rules not processed for user `5b1a972ace154e93aeb19a53930fd306`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:44:54.691470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-c55fda60-e1cf-43e9-8d63-54f80ac1ff2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:44:54.781030 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1229/2473] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:44:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:44:54.785601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1b075-6f5f-4431-a29a-336e19333247 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:54.801922 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1b075-6f5f-4431-a29a-336e19333247 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:54.807436 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac414c-94e5-40e7-9b96-74b8e8570e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:54.808186 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac414c-94e5-40e7-9b96-74b8e8570e77 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:54.808470 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac414c-94e5-40e7-9b96-74b8e8570e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:54.808748 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac414c-94e5-40e7-9b96-74b8e8570e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:54.810151 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac414c-94e5-40e7-9b96-74b8e8570e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:54.812409 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac414c-94e5-40e7-9b96-74b8e8570e77 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:54.847566 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1245/2474] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:44:54 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:44:54.861597 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55fda60-e1cf-43e9-8d63-54f80ac1ff2a None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:54.874308 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55fda60-e1cf-43e9-8d63-54f80ac1ff2a None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:54.943898 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772c2a9-3898-4fc9-9593-6887b6627d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:54.944592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772c2a9-3898-4fc9-9593-6887b6627d52 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:54.944944 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772c2a9-3898-4fc9-9593-6887b6627d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:54.945289 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772c2a9-3898-4fc9-9593-6887b6627d52 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:54.946044 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772c2a9-3898-4fc9-9593-6887b6627d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:54.948033 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772c2a9-3898-4fc9-9593-6887b6627d52 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:54.973551 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1230/2475] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:44:54 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:44:54.974851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac414c-94e5-40e7-9b96-74b8e8570e77 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:54.986945 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac414c-94e5-40e7-9b96-74b8e8570e77 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:55.003529 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8f233-e581-4fd1-8b49-4143ddc2f24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:55.004454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8f233-e581-4fd1-8b49-4143ddc2f24e admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:55.004842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8f233-e581-4fd1-8b49-4143ddc2f24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:55.005201 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8f233-e581-4fd1-8b49-4143ddc2f24e admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:55.005948 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8f233-e581-4fd1-8b49-4143ddc2f24e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:55.007650 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8f233-e581-4fd1-8b49-4143ddc2f24e admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:55.020130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1246/2476] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:44:55.024983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772c2a9-3898-4fc9-9593-6887b6627d52 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:55.036600 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772c2a9-3898-4fc9-9593-6887b6627d52 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:55.041962 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa443d9-b79d-4af3-9931-b5acca20436d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:55.042940 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa443d9-b79d-4af3-9931-b5acca20436d admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:55.043426 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa443d9-b79d-4af3-9931-b5acca20436d admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:55.044594 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa443d9-b79d-4af3-9931-b5acca20436d admin admin] PATH_INFO: `/v3/projects/e45e0a6597e548d6800eb3c3f91313b0/users/150042280c2c4c5299cb63730d67b8d5/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:55.066916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa443d9-b79d-4af3-9931-b5acca20436d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e45e0a6597e548d6800eb3c3f91313b0, user_id=150042280c2c4c5299cb63730d67b8d5, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:55.069058 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa443d9-b79d-4af3-9931-b5acca20436d admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:55.090400 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1231/2477] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:44:55 2022] PUT /identity/v3/projects/e45e0a6597e548d6800eb3c3f91313b0/users/150042280c2c4c5299cb63730d67b8d5/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:44:55.095469 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8f233-e581-4fd1-8b49-4143ddc2f24e admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:55.110231 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8f233-e581-4fd1-8b49-4143ddc2f24e admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:55.149188 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:55.223465 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910c510-29f7-4e1f-b582-26ee6627ee94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:55.224401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910c510-29f7-4e1f-b582-26ee6627ee94 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:55.224769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910c510-29f7-4e1f-b582-26ee6627ee94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:55.225110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910c510-29f7-4e1f-b582-26ee6627ee94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:55.225913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4910c510-29f7-4e1f-b582-26ee6627ee94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:55.227650 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4910c510-29f7-4e1f-b582-26ee6627ee94 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:55.240019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1247/2478] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:44:55.244274 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa443d9-b79d-4af3-9931-b5acca20436d admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:44:55.253432 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:55.259372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa443d9-b79d-4af3-9931-b5acca20436d admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:44:55.266276 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f438b-d8cd-4fa2-9460-015864013a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:44:55.267832 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f438b-d8cd-4fa2-9460-015864013a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:44:55.268112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f438b-d8cd-4fa2-9460-015864013a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:44:55.268424 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f438b-d8cd-4fa2-9460-015864013a99 admin admin] PATH_INFO: `/v3/projects/e45e0a6597e548d6800eb3c3f91313b0/users/150042280c2c4c5299cb63730d67b8d5/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:44:55.270925 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f438b-d8cd-4fa2-9460-015864013a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e45e0a6597e548d6800eb3c3f91313b0, user_id=150042280c2c4c5299cb63730d67b8d5, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:44:55.273657 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f438b-d8cd-4fa2-9460-015864013a99 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:44:55.287475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1232/2479] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:44:55 2022] PUT /identity/v3/projects/e45e0a6597e548d6800eb3c3f91313b0/users/150042280c2c4c5299cb63730d67b8d5/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:45:00.544452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955045e5-fcd8-409c-b592-31ce7eb67e86 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:00.545003 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955045e5-fcd8-409c-b592-31ce7eb67e86 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:00.545003 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955045e5-fcd8-409c-b592-31ce7eb67e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:00.574306 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-955045e5-fcd8-409c-b592-31ce7eb67e86 None None] MFA Rules not processed for user `150042280c2c4c5299cb63730d67b8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:00.576156 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-955045e5-fcd8-409c-b592-31ce7eb67e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:00.652962 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1248/2480] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:45:00 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:00.667004 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f438b-d8cd-4fa2-9460-015864013a99 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:00.669679 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-2a3f438b-d8cd-4fa2-9460-015864013a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:00.748826 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f438b-d8cd-4fa2-9460-015864013a99 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:00.754645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60829088-b910-4faa-9265-f903d8ce847b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:00.755405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60829088-b910-4faa-9265-f903d8ce847b service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:00.755691 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60829088-b910-4faa-9265-f903d8ce847b service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:00.755965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60829088-b910-4faa-9265-f903d8ce847b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:00.813643 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60829088-b910-4faa-9265-f903d8ce847b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:00.815236 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60829088-b910-4faa-9265-f903d8ce847b service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:00.824106 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1233/2481] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:45:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:45:02.224689 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b987697-f8de-493f-8ca6-8ab626c502cd None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:02.225255 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b987697-f8de-493f-8ca6-8ab626c502cd None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:02.225353 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b987697-f8de-493f-8ca6-8ab626c502cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:02.243930 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-7b987697-f8de-493f-8ca6-8ab626c502cd None None] MFA Rules not processed for user `5b1a972ace154e93aeb19a53930fd306`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:02.245147 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-7b987697-f8de-493f-8ca6-8ab626c502cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:02.252644 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1249/2482] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:45:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:10.820008 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=59,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:12.238551 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=54 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:14.853415 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f26bb2-e876-4e5b-a465-a904c657aeaf None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:14.853938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f26bb2-e876-4e5b-a465-a904c657aeaf None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:14.854263 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f26bb2-e876-4e5b-a465-a904c657aeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:14.873483 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-e9f26bb2-e876-4e5b-a465-a904c657aeaf None None] MFA Rules not processed for user `f52f0a03cc0f494d82a091bd885478e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:45:14.875324 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e9f26bb2-e876-4e5b-a465-a904c657aeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:14.933490 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1234/2483] 10.222.0.41 () {58 vars in 967 bytes} [Fri May 27 09:45:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:45:14.946115 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b987697-f8de-493f-8ca6-8ab626c502cd None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:14.947557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-7b987697-f8de-493f-8ca6-8ab626c502cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:15.023080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b987697-f8de-493f-8ca6-8ab626c502cd None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:15.027998 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cac7dc-130b-4c4d-a29a-49b821e87118 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '351f74222d394f39bda0663e0e4ebde6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:15.028656 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cac7dc-130b-4c4d-a29a-49b821e87118 service swift] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:15.028926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cac7dc-130b-4c4d-a29a-49b821e87118 service swift] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:15.029202 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cac7dc-130b-4c4d-a29a-49b821e87118 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:15.038672 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cac7dc-130b-4c4d-a29a-49b821e87118 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:15.040335 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cac7dc-130b-4c4d-a29a-49b821e87118 service swift] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:15.049734 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1250/2484] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 09:45:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:45:24.925936 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=25 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:25.045495 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=32 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:34.329890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f26bb2-e876-4e5b-a465-a904c657aeaf None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:34.342815 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f26bb2-e876-4e5b-a465-a904c657aeaf None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:34.348879 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17920d20-5678-4769-8fe0-c096d35b2255 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:34.349515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17920d20-5678-4769-8fe0-c096d35b2255 service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:34.349795 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17920d20-5678-4769-8fe0-c096d35b2255 service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:34.350070 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17920d20-5678-4769-8fe0-c096d35b2255 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:34.351835 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-17920d20-5678-4769-8fe0-c096d35b2255 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:45:34.414592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17920d20-5678-4769-8fe0-c096d35b2255 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:34.416220 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17920d20-5678-4769-8fe0-c096d35b2255 service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:34.425546 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1235/2485] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:45:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:45:44.421199 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=28 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:45.808655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cac7dc-130b-4c4d-a29a-49b821e87118 service swift] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:45:45.867384 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cac7dc-130b-4c4d-a29a-49b821e87118 service swift] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:45:45.871139 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27aa4b9-80c3-4f12-ae02-a294d1fed2cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:45:45.871824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27aa4b9-80c3-4f12-ae02-a294d1fed2cd service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:45:45.872113 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27aa4b9-80c3-4f12-ae02-a294d1fed2cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:45:45.872469 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27aa4b9-80c3-4f12-ae02-a294d1fed2cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:45:45.882149 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27aa4b9-80c3-4f12-ae02-a294d1fed2cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:45:45.883683 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27aa4b9-80c3-4f12-ae02-a294d1fed2cd service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:45:45.893650 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1251/2486] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:45:45 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:45:55.889142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=26 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:05.973309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaf593-2d9c-400d-a855-15db0b6ac669 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:05.973869 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaf593-2d9c-400d-a855-15db0b6ac669 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:05.973869 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaf593-2d9c-400d-a855-15db0b6ac669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:05.996935 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-09aaf593-2d9c-400d-a855-15db0b6ac669 None None] MFA Rules not processed for user `1331ba69eaec44dd9bd8f8db7d53ba5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:46:05.998143 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-09aaf593-2d9c-400d-a855-15db0b6ac669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:06.005779 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1236/2487] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:46:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:46:15.991527 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:42.465903 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3acf6-3aeb-4882-a558-8da47a7e4a34 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:42.466409 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3acf6-3aeb-4882-a558-8da47a7e4a34 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:42.466505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3acf6-3aeb-4882-a558-8da47a7e4a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:42.489527 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-ced3acf6-3aeb-4882-a558-8da47a7e4a34 None None] MFA Rules not processed for user `5b0d25ff6a664177b463b834124802d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:46:42.490782 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-ced3acf6-3aeb-4882-a558-8da47a7e4a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:42.544235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1252/2488] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:46:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:46:42.836607 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aaf593-2d9c-400d-a855-15db0b6ac669 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:46:42.847101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aaf593-2d9c-400d-a855-15db0b6ac669 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:46:42.850612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5261e-85c6-43a5-b8d6-bb41804c13e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:46:42.851246 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5261e-85c6-43a5-b8d6-bb41804c13e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:42.851559 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5261e-85c6-43a5-b8d6-bb41804c13e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:42.851859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5261e-85c6-43a5-b8d6-bb41804c13e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:42.853659 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-aca5261e-85c6-43a5-b8d6-bb41804c13e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:42.863634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5261e-85c6-43a5-b8d6-bb41804c13e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:46:42.865214 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5261e-85c6-43a5-b8d6-bb41804c13e3 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:46:42.873566 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1237/2489] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:46:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:46:47.152316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3acf6-3aeb-4882-a558-8da47a7e4a34 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:46:47.153647 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-ced3acf6-3aeb-4882-a558-8da47a7e4a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:47.169525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3acf6-3aeb-4882-a558-8da47a7e4a34 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:46:47.177012 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193edd1-a96a-45d9-b2d5-4cba4fb732d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:46:47.178492 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193edd1-a96a-45d9-b2d5-4cba4fb732d6 service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:47.178776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193edd1-a96a-45d9-b2d5-4cba4fb732d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:47.179052 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193edd1-a96a-45d9-b2d5-4cba4fb732d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:47.180875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-0193edd1-a96a-45d9-b2d5-4cba4fb732d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:47.239138 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193edd1-a96a-45d9-b2d5-4cba4fb732d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:46:47.240761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193edd1-a96a-45d9-b2d5-4cba4fb732d6 service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:46:47.249546 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1253/2490] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:46:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:46:52.869947 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=6 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:57.245574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=53 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:58.471697 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1f2bd-abc9-4110-892b-1999fac639be None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:58.472171 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1f2bd-abc9-4110-892b-1999fac639be None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:58.472253 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1f2bd-abc9-4110-892b-1999fac639be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:58.491496 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-aad1f2bd-abc9-4110-892b-1999fac639be None None] MFA Rules not processed for user `f52f0a03cc0f494d82a091bd885478e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:46:58.492742 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-aad1f2bd-abc9-4110-892b-1999fac639be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:58.499912 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1238/2491] 10.222.0.41 () {58 vars in 967 bytes} [Fri May 27 09:46:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:46:58.548458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193edd1-a96a-45d9-b2d5-4cba4fb732d6 service nova] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:46:58.559702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193edd1-a96a-45d9-b2d5-4cba4fb732d6 service nova] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:46:58.564696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea942c-7e7f-47a4-aa68-a5145cd965c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '351f74222d394f39bda0663e0e4ebde6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:46:58.565343 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea942c-7e7f-47a4-aa68-a5145cd965c6 service swift] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:58.565652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea942c-7e7f-47a4-aa68-a5145cd965c6 service swift] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:58.565910 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea942c-7e7f-47a4-aa68-a5145cd965c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:58.574071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea942c-7e7f-47a4-aa68-a5145cd965c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:46:58.575693 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea942c-7e7f-47a4-aa68-a5145cd965c6 service swift] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:46:58.584721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1254/2492] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 09:46:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:46:58.941195 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1f2bd-abc9-4110-892b-1999fac639be None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:46:58.942746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-aad1f2bd-abc9-4110-892b-1999fac639be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:58.958055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1f2bd-abc9-4110-892b-1999fac639be None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:46:58.961677 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3b46e-460f-40fb-bb19-4db4db1de41a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:46:58.962496 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3b46e-460f-40fb-bb19-4db4db1de41a service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:46:58.962774 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3b46e-460f-40fb-bb19-4db4db1de41a service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:46:58.963047 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3b46e-460f-40fb-bb19-4db4db1de41a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:46:58.964820 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-12d3b46e-460f-40fb-bb19-4db4db1de41a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:46:59.029783 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3b46e-460f-40fb-bb19-4db4db1de41a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:46:59.031252 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3b46e-460f-40fb-bb19-4db4db1de41a service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:46:59.047467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1239/2493] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:46:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:47:02.509999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea942c-7e7f-47a4-aa68-a5145cd965c6 service swift] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:02.511995 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-89ea942c-7e7f-47a4-aa68-a5145cd965c6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:02.587748 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea942c-7e7f-47a4-aa68-a5145cd965c6 service swift] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:02.592916 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bba9a5-b821-4a26-b098-9f34228fc043 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746fd8ed517446fe89c53df873abb2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:02.593569 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bba9a5-b821-4a26-b098-9f34228fc043 service placement] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:02.593851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bba9a5-b821-4a26-b098-9f34228fc043 service placement] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:02.594126 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bba9a5-b821-4a26-b098-9f34228fc043 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:02.596460 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d5bba9a5-b821-4a26-b098-9f34228fc043 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:02.614471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bba9a5-b821-4a26-b098-9f34228fc043 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:02.616204 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bba9a5-b821-4a26-b098-9f34228fc043 service placement] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:02.629953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1255/2494] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:47:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:47:05.708985 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3b46e-460f-40fb-bb19-4db4db1de41a service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:05.717151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-12d3b46e-460f-40fb-bb19-4db4db1de41a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:05.733948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3b46e-460f-40fb-bb19-4db4db1de41a service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:05.738633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421c005-f4a6-480f-9693-d6a63e02da76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:05.739543 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421c005-f4a6-480f-9693-d6a63e02da76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:05.739829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421c005-f4a6-480f-9693-d6a63e02da76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:05.740110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421c005-f4a6-480f-9693-d6a63e02da76 admin admin] PATH_INFO: `/v3/users/68b32d9217954d72a2b7aa3ba893f942` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:05.741302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421c005-f4a6-480f-9693-d6a63e02da76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68b32d9217954d72a2b7aa3ba893f942)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:05.743261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421c005-f4a6-480f-9693-d6a63e02da76 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:05.796350 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-0421c005-f4a6-480f-9693-d6a63e02da76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68b32d9217954d72a2b7aa3ba893f942'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:05.803942 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-0421c005-f4a6-480f-9693-d6a63e02da76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68b32d9217954d72a2b7aa3ba893f942'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:05.804608 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-0421c005-f4a6-480f-9693-d6a63e02da76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68b32d9217954d72a2b7aa3ba893f942'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:05.816460 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-0421c005-f4a6-480f-9693-d6a63e02da76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68b32d9217954d72a2b7aa3ba893f942'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:05.823091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-0421c005-f4a6-480f-9693-d6a63e02da76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68b32d9217954d72a2b7aa3ba893f942'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:05.828921 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1240/2495] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:47:05 2022] DELETE /identity/v3/users/68b32d9217954d72a2b7aa3ba893f942 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:47:06.000936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bba9a5-b821-4a26-b098-9f34228fc043 service placement] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:06.011841 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bba9a5-b821-4a26-b098-9f34228fc043 service placement] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:06.077340 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d89d50-7a55-4712-a1f7-dd0429b81a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:06.078211 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d89d50-7a55-4712-a1f7-dd0429b81a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:06.078499 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d89d50-7a55-4712-a1f7-dd0429b81a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:06.078779 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d89d50-7a55-4712-a1f7-dd0429b81a08 admin admin] PATH_INFO: `/v3/projects/050fc8655bd34646b1b3f211b6fd912a` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:06.080525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d89d50-7a55-4712-a1f7-dd0429b81a08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=050fc8655bd34646b1b3f211b6fd912a)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:06.082489 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d89d50-7a55-4712-a1f7-dd0429b81a08 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:06.127331 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-23d89d50-7a55-4712-a1f7-dd0429b81a08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '050fc8655bd34646b1b3f211b6fd912a', 'request_id': 'req-23d89d50-7a55-4712-a1f7-dd0429b81a08'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:06.134249 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-23d89d50-7a55-4712-a1f7-dd0429b81a08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '050fc8655bd34646b1b3f211b6fd912a', 'request_id': 'req-23d89d50-7a55-4712-a1f7-dd0429b81a08'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:06.139671 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-23d89d50-7a55-4712-a1f7-dd0429b81a08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '050fc8655bd34646b1b3f211b6fd912a', 'request_id': 'req-23d89d50-7a55-4712-a1f7-dd0429b81a08'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:06.150862 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-23d89d50-7a55-4712-a1f7-dd0429b81a08 admin admin] The token cache is being invalidate because project 050fc8655bd34646b1b3f211b6fd912a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:47:06.151149 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-23d89d50-7a55-4712-a1f7-dd0429b81a08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:06.151794 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-23d89d50-7a55-4712-a1f7-dd0429b81a08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:06.153303 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1256/2496] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:47:05 2022] DELETE /identity/v3/projects/050fc8655bd34646b1b3f211b6fd912a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:47:06.158000 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421c005-f4a6-480f-9693-d6a63e02da76 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:06.159385 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-0421c005-f4a6-480f-9693-d6a63e02da76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:06.172246 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421c005-f4a6-480f-9693-d6a63e02da76 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:06.234242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe81df-b866-4bb0-a2a2-f1f52e821d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:06.235153 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe81df-b866-4bb0-a2a2-f1f52e821d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:06.235462 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe81df-b866-4bb0-a2a2-f1f52e821d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:06.235732 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe81df-b866-4bb0-a2a2-f1f52e821d0b admin admin] PATH_INFO: `/v3/users/43fec2f999c748e0a7266455dddbc7e0` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:06.236895 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe81df-b866-4bb0-a2a2-f1f52e821d0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=43fec2f999c748e0a7266455dddbc7e0)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:06.238802 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe81df-b866-4bb0-a2a2-f1f52e821d0b admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:06.240283 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:06.286534 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-4afe81df-b866-4bb0-a2a2-f1f52e821d0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43fec2f999c748e0a7266455dddbc7e0'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:06.293404 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-4afe81df-b866-4bb0-a2a2-f1f52e821d0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43fec2f999c748e0a7266455dddbc7e0'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:06.294052 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-4afe81df-b866-4bb0-a2a2-f1f52e821d0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43fec2f999c748e0a7266455dddbc7e0'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:06.305835 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-4afe81df-b866-4bb0-a2a2-f1f52e821d0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43fec2f999c748e0a7266455dddbc7e0'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:06.313814 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-4afe81df-b866-4bb0-a2a2-f1f52e821d0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43fec2f999c748e0a7266455dddbc7e0'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:06.319757 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1241/2497] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:47:06 2022] DELETE /identity/v3/users/43fec2f999c748e0a7266455dddbc7e0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:47:06.490753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d89d50-7a55-4712-a1f7-dd0429b81a08 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:06.492755 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-23d89d50-7a55-4712-a1f7-dd0429b81a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:06.505520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d89d50-7a55-4712-a1f7-dd0429b81a08 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:06.509699 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:06.565757 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fce61-5cb7-4ace-80a6-4e7b840fd7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:06.566627 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fce61-5cb7-4ace-80a6-4e7b840fd7c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:06.566907 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fce61-5cb7-4ace-80a6-4e7b840fd7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:06.567184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fce61-5cb7-4ace-80a6-4e7b840fd7c8 admin admin] PATH_INFO: `/v3/projects/da2160cfd845436b813871795986d876` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:06.568398 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fce61-5cb7-4ace-80a6-4e7b840fd7c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da2160cfd845436b813871795986d876)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:06.570430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fce61-5cb7-4ace-80a6-4e7b840fd7c8 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:06.616070 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-dd7fce61-5cb7-4ace-80a6-4e7b840fd7c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da2160cfd845436b813871795986d876', 'request_id': 'req-dd7fce61-5cb7-4ace-80a6-4e7b840fd7c8'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:06.623365 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-dd7fce61-5cb7-4ace-80a6-4e7b840fd7c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da2160cfd845436b813871795986d876', 'request_id': 'req-dd7fce61-5cb7-4ace-80a6-4e7b840fd7c8'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:06.629059 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-dd7fce61-5cb7-4ace-80a6-4e7b840fd7c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da2160cfd845436b813871795986d876', 'request_id': 'req-dd7fce61-5cb7-4ace-80a6-4e7b840fd7c8'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:06.639835 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-dd7fce61-5cb7-4ace-80a6-4e7b840fd7c8 admin admin] The token cache is being invalidate because project da2160cfd845436b813871795986d876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:47:06.640119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-dd7fce61-5cb7-4ace-80a6-4e7b840fd7c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:06.640740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-dd7fce61-5cb7-4ace-80a6-4e7b840fd7c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:06.642246 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1257/2498] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:47:06 2022] DELETE /identity/v3/projects/da2160cfd845436b813871795986d876 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:47:16.316372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=26,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:16.636910 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:33.599690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe81df-b866-4bb0-a2a2-f1f52e821d0b admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:33.601139 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-4afe81df-b866-4bb0-a2a2-f1f52e821d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:33.669757 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe81df-b866-4bb0-a2a2-f1f52e821d0b admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:33.729209 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0b3fe-058a-4a52-91ad-aa975b68a9f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746fd8ed517446fe89c53df873abb2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:33.729871 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0b3fe-058a-4a52-91ad-aa975b68a9f4 service placement] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:33.730158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0b3fe-058a-4a52-91ad-aa975b68a9f4 service placement] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:33.730550 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0b3fe-058a-4a52-91ad-aa975b68a9f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:33.732403 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-3fe0b3fe-058a-4a52-91ad-aa975b68a9f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:33.745193 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0b3fe-058a-4a52-91ad-aa975b68a9f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:33.746784 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0b3fe-058a-4a52-91ad-aa975b68a9f4 service placement] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:33.757248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1242/2499] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:47:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:47:37.933464 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f2fba-bba2-4ecd-9cff-8824d016beab None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:37.933980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f2fba-bba2-4ecd-9cff-8824d016beab None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:37.934097 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f2fba-bba2-4ecd-9cff-8824d016beab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:37.952213 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-fc4f2fba-bba2-4ecd-9cff-8824d016beab None None] MFA Rules not processed for user `2463c2327e364ca996768e3eb6ef6316`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:47:37.953592 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-fc4f2fba-bba2-4ecd-9cff-8824d016beab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:38.009590 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1258/2500] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:47:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:47:43.753075 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=58 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:47.731890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0b3fe-058a-4a52-91ad-aa975b68a9f4 service placement] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:47.733284 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-3fe0b3fe-058a-4a52-91ad-aa975b68a9f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:47.790282 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0b3fe-058a-4a52-91ad-aa975b68a9f4 service placement] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:47.794018 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf10414-51d9-4abe-b57f-827469af18a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:47.794659 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf10414-51d9-4abe-b57f-827469af18a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:47.794943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf10414-51d9-4abe-b57f-827469af18a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:47.795402 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf10414-51d9-4abe-b57f-827469af18a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:47.797426 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-aaf10414-51d9-4abe-b57f-827469af18a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:47.862704 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf10414-51d9-4abe-b57f-827469af18a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:47.864174 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf10414-51d9-4abe-b57f-827469af18a8 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:47.874320 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1243/2501] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:47:48.002636 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=25 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:50.963549 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f2fba-bba2-4ecd-9cff-8824d016beab None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:50.966102 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-fc4f2fba-bba2-4ecd-9cff-8824d016beab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:50.983735 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f2fba-bba2-4ecd-9cff-8824d016beab None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:50.989219 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe15490-22d1-41a4-bbaa-2e49e34722c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:50.990176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe15490-22d1-41a4-bbaa-2e49e34722c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:50.990525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe15490-22d1-41a4-bbaa-2e49e34722c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:50.990868 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe15490-22d1-41a4-bbaa-2e49e34722c8 admin admin] PATH_INFO: `/v3/users/1331ba69eaec44dd9bd8f8db7d53ba5c` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:50.992205 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe15490-22d1-41a4-bbaa-2e49e34722c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1331ba69eaec44dd9bd8f8db7d53ba5c)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:50.994131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe15490-22d1-41a4-bbaa-2e49e34722c8 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:51.044413 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-7fe15490-22d1-41a4-bbaa-2e49e34722c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1331ba69eaec44dd9bd8f8db7d53ba5c'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:51.045108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-7fe15490-22d1-41a4-bbaa-2e49e34722c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1331ba69eaec44dd9bd8f8db7d53ba5c'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:51.052605 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-7fe15490-22d1-41a4-bbaa-2e49e34722c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1331ba69eaec44dd9bd8f8db7d53ba5c'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:51.053229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-7fe15490-22d1-41a4-bbaa-2e49e34722c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1331ba69eaec44dd9bd8f8db7d53ba5c'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:51.066000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-7fe15490-22d1-41a4-bbaa-2e49e34722c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1331ba69eaec44dd9bd8f8db7d53ba5c'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:51.080698 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1259/2502] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:47:50 2022] DELETE /identity/v3/users/1331ba69eaec44dd9bd8f8db7d53ba5c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:47:51.263866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf10414-51d9-4abe-b57f-827469af18a8 service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:51.274778 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf10414-51d9-4abe-b57f-827469af18a8 service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:51.334341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfb7a1-45d7-427b-b414-cccdcbe0082f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:51.335201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfb7a1-45d7-427b-b414-cccdcbe0082f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:51.335525 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfb7a1-45d7-427b-b414-cccdcbe0082f admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:51.335792 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfb7a1-45d7-427b-b414-cccdcbe0082f admin admin] PATH_INFO: `/v3/projects/0cad683f27d14cf5a90a19525a467a52` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:51.336971 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bfb7a1-45d7-427b-b414-cccdcbe0082f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cad683f27d14cf5a90a19525a467a52)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:51.338876 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bfb7a1-45d7-427b-b414-cccdcbe0082f admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:51.386896 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-89bfb7a1-45d7-427b-b414-cccdcbe0082f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cad683f27d14cf5a90a19525a467a52', 'request_id': 'req-89bfb7a1-45d7-427b-b414-cccdcbe0082f'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:51.389528 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:51.395293 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-89bfb7a1-45d7-427b-b414-cccdcbe0082f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cad683f27d14cf5a90a19525a467a52', 'request_id': 'req-89bfb7a1-45d7-427b-b414-cccdcbe0082f'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:51.402853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-89bfb7a1-45d7-427b-b414-cccdcbe0082f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cad683f27d14cf5a90a19525a467a52', 'request_id': 'req-89bfb7a1-45d7-427b-b414-cccdcbe0082f'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:51.413418 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-89bfb7a1-45d7-427b-b414-cccdcbe0082f admin admin] The token cache is being invalidate because project 0cad683f27d14cf5a90a19525a467a52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:47:51.413700 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-89bfb7a1-45d7-427b-b414-cccdcbe0082f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:51.414309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-89bfb7a1-45d7-427b-b414-cccdcbe0082f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:47:51.415873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1244/2503] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:47:51 2022] DELETE /identity/v3/projects/0cad683f27d14cf5a90a19525a467a52 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:47:51.420825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c4c72-deb8-4c46-b42d-ced36992976c None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:51.421118 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c4c72-deb8-4c46-b42d-ced36992976c None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:51.421396 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c4c72-deb8-4c46-b42d-ced36992976c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:51.439546 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-979c4c72-deb8-4c46-b42d-ced36992976c None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:47:51.440761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-979c4c72-deb8-4c46-b42d-ced36992976c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:51.498588 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1260/2504] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:47:51.506309 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc1fa9-3122-4e37-b30a-d9655be392da None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:51.506567 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc1fa9-3122-4e37-b30a-d9655be392da None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:51.506853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc1fa9-3122-4e37-b30a-d9655be392da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:51.525028 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-c4cc1fa9-3122-4e37-b30a-d9655be392da None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:47:51.526228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-c4cc1fa9-3122-4e37-b30a-d9655be392da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:51.534644 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1245/2505] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:47:51.538665 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c4c72-deb8-4c46-b42d-ced36992976c None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:51.548341 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c4c72-deb8-4c46-b42d-ced36992976c None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:51.553468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a95f51-f5cd-4984-883a-3a2ed0bf874f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:51.554128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a95f51-f5cd-4984-883a-3a2ed0bf874f admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:51.554416 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a95f51-f5cd-4984-883a-3a2ed0bf874f admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:51.554688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a95f51-f5cd-4984-883a-3a2ed0bf874f admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:51.555433 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a95f51-f5cd-4984-883a-3a2ed0bf874f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:47:51.555741 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a95f51-f5cd-4984-883a-3a2ed0bf874f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:51.557330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a95f51-f5cd-4984-883a-3a2ed0bf874f admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:51.568730 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1261/2506] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:47:51.572794 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc1fa9-3122-4e37-b30a-d9655be392da None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:51.581901 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc1fa9-3122-4e37-b30a-d9655be392da None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:51.586517 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278c625-c381-48b1-b93b-2a28620c53e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:51.587160 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278c625-c381-48b1-b93b-2a28620c53e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:51.587474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278c625-c381-48b1-b93b-2a28620c53e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:51.587752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278c625-c381-48b1-b93b-2a28620c53e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:51.588429 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278c625-c381-48b1-b93b-2a28620c53e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:51.590584 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278c625-c381-48b1-b93b-2a28620c53e8 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:51.626250 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1246/2507] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:47:51 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:47:51.630235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a95f51-f5cd-4984-883a-3a2ed0bf874f admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:51.639979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a95f51-f5cd-4984-883a-3a2ed0bf874f admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:51.695847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560fcfb-f9db-4b7a-b8c7-0fc2150d9b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:51.696542 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560fcfb-f9db-4b7a-b8c7-0fc2150d9b86 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:51.696832 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560fcfb-f9db-4b7a-b8c7-0fc2150d9b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:51.697114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560fcfb-f9db-4b7a-b8c7-0fc2150d9b86 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:51.697811 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560fcfb-f9db-4b7a-b8c7-0fc2150d9b86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:51.699839 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560fcfb-f9db-4b7a-b8c7-0fc2150d9b86 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:51.706953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:51.727655 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1262/2508] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:47:51 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:47:51.729152 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278c625-c381-48b1-b93b-2a28620c53e8 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:51.740679 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278c625-c381-48b1-b93b-2a28620c53e8 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:51.745871 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0447ca-fcdf-4775-adf9-2d1c7e86322c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:51.746635 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0447ca-fcdf-4775-adf9-2d1c7e86322c admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:51.746984 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0447ca-fcdf-4775-adf9-2d1c7e86322c admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:51.747353 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0447ca-fcdf-4775-adf9-2d1c7e86322c admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:51.748157 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0447ca-fcdf-4775-adf9-2d1c7e86322c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:51.749874 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0447ca-fcdf-4775-adf9-2d1c7e86322c admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:51.760952 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1247/2509] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:47:51.765047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560fcfb-f9db-4b7a-b8c7-0fc2150d9b86 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:51.776322 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560fcfb-f9db-4b7a-b8c7-0fc2150d9b86 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:51.781071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf5cf7-dc60-4345-ab7a-4c4259d8fb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:51.781751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf5cf7-dc60-4345-ab7a-4c4259d8fb97 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:51.782036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf5cf7-dc60-4345-ab7a-4c4259d8fb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:51.782393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf5cf7-dc60-4345-ab7a-4c4259d8fb97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:51.783658 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf5cf7-dc60-4345-ab7a-4c4259d8fb97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:51.785277 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf5cf7-dc60-4345-ab7a-4c4259d8fb97 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:51.796026 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1263/2510] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:47:51.800158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0447ca-fcdf-4775-adf9-2d1c7e86322c admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:51.815348 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0447ca-fcdf-4775-adf9-2d1c7e86322c admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:51.823462 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874776cf-be76-4db2-a05a-f7b30497b7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:51.823462 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874776cf-be76-4db2-a05a-f7b30497b7da admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:51.823462 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874776cf-be76-4db2-a05a-f7b30497b7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:51.823462 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874776cf-be76-4db2-a05a-f7b30497b7da admin admin] PATH_INFO: `/v3/projects/43091208be574e6e8cc348667792f751/users/8d96e9d955934f0e883df57a3bcf934d/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:51.839816 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874776cf-be76-4db2-a05a-f7b30497b7da admin admin] RBAC: Authorizing `identity:create_grant(project_id=43091208be574e6e8cc348667792f751, user_id=8d96e9d955934f0e883df57a3bcf934d, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:51.842575 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874776cf-be76-4db2-a05a-f7b30497b7da admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:51.856965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1248/2511] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:47:51 2022] PUT /identity/v3/projects/43091208be574e6e8cc348667792f751/users/8d96e9d955934f0e883df57a3bcf934d/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:47:51.861734 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be591cbf-4fc3-4a03-87cd-40e22687ebb8 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:51.862024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be591cbf-4fc3-4a03-87cd-40e22687ebb8 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:51.862304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be591cbf-4fc3-4a03-87cd-40e22687ebb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:51.881654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-be591cbf-4fc3-4a03-87cd-40e22687ebb8 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:47:51.882925 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-be591cbf-4fc3-4a03-87cd-40e22687ebb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:51.944211 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1264/2512] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:47:51.956086 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874776cf-be76-4db2-a05a-f7b30497b7da admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:51.957878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-874776cf-be76-4db2-a05a-f7b30497b7da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:52.018424 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874776cf-be76-4db2-a05a-f7b30497b7da admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:52.022119 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5f113-b2ff-45d5-b5e9-c4f3743a1b1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:52.022769 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5f113-b2ff-45d5-b5e9-c4f3743a1b1d service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:52.023057 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5f113-b2ff-45d5-b5e9-c4f3743a1b1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:52.023438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5f113-b2ff-45d5-b5e9-c4f3743a1b1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:52.034290 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5f113-b2ff-45d5-b5e9-c4f3743a1b1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:52.035190 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5f113-b2ff-45d5-b5e9-c4f3743a1b1d service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:52.045497 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1249/2513] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:47:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:47:53.325318 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be591cbf-4fc3-4a03-87cd-40e22687ebb8 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:53.327126 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-be591cbf-4fc3-4a03-87cd-40e22687ebb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:53.432454 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be591cbf-4fc3-4a03-87cd-40e22687ebb8 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:53.440252 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256428fd-731a-448a-9c3b-952ac701691f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:53.441301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256428fd-731a-448a-9c3b-952ac701691f service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:53.441455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256428fd-731a-448a-9c3b-952ac701691f service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:53.441610 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256428fd-731a-448a-9c3b-952ac701691f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:53.443947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-256428fd-731a-448a-9c3b-952ac701691f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:53.468072 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256428fd-731a-448a-9c3b-952ac701691f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:53.470073 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256428fd-731a-448a-9c3b-952ac701691f service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:53.484724 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1265/2514] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:47:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:47:56.993055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bbea6-115f-473c-8efb-921939098452 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:56.993966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bbea6-115f-473c-8efb-921939098452 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:56.994454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bbea6-115f-473c-8efb-921939098452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:57.023019 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-ec1bbea6-115f-473c-8efb-921939098452 None None] MFA Rules not processed for user `8d96e9d955934f0e883df57a3bcf934d`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:47:57.024307 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-ec1bbea6-115f-473c-8efb-921939098452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:57.101175 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:57.105782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1250/2515] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:47:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:47:57.120996 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256428fd-731a-448a-9c3b-952ac701691f service nova] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:47:57.122400 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-256428fd-731a-448a-9c3b-952ac701691f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:57.137236 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256428fd-731a-448a-9c3b-952ac701691f service nova] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:47:57.143156 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a454a-4b57-4a1b-8d2a-42451c65b821 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:47:57.143930 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a454a-4b57-4a1b-8d2a-42451c65b821 service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:57.144218 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a454a-4b57-4a1b-8d2a-42451c65b821 service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:57.144499 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a454a-4b57-4a1b-8d2a-42451c65b821 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:57.153285 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a454a-4b57-4a1b-8d2a-42451c65b821 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:47:57.154898 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a454a-4b57-4a1b-8d2a-42451c65b821 service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:47:57.165127 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1266/2516] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:47:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:47:58.473778 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45459773-41ee-4c93-a423-95c7f783345f None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:47:58.474292 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45459773-41ee-4c93-a423-95c7f783345f None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:47:58.474292 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45459773-41ee-4c93-a423-95c7f783345f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:47:58.492382 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-45459773-41ee-4c93-a423-95c7f783345f None None] MFA Rules not processed for user `8d96e9d955934f0e883df57a3bcf934d`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:47:58.493579 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-45459773-41ee-4c93-a423-95c7f783345f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:47:58.500486 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1251/2517] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:47:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:48:07.161151 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:INSERT=3,keystone:SELECT=74 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:08.486852 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:43.962265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a13d6f-83f3-4ce2-b857-340777296413 None None] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:43.962842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a13d6f-83f3-4ce2-b857-340777296413 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:43.962842 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a13d6f-83f3-4ce2-b857-340777296413 None None] PATH_INFO: `/` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:43.964518 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1267/2518] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 09:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 09:48:43.970275 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10572ef-c2da-4f98-928b-19d93813ac0d None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:43.970755 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10572ef-c2da-4f98-928b-19d93813ac0d None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:43.970857 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10572ef-c2da-4f98-928b-19d93813ac0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:43.989689 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-a10572ef-c2da-4f98-928b-19d93813ac0d None None] MFA Rules not processed for user `c1103a08484048da82c5e4627552253e`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:48:43.990899 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-a10572ef-c2da-4f98-928b-19d93813ac0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:43.997447 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1252/2519] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 09:48:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:48:44.009976 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a13d6f-83f3-4ce2-b857-340777296413 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:44.011747 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-21a13d6f-83f3-4ce2-b857-340777296413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:44.025044 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a13d6f-83f3-4ce2-b857-340777296413 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:44.028636 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4d8a1-2cb9-42f8-a73b-d20ba617a4f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:44.029328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4d8a1-2cb9-42f8-a73b-d20ba617a4f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:44.029614 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4d8a1-2cb9-42f8-a73b-d20ba617a4f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:44.029896 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4d8a1-2cb9-42f8-a73b-d20ba617a4f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:44.037992 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4d8a1-2cb9-42f8-a73b-d20ba617a4f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:44.039489 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4d8a1-2cb9-42f8-a73b-d20ba617a4f5 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:44.048298 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1268/2520] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:48:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:48:44.135409 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccb1b6-e768-4391-9f02-3d0ea0d434ce None None] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:44.135704 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccb1b6-e768-4391-9f02-3d0ea0d434ce None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:44.135989 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccb1b6-e768-4391-9f02-3d0ea0d434ce None None] PATH_INFO: `/` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:44.137408 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1253/2521] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 09:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 09:48:44.142477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c312e9-1d7e-4d0a-9a9b-0ee02181e07b None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:44.142767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c312e9-1d7e-4d0a-9a9b-0ee02181e07b None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:44.143047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c312e9-1d7e-4d0a-9a9b-0ee02181e07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:44.160973 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-39c312e9-1d7e-4d0a-9a9b-0ee02181e07b None None] MFA Rules not processed for user `d2b1c12e88c549208894fc0dd0c60b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:48:44.162177 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-39c312e9-1d7e-4d0a-9a9b-0ee02181e07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:44.171359 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1269/2522] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 09:48:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:48:44.182009 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccb1b6-e768-4391-9f02-3d0ea0d434ce None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:44.193628 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccb1b6-e768-4391-9f02-3d0ea0d434ce None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:44.197213 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e86a4e-c34a-4e6f-9640-2fb48a24ee4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:44.197838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e86a4e-c34a-4e6f-9640-2fb48a24ee4e service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:44.198116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e86a4e-c34a-4e6f-9640-2fb48a24ee4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:44.198385 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e86a4e-c34a-4e6f-9640-2fb48a24ee4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:44.208354 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e86a4e-c34a-4e6f-9640-2fb48a24ee4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:44.209765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e86a4e-c34a-4e6f-9640-2fb48a24ee4e service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:44.220532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1254/2523] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:48:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:48:49.354408 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8aa9e4-6e46-4e60-8590-8c92b4ae9f93 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:49.355021 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8aa9e4-6e46-4e60-8590-8c92b4ae9f93 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:49.355021 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8aa9e4-6e46-4e60-8590-8c92b4ae9f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:49.373415 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-0a8aa9e4-6e46-4e60-8590-8c92b4ae9f93 None None] MFA Rules not processed for user `f52f0a03cc0f494d82a091bd885478e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:48:49.374639 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-0a8aa9e4-6e46-4e60-8590-8c92b4ae9f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:49.428039 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1270/2524] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 09:48:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:48:49.473424 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e86a4e-c34a-4e6f-9640-2fb48a24ee4e service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:49.474859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-64e86a4e-c34a-4e6f-9640-2fb48a24ee4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:49.542703 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e86a4e-c34a-4e6f-9640-2fb48a24ee4e service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:49.547559 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95dfc3-18fc-40db-9fc3-df7c95d251ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '351f74222d394f39bda0663e0e4ebde6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:49.548213 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95dfc3-18fc-40db-9fc3-df7c95d251ea service swift] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:49.548492 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95dfc3-18fc-40db-9fc3-df7c95d251ea service swift] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:49.548767 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95dfc3-18fc-40db-9fc3-df7c95d251ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:49.558752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95dfc3-18fc-40db-9fc3-df7c95d251ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:49.560376 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95dfc3-18fc-40db-9fc3-df7c95d251ea service swift] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:49.568707 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1255/2525] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 09:48:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:48:50.795522 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8aa9e4-6e46-4e60-8590-8c92b4ae9f93 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:50.806262 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8aa9e4-6e46-4e60-8590-8c92b4ae9f93 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:50.809893 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76628a1e-e5ad-4342-8aee-4613d09700f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:50.810538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76628a1e-e5ad-4342-8aee-4613d09700f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:50.810825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76628a1e-e5ad-4342-8aee-4613d09700f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:50.811106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76628a1e-e5ad-4342-8aee-4613d09700f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:50.812950 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-76628a1e-e5ad-4342-8aee-4613d09700f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:50.827970 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76628a1e-e5ad-4342-8aee-4613d09700f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:50.829463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76628a1e-e5ad-4342-8aee-4613d09700f9 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:50.846007 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1271/2526] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:48:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:48:51.154011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95dfc3-18fc-40db-9fc3-df7c95d251ea service swift] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:48:51.167637 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95dfc3-18fc-40db-9fc3-df7c95d251ea service swift] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:48:51.172287 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8277055-2f69-42d4-ba7d-f3b289aeb3c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:48:51.172926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8277055-2f69-42d4-ba7d-f3b289aeb3c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:48:51.173205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8277055-2f69-42d4-ba7d-f3b289aeb3c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:48:51.173476 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8277055-2f69-42d4-ba7d-f3b289aeb3c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:48:51.176102 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-c8277055-2f69-42d4-ba7d-f3b289aeb3c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:48:51.193403 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8277055-2f69-42d4-ba7d-f3b289aeb3c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:48:51.194839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8277055-2f69-42d4-ba7d-f3b289aeb3c7 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:48:51.206638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1256/2527] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:48:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:49:00.836473 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=40 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:01.201005 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=47 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:06.175068 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76628a1e-e5ad-4342-8aee-4613d09700f9 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:06.186890 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76628a1e-e5ad-4342-8aee-4613d09700f9 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:06.192421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b005eb8-7f84-424a-8eb2-9ba9a3acd36f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:06.193096 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b005eb8-7f84-424a-8eb2-9ba9a3acd36f service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:06.193473 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b005eb8-7f84-424a-8eb2-9ba9a3acd36f service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:06.193794 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b005eb8-7f84-424a-8eb2-9ba9a3acd36f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:06.195662 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-7b005eb8-7f84-424a-8eb2-9ba9a3acd36f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:06.280233 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b005eb8-7f84-424a-8eb2-9ba9a3acd36f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:06.281837 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b005eb8-7f84-424a-8eb2-9ba9a3acd36f service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:06.301318 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1272/2528] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:49:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:49:06.841458 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e84744-c2bf-47f3-9cc6-33c387b009fa None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:06.841943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e84744-c2bf-47f3-9cc6-33c387b009fa None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:06.842045 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e84744-c2bf-47f3-9cc6-33c387b009fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:06.858967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-26e84744-c2bf-47f3-9cc6-33c387b009fa None None] MFA Rules not processed for user `f52f0a03cc0f494d82a091bd885478e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:06.860113 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-26e84744-c2bf-47f3-9cc6-33c387b009fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:06.867182 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1257/2529] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 09:49:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:06.879785 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b005eb8-7f84-424a-8eb2-9ba9a3acd36f service nova] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:06.890651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b005eb8-7f84-424a-8eb2-9ba9a3acd36f service nova] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:06.896101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45af57-0d47-4b5b-b699-79e61d9965ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '351f74222d394f39bda0663e0e4ebde6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:06.896732 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45af57-0d47-4b5b-b699-79e61d9965ee service swift] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:06.897017 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45af57-0d47-4b5b-b699-79e61d9965ee service swift] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:06.897291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45af57-0d47-4b5b-b699-79e61d9965ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:06.905073 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45af57-0d47-4b5b-b699-79e61d9965ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:06.906637 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45af57-0d47-4b5b-b699-79e61d9965ee service swift] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:06.914527 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1273/2530] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 09:49:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:49:16.854189 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:16.911407 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=47 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:21.212728 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e84744-c2bf-47f3-9cc6-33c387b009fa None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:21.226097 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e84744-c2bf-47f3-9cc6-33c387b009fa None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:21.231476 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345b49e-e03c-4890-bd25-355ddd0538da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:21.232106 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345b49e-e03c-4890-bd25-355ddd0538da service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:21.232389 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345b49e-e03c-4890-bd25-355ddd0538da service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:21.232666 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345b49e-e03c-4890-bd25-355ddd0538da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:21.234430 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e345b49e-e03c-4890-bd25-355ddd0538da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:21.313693 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345b49e-e03c-4890-bd25-355ddd0538da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:21.315297 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345b49e-e03c-4890-bd25-355ddd0538da service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:21.333782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1258/2531] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:49:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:49:25.879774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45af57-0d47-4b5b-b699-79e61d9965ee service swift] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:25.889032 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45af57-0d47-4b5b-b699-79e61d9965ee service swift] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:25.892639 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01680c48-f1e3-47b2-b4cb-595543629840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:25.893280 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01680c48-f1e3-47b2-b4cb-595543629840 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:25.893565 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01680c48-f1e3-47b2-b4cb-595543629840 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:25.893843 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01680c48-f1e3-47b2-b4cb-595543629840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:25.895637 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-01680c48-f1e3-47b2-b4cb-595543629840 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:25.904947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01680c48-f1e3-47b2-b4cb-595543629840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:25.906374 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01680c48-f1e3-47b2-b4cb-595543629840 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:25.914260 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1274/2532] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:49:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:49:27.690590 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137ede8-5de2-42b7-98ef-056e344748c9 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:27.691593 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137ede8-5de2-42b7-98ef-056e344748c9 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:27.691692 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137ede8-5de2-42b7-98ef-056e344748c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:27.709472 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-3137ede8-5de2-42b7-98ef-056e344748c9 None None] MFA Rules not processed for user `f52f0a03cc0f494d82a091bd885478e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:27.710645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-3137ede8-5de2-42b7-98ef-056e344748c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:27.717888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1259/2533] 10.222.0.41 () {58 vars in 967 bytes} [Fri May 27 09:49:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:27.729741 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01680c48-f1e3-47b2-b4cb-595543629840 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:27.741508 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01680c48-f1e3-47b2-b4cb-595543629840 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:27.746406 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c503c-7934-4c11-94e8-118950371b01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '351f74222d394f39bda0663e0e4ebde6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:27.747034 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c503c-7934-4c11-94e8-118950371b01 service swift] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:27.747342 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c503c-7934-4c11-94e8-118950371b01 service swift] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:27.747617 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c503c-7934-4c11-94e8-118950371b01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:27.755971 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c503c-7934-4c11-94e8-118950371b01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:27.757539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c503c-7934-4c11-94e8-118950371b01 service swift] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:27.765375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1275/2534] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 09:49:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 09:49:37.703830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=44 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:37.762198 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=12 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:47.336200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137ede8-5de2-42b7-98ef-056e344748c9 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:47.350731 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137ede8-5de2-42b7-98ef-056e344748c9 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:47.356434 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953d06b-966c-4253-8a62-6240d0c9055a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:47.357092 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953d06b-966c-4253-8a62-6240d0c9055a service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:47.357383 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953d06b-966c-4253-8a62-6240d0c9055a service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:47.357794 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953d06b-966c-4253-8a62-6240d0c9055a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:47.359714 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-9953d06b-966c-4253-8a62-6240d0c9055a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:47.372723 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953d06b-966c-4253-8a62-6240d0c9055a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:47.374359 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953d06b-966c-4253-8a62-6240d0c9055a service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:47.386040 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1260/2535] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:49:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:49:53.189306 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c503c-7934-4c11-94e8-118950371b01 service swift] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:53.198767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c503c-7934-4c11-94e8-118950371b01 service swift] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:53.202291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8fe55-2f88-4d0f-a2ee-471b477d7ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:53.202927 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8fe55-2f88-4d0f-a2ee-471b477d7ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:53.203240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8fe55-2f88-4d0f-a2ee-471b477d7ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:53.203537 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8fe55-2f88-4d0f-a2ee-471b477d7ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:53.205271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-89c8fe55-2f88-4d0f-a2ee-471b477d7ab2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:53.216799 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8fe55-2f88-4d0f-a2ee-471b477d7ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:53.218218 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8fe55-2f88-4d0f-a2ee-471b477d7ab2 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:53.228052 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1276/2536] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:49:56.433747 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953d06b-966c-4253-8a62-6240d0c9055a service nova] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:56.435265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-9953d06b-966c-4253-8a62-6240d0c9055a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:56.445802 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8fe55-2f88-4d0f-a2ee-471b477d7ab2 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:56.447420 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-89c8fe55-2f88-4d0f-a2ee-471b477d7ab2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:56.463490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8fe55-2f88-4d0f-a2ee-471b477d7ab2 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:56.468423 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a82e9-79ba-4f09-80a3-75969c3ac0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:56.469293 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a82e9-79ba-4f09-80a3-75969c3ac0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:56.469579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a82e9-79ba-4f09-80a3-75969c3ac0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:56.469857 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a82e9-79ba-4f09-80a3-75969c3ac0eb admin admin] PATH_INFO: `/v3/users/2463c2327e364ca996768e3eb6ef6316` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:56.471048 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a82e9-79ba-4f09-80a3-75969c3ac0eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2463c2327e364ca996768e3eb6ef6316)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:56.473085 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a82e9-79ba-4f09-80a3-75969c3ac0eb admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:56.525998 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-9b7a82e9-79ba-4f09-80a3-75969c3ac0eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2463c2327e364ca996768e3eb6ef6316'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:56.526916 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-9b7a82e9-79ba-4f09-80a3-75969c3ac0eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2463c2327e364ca996768e3eb6ef6316'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:56.530989 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953d06b-966c-4253-8a62-6240d0c9055a service nova] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:56.535753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-9b7a82e9-79ba-4f09-80a3-75969c3ac0eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2463c2327e364ca996768e3eb6ef6316'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:56.536295 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-9b7a82e9-79ba-4f09-80a3-75969c3ac0eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2463c2327e364ca996768e3eb6ef6316'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:56.537366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83feeae0-73d7-489d-87bc-518e732d3e36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746fd8ed517446fe89c53df873abb2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:56.538101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83feeae0-73d7-489d-87bc-518e732d3e36 service placement] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:56.539008 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83feeae0-73d7-489d-87bc-518e732d3e36 service placement] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:56.539494 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83feeae0-73d7-489d-87bc-518e732d3e36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:56.549303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-83feeae0-73d7-489d-87bc-518e732d3e36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:56.552479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-9b7a82e9-79ba-4f09-80a3-75969c3ac0eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2463c2327e364ca996768e3eb6ef6316'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:56.561625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83feeae0-73d7-489d-87bc-518e732d3e36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:56.563511 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83feeae0-73d7-489d-87bc-518e732d3e36 service placement] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:56.565478 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1277/2537] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:49:56 2022] DELETE /identity/v3/users/2463c2327e364ca996768e3eb6ef6316 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:49:56.576172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1261/2538] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:49:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:49:56.739641 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a82e9-79ba-4f09-80a3-75969c3ac0eb admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:56.741873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-9b7a82e9-79ba-4f09-80a3-75969c3ac0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:56.814403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a82e9-79ba-4f09-80a3-75969c3ac0eb admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:56.818909 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcefc3a-0562-4f99-8e5c-d419347f32a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:56.820449 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcefc3a-0562-4f99-8e5c-d419347f32a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:56.820710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcefc3a-0562-4f99-8e5c-d419347f32a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:56.820981 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcefc3a-0562-4f99-8e5c-d419347f32a5 admin admin] PATH_INFO: `/v3/projects/06332dc6f29b4d01b047104d93bbef0f` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:56.822139 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcefc3a-0562-4f99-8e5c-d419347f32a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06332dc6f29b4d01b047104d93bbef0f)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:56.824155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcefc3a-0562-4f99-8e5c-d419347f32a5 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:56.869864 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-5dcefc3a-0562-4f99-8e5c-d419347f32a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06332dc6f29b4d01b047104d93bbef0f', 'request_id': 'req-5dcefc3a-0562-4f99-8e5c-d419347f32a5'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:56.878051 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-5dcefc3a-0562-4f99-8e5c-d419347f32a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06332dc6f29b4d01b047104d93bbef0f', 'request_id': 'req-5dcefc3a-0562-4f99-8e5c-d419347f32a5'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:56.882878 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:56.884914 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-5dcefc3a-0562-4f99-8e5c-d419347f32a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06332dc6f29b4d01b047104d93bbef0f', 'request_id': 'req-5dcefc3a-0562-4f99-8e5c-d419347f32a5'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:56.898168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-5dcefc3a-0562-4f99-8e5c-d419347f32a5 admin admin] The token cache is being invalidate because project 06332dc6f29b4d01b047104d93bbef0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:49:56.898462 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-5dcefc3a-0562-4f99-8e5c-d419347f32a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:56.899094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-5dcefc3a-0562-4f99-8e5c-d419347f32a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:56.900673 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1278/2539] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:49:56 2022] DELETE /identity/v3/projects/06332dc6f29b4d01b047104d93bbef0f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:49:56.905585 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c1945-1678-419b-af97-5fa57ca413b6 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:56.905878 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c1945-1678-419b-af97-5fa57ca413b6 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:56.906157 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c1945-1678-419b-af97-5fa57ca413b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:56.924263 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-947c1945-1678-419b-af97-5fa57ca413b6 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:56.925386 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-947c1945-1678-419b-af97-5fa57ca413b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:56.983941 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1262/2540] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:56.991798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28f8a8-300a-429b-b9ce-b96df2b25902 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:56.992087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28f8a8-300a-429b-b9ce-b96df2b25902 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:56.992370 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28f8a8-300a-429b-b9ce-b96df2b25902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:57.010662 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-aa28f8a8-300a-429b-b9ce-b96df2b25902 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:57.011896 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-aa28f8a8-300a-429b-b9ce-b96df2b25902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:57.019844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1279/2541] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:57.024440 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c1945-1678-419b-af97-5fa57ca413b6 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:57.034066 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c1945-1678-419b-af97-5fa57ca413b6 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:57.040906 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810eac4-d008-42dd-befb-35367fc5892a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:57.041564 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810eac4-d008-42dd-befb-35367fc5892a admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:57.041850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810eac4-d008-42dd-befb-35367fc5892a admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:57.042127 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810eac4-d008-42dd-befb-35367fc5892a admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:57.042850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810eac4-d008-42dd-befb-35367fc5892a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:49:57.043161 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810eac4-d008-42dd-befb-35367fc5892a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:57.044779 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810eac4-d008-42dd-befb-35367fc5892a admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:57.056289 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1263/2542] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:49:57.060469 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28f8a8-300a-429b-b9ce-b96df2b25902 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:57.070404 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28f8a8-300a-429b-b9ce-b96df2b25902 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:57.074986 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5a181-497f-4212-9435-930d4a9429c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:57.075665 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5a181-497f-4212-9435-930d4a9429c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:57.075947 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5a181-497f-4212-9435-930d4a9429c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:57.076219 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5a181-497f-4212-9435-930d4a9429c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:57.076899 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c5a181-497f-4212-9435-930d4a9429c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:57.078793 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c5a181-497f-4212-9435-930d4a9429c0 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:57.104025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1280/2543] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:49:57 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:49:57.108283 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810eac4-d008-42dd-befb-35367fc5892a admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:57.118437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810eac4-d008-42dd-befb-35367fc5892a admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:57.177947 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcd32b-ab2f-4319-9687-a04d910903e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:57.178610 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcd32b-ab2f-4319-9687-a04d910903e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:57.179501 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcd32b-ab2f-4319-9687-a04d910903e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:57.179781 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcd32b-ab2f-4319-9687-a04d910903e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:57.180483 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dcd32b-ab2f-4319-9687-a04d910903e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:57.182421 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dcd32b-ab2f-4319-9687-a04d910903e9 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:57.199091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:57.212830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1264/2544] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:49:57 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:49:57.217154 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5a181-497f-4212-9435-930d4a9429c0 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:57.227855 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5a181-497f-4212-9435-930d4a9429c0 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:57.232649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d2d85-29d1-416e-b58c-24eb9c967ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:57.233401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d2d85-29d1-416e-b58c-24eb9c967ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:57.233913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d2d85-29d1-416e-b58c-24eb9c967ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:57.234300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d2d85-29d1-416e-b58c-24eb9c967ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:57.235199 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d2d85-29d1-416e-b58c-24eb9c967ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:57.237004 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d2d85-29d1-416e-b58c-24eb9c967ef7 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:57.248666 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1281/2545] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:49:57.252748 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcd32b-ab2f-4319-9687-a04d910903e9 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:57.263490 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcd32b-ab2f-4319-9687-a04d910903e9 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:57.268067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8c1da-900b-49b7-9d2d-2a2c7de60cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:57.268721 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8c1da-900b-49b7-9d2d-2a2c7de60cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:57.269007 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8c1da-900b-49b7-9d2d-2a2c7de60cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:57.269278 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8c1da-900b-49b7-9d2d-2a2c7de60cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:57.269995 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8c1da-900b-49b7-9d2d-2a2c7de60cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:57.271679 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8c1da-900b-49b7-9d2d-2a2c7de60cf9 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:57.286546 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1265/2546] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:49:57.287793 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d2d85-29d1-416e-b58c-24eb9c967ef7 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:57.301025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d2d85-29d1-416e-b58c-24eb9c967ef7 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:57.311817 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5383082-a388-4b08-8110-9fe8aa7cc04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:57.312731 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5383082-a388-4b08-8110-9fe8aa7cc04d admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:57.313013 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5383082-a388-4b08-8110-9fe8aa7cc04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:57.313292 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5383082-a388-4b08-8110-9fe8aa7cc04d admin admin] PATH_INFO: `/v3/projects/c6be9af66b7048778fd5b823a1535450/users/426d1d2e2b7245afbd688b174059dce5/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:57.330259 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5383082-a388-4b08-8110-9fe8aa7cc04d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6be9af66b7048778fd5b823a1535450, user_id=426d1d2e2b7245afbd688b174059dce5, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:57.333003 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5383082-a388-4b08-8110-9fe8aa7cc04d admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:57.349045 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1282/2547] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:49:57 2022] PUT /identity/v3/projects/c6be9af66b7048778fd5b823a1535450/users/426d1d2e2b7245afbd688b174059dce5/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:49:57.360315 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfb8f8-5ae4-408b-8e14-a6c05fd5e275 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:57.360603 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfb8f8-5ae4-408b-8e14-a6c05fd5e275 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:57.360873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfb8f8-5ae4-408b-8e14-a6c05fd5e275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:57.390186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-f2bfb8f8-5ae4-408b-8e14-a6c05fd5e275 None None] MFA Rules not processed for user `426d1d2e2b7245afbd688b174059dce5`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:57.391477 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f2bfb8f8-5ae4-408b-8e14-a6c05fd5e275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:57.457742 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1266/2548] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:49:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:57.469790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5383082-a388-4b08-8110-9fe8aa7cc04d admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:57.471528 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-b5383082-a388-4b08-8110-9fe8aa7cc04d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:57.544624 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5383082-a388-4b08-8110-9fe8aa7cc04d admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:57.550165 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2e5bc-86bb-4bdc-8e20-bd540c20e5b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:57.550943 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2e5bc-86bb-4bdc-8e20-bd540c20e5b1 service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:57.551237 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2e5bc-86bb-4bdc-8e20-bd540c20e5b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:57.551552 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2e5bc-86bb-4bdc-8e20-bd540c20e5b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:57.560591 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2e5bc-86bb-4bdc-8e20-bd540c20e5b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:57.562203 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2e5bc-86bb-4bdc-8e20-bd540c20e5b1 service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:57.571937 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1283/2549] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:49:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:49:57.783178 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfb8f8-5ae4-408b-8e14-a6c05fd5e275 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:57.848124 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfb8f8-5ae4-408b-8e14-a6c05fd5e275 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:57.853163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478abbd9-e63e-42d7-b493-9620fd635616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:57.854030 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478abbd9-e63e-42d7-b493-9620fd635616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:57.854407 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478abbd9-e63e-42d7-b493-9620fd635616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:57.854708 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478abbd9-e63e-42d7-b493-9620fd635616 admin admin] PATH_INFO: `/v3/users/426d1d2e2b7245afbd688b174059dce5` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:57.855904 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478abbd9-e63e-42d7-b493-9620fd635616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=426d1d2e2b7245afbd688b174059dce5)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:57.857822 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478abbd9-e63e-42d7-b493-9620fd635616 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:57.907085 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-478abbd9-e63e-42d7-b493-9620fd635616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '426d1d2e2b7245afbd688b174059dce5'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:57.915352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-478abbd9-e63e-42d7-b493-9620fd635616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '426d1d2e2b7245afbd688b174059dce5'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:57.916093 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-478abbd9-e63e-42d7-b493-9620fd635616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '426d1d2e2b7245afbd688b174059dce5'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:57.929741 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-478abbd9-e63e-42d7-b493-9620fd635616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '426d1d2e2b7245afbd688b174059dce5'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:57.931465 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:INSERT=1,keystone:SELECT=90,keystone:DELETE=9 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:57.938399 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-478abbd9-e63e-42d7-b493-9620fd635616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '426d1d2e2b7245afbd688b174059dce5'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:57.946918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1267/2550] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:49:57 2022] DELETE /identity/v3/users/426d1d2e2b7245afbd688b174059dce5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:49:57.951561 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eaf0b5-5f1d-4615-94b7-2922282e80a8 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:57.951900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eaf0b5-5f1d-4615-94b7-2922282e80a8 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:57.952140 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eaf0b5-5f1d-4615-94b7-2922282e80a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:57.970682 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-28eaf0b5-5f1d-4615-94b7-2922282e80a8 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:57.971896 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-28eaf0b5-5f1d-4615-94b7-2922282e80a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:58.031466 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1284/2551] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:58.041549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478abbd9-e63e-42d7-b493-9620fd635616 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:58.043016 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-478abbd9-e63e-42d7-b493-9620fd635616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:58.106292 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478abbd9-e63e-42d7-b493-9620fd635616 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:58.109948 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a753792-02dd-4bf1-8194-4ec7667ffd5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:58.110592 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a753792-02dd-4bf1-8194-4ec7667ffd5f service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:58.110871 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a753792-02dd-4bf1-8194-4ec7667ffd5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:58.111150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a753792-02dd-4bf1-8194-4ec7667ffd5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:58.120681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a753792-02dd-4bf1-8194-4ec7667ffd5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:58.122173 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a753792-02dd-4bf1-8194-4ec7667ffd5f service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:58.131572 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1268/2552] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:49:58.392277 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eaf0b5-5f1d-4615-94b7-2922282e80a8 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:58.394012 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-28eaf0b5-5f1d-4615-94b7-2922282e80a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:58.407549 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eaf0b5-5f1d-4615-94b7-2922282e80a8 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:58.414472 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b555f28-1a2e-411f-9c7d-110862e12559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:58.415388 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b555f28-1a2e-411f-9c7d-110862e12559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:58.415675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b555f28-1a2e-411f-9c7d-110862e12559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:58.415950 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b555f28-1a2e-411f-9c7d-110862e12559 admin admin] PATH_INFO: `/v3/projects/c6be9af66b7048778fd5b823a1535450` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:58.417169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b555f28-1a2e-411f-9c7d-110862e12559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6be9af66b7048778fd5b823a1535450)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:58.419127 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b555f28-1a2e-411f-9c7d-110862e12559 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:58.427614 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:58.473834 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-7b555f28-1a2e-411f-9c7d-110862e12559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6be9af66b7048778fd5b823a1535450', 'request_id': 'req-7b555f28-1a2e-411f-9c7d-110862e12559'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:58.482230 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-7b555f28-1a2e-411f-9c7d-110862e12559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6be9af66b7048778fd5b823a1535450', 'request_id': 'req-7b555f28-1a2e-411f-9c7d-110862e12559'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:58.487958 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-7b555f28-1a2e-411f-9c7d-110862e12559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6be9af66b7048778fd5b823a1535450', 'request_id': 'req-7b555f28-1a2e-411f-9c7d-110862e12559'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:58.500253 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-7b555f28-1a2e-411f-9c7d-110862e12559 admin admin] The token cache is being invalidate because project c6be9af66b7048778fd5b823a1535450 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:49:58.500543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-7b555f28-1a2e-411f-9c7d-110862e12559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:58.501212 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-7b555f28-1a2e-411f-9c7d-110862e12559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:49:58.502844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1285/2553] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:49:58 2022] DELETE /identity/v3/projects/c6be9af66b7048778fd5b823a1535450 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:49:58.508801 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff965b-6cc8-475c-be83-dca248285f99 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:58.509279 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff965b-6cc8-475c-be83-dca248285f99 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:58.509401 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff965b-6cc8-475c-be83-dca248285f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:58.527608 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-46ff965b-6cc8-475c-be83-dca248285f99 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:58.528867 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-46ff965b-6cc8-475c-be83-dca248285f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:58.588636 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1269/2554] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:58.596324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a276c84-98d2-4b48-8658-70ff1c8af714 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:58.596613 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a276c84-98d2-4b48-8658-70ff1c8af714 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:58.596892 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a276c84-98d2-4b48-8658-70ff1c8af714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:58.615513 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-5a276c84-98d2-4b48-8658-70ff1c8af714 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:58.617306 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-5a276c84-98d2-4b48-8658-70ff1c8af714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:58.625013 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1286/2555] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:58.629058 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff965b-6cc8-475c-be83-dca248285f99 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:58.638539 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff965b-6cc8-475c-be83-dca248285f99 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:58.642958 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99683bd0-5ba3-446e-a577-9ec24b3b4c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:58.643653 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99683bd0-5ba3-446e-a577-9ec24b3b4c58 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:58.643957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99683bd0-5ba3-446e-a577-9ec24b3b4c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:58.644207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99683bd0-5ba3-446e-a577-9ec24b3b4c58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:58.644913 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99683bd0-5ba3-446e-a577-9ec24b3b4c58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:49:58.645219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99683bd0-5ba3-446e-a577-9ec24b3b4c58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:58.646797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99683bd0-5ba3-446e-a577-9ec24b3b4c58 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:58.658264 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1270/2556] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:49:58.662226 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a276c84-98d2-4b48-8658-70ff1c8af714 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:58.671923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a276c84-98d2-4b48-8658-70ff1c8af714 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:58.676943 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf50c9-4b2e-444f-baea-503267322a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:58.677578 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf50c9-4b2e-444f-baea-503267322a83 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:58.677860 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf50c9-4b2e-444f-baea-503267322a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:58.678133 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf50c9-4b2e-444f-baea-503267322a83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:58.679481 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf50c9-4b2e-444f-baea-503267322a83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:58.681440 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf50c9-4b2e-444f-baea-503267322a83 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:58.706594 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1287/2557] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:49:58 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:49:58.711260 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99683bd0-5ba3-446e-a577-9ec24b3b4c58 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:58.721747 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99683bd0-5ba3-446e-a577-9ec24b3b4c58 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:58.779368 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb7e77-8b58-4d8a-9336-d6653550eeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:58.780044 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb7e77-8b58-4d8a-9336-d6653550eeda admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:58.780329 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb7e77-8b58-4d8a-9336-d6653550eeda admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:58.780603 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb7e77-8b58-4d8a-9336-d6653550eeda admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:58.781278 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb7e77-8b58-4d8a-9336-d6653550eeda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:58.783196 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb7e77-8b58-4d8a-9336-d6653550eeda admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:58.806858 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1271/2558] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:49:58 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:49:58.808038 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf50c9-4b2e-444f-baea-503267322a83 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:58.818035 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf50c9-4b2e-444f-baea-503267322a83 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:58.822858 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80b59e-983f-4962-935d-f014b64eaafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:58.823555 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80b59e-983f-4962-935d-f014b64eaafc admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:58.823844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80b59e-983f-4962-935d-f014b64eaafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:58.824123 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80b59e-983f-4962-935d-f014b64eaafc admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:58.824858 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80b59e-983f-4962-935d-f014b64eaafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:58.826468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80b59e-983f-4962-935d-f014b64eaafc admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:58.838305 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1288/2559] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:49:58.842617 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb7e77-8b58-4d8a-9336-d6653550eeda admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:58.852997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb7e77-8b58-4d8a-9336-d6653550eeda admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:58.857573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051456a-32ce-43c6-8a0a-4b4761d1af36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:58.858219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051456a-32ce-43c6-8a0a-4b4761d1af36 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:58.858500 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051456a-32ce-43c6-8a0a-4b4761d1af36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:58.858776 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051456a-32ce-43c6-8a0a-4b4761d1af36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:58.859516 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051456a-32ce-43c6-8a0a-4b4761d1af36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:58.861079 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051456a-32ce-43c6-8a0a-4b4761d1af36 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:58.866164 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:58.872589 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1272/2560] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:49:58.876017 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80b59e-983f-4962-935d-f014b64eaafc admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:58.886200 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80b59e-983f-4962-935d-f014b64eaafc admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:58.890802 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27712b-b33d-42ef-916b-ccc4d0496244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:58.891723 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27712b-b33d-42ef-916b-ccc4d0496244 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:58.892002 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27712b-b33d-42ef-916b-ccc4d0496244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:58.892275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27712b-b33d-42ef-916b-ccc4d0496244 admin admin] PATH_INFO: `/v3/projects/74747559eccd42619d007dcc0609b6a5/users/27f0ba5d00bb42299bad85ffb447b744/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:58.907235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27712b-b33d-42ef-916b-ccc4d0496244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74747559eccd42619d007dcc0609b6a5, user_id=27f0ba5d00bb42299bad85ffb447b744, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:58.909953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27712b-b33d-42ef-916b-ccc4d0496244 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:58.923303 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1289/2561] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:49:58 2022] PUT /identity/v3/projects/74747559eccd42619d007dcc0609b6a5/users/27f0ba5d00bb42299bad85ffb447b744/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:49:58.933932 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75161cb2-be02-4e28-a6b4-86c1dbf3201c None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:58.934222 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75161cb2-be02-4e28-a6b4-86c1dbf3201c None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:58.934493 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75161cb2-be02-4e28-a6b4-86c1dbf3201c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:58.960772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-75161cb2-be02-4e28-a6b4-86c1dbf3201c None None] MFA Rules not processed for user `27f0ba5d00bb42299bad85ffb447b744`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:58.961963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-75161cb2-be02-4e28-a6b4-86c1dbf3201c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:59.037116 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1273/2562] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:49:58 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:59.041508 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27712b-b33d-42ef-916b-ccc4d0496244 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:59.105717 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27712b-b33d-42ef-916b-ccc4d0496244 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:59.110265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d389cb6-0258-4a0f-aa5f-c6a6c78c4e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:59.110913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d389cb6-0258-4a0f-aa5f-c6a6c78c4e69 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:59.111193 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d389cb6-0258-4a0f-aa5f-c6a6c78c4e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:59.111494 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d389cb6-0258-4a0f-aa5f-c6a6c78c4e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:59.112172 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d389cb6-0258-4a0f-aa5f-c6a6c78c4e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:59.114061 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d389cb6-0258-4a0f-aa5f-c6a6c78c4e69 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:59.138946 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1290/2563] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:49:59 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:49:59.143012 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75161cb2-be02-4e28-a6b4-86c1dbf3201c None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:59.153872 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75161cb2-be02-4e28-a6b4-86c1dbf3201c None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:59.210400 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a70bd-ce8e-4ec8-bf9f-a7fdd985c748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:59.211072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a70bd-ce8e-4ec8-bf9f-a7fdd985c748 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:59.211385 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a70bd-ce8e-4ec8-bf9f-a7fdd985c748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:59.211662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a70bd-ce8e-4ec8-bf9f-a7fdd985c748 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:59.212338 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a70bd-ce8e-4ec8-bf9f-a7fdd985c748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:59.214489 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a70bd-ce8e-4ec8-bf9f-a7fdd985c748 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:59.233949 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1274/2564] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:49:59 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:49:59.237901 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d389cb6-0258-4a0f-aa5f-c6a6c78c4e69 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:59.248880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d389cb6-0258-4a0f-aa5f-c6a6c78c4e69 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:59.253533 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3895114-de6b-4ea5-bfda-2e78762c974a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:59.254180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3895114-de6b-4ea5-bfda-2e78762c974a admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:59.254461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3895114-de6b-4ea5-bfda-2e78762c974a admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:59.254745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3895114-de6b-4ea5-bfda-2e78762c974a admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:59.255526 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3895114-de6b-4ea5-bfda-2e78762c974a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:59.257926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3895114-de6b-4ea5-bfda-2e78762c974a admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:59.268188 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1291/2565] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:49:59.272312 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a70bd-ce8e-4ec8-bf9f-a7fdd985c748 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:59.282827 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a70bd-ce8e-4ec8-bf9f-a7fdd985c748 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:59.287524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602281c7-51b1-43d3-954d-fcc3c14326bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:59.288347 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602281c7-51b1-43d3-954d-fcc3c14326bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:59.288631 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602281c7-51b1-43d3-954d-fcc3c14326bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:59.288910 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602281c7-51b1-43d3-954d-fcc3c14326bc admin admin] PATH_INFO: `/v3/projects/ac2431074251485da1041f4c66985d8d/users/90ce4d1142fb432d99953108e387c872/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:59.304609 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602281c7-51b1-43d3-954d-fcc3c14326bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac2431074251485da1041f4c66985d8d, user_id=90ce4d1142fb432d99953108e387c872, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:59.307299 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602281c7-51b1-43d3-954d-fcc3c14326bc admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:59.320713 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1275/2566] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:49:59 2022] PUT /identity/v3/projects/ac2431074251485da1041f4c66985d8d/users/90ce4d1142fb432d99953108e387c872/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:49:59.324734 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3895114-de6b-4ea5-bfda-2e78762c974a admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:59.330974 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:59.335678 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3895114-de6b-4ea5-bfda-2e78762c974a admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:59.393805 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d098de8-5636-499c-9b8a-3501c1d9fa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:59.394479 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d098de8-5636-499c-9b8a-3501c1d9fa97 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:59.394768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d098de8-5636-499c-9b8a-3501c1d9fa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:59.395048 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d098de8-5636-499c-9b8a-3501c1d9fa97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:59.395803 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d098de8-5636-499c-9b8a-3501c1d9fa97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:59.397399 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d098de8-5636-499c-9b8a-3501c1d9fa97 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:59.407850 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1292/2567] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:49:59.411963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602281c7-51b1-43d3-954d-fcc3c14326bc admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:59.422470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602281c7-51b1-43d3-954d-fcc3c14326bc admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:59.427106 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2a6ce-4b35-4fd6-8802-16fe1c8bd2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:59.428101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2a6ce-4b35-4fd6-8802-16fe1c8bd2c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:59.428446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2a6ce-4b35-4fd6-8802-16fe1c8bd2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:59.429288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2a6ce-4b35-4fd6-8802-16fe1c8bd2c3 admin admin] PATH_INFO: `/v3/projects/ac2431074251485da1041f4c66985d8d/users/90ce4d1142fb432d99953108e387c872/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:59.431381 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2a6ce-4b35-4fd6-8802-16fe1c8bd2c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac2431074251485da1041f4c66985d8d, user_id=90ce4d1142fb432d99953108e387c872, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:59.434066 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2a6ce-4b35-4fd6-8802-16fe1c8bd2c3 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:59.445299 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1276/2568] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:49:59 2022] PUT /identity/v3/projects/ac2431074251485da1041f4c66985d8d/users/90ce4d1142fb432d99953108e387c872/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:49:59.457207 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f825b-3aac-4114-a6d6-20b7e0078c8b None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:59.457499 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f825b-3aac-4114-a6d6-20b7e0078c8b None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:59.457781 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f825b-3aac-4114-a6d6-20b7e0078c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:59.484095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-f25f825b-3aac-4114-a6d6-20b7e0078c8b None None] MFA Rules not processed for user `90ce4d1142fb432d99953108e387c872`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:49:59.485310 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f25f825b-3aac-4114-a6d6-20b7e0078c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:59.553353 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1293/2569] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:49:59 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:49:59.565985 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2a6ce-4b35-4fd6-8802-16fe1c8bd2c3 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:49:59.567861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-2ae2a6ce-4b35-4fd6-8802-16fe1c8bd2c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:49:59.614069 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:59.626798 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2a6ce-4b35-4fd6-8802-16fe1c8bd2c3 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:49:59.630483 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fe749-ebd3-4146-abec-d3bb9fa22007 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:49:59.631117 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fe749-ebd3-4146-abec-d3bb9fa22007 service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:49:59.631450 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fe749-ebd3-4146-abec-d3bb9fa22007 service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:49:59.631729 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fe749-ebd3-4146-abec-d3bb9fa22007 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:49:59.641242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fe749-ebd3-4146-abec-d3bb9fa22007 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:49:59.642667 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fe749-ebd3-4146-abec-d3bb9fa22007 service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:49:59.651976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1277/2570] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:49:59 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:00.056545 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f825b-3aac-4114-a6d6-20b7e0078c8b None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:00.120850 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f825b-3aac-4114-a6d6-20b7e0078c8b None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:00.127050 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afdba2-7461-4332-8467-da5bf572e36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:00.127963 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afdba2-7461-4332-8467-da5bf572e36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:00.128241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afdba2-7461-4332-8467-da5bf572e36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:00.128509 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afdba2-7461-4332-8467-da5bf572e36e admin admin] PATH_INFO: `/v3/users/27f0ba5d00bb42299bad85ffb447b744` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:00.129704 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afdba2-7461-4332-8467-da5bf572e36e admin admin] RBAC: Authorizing `identity:delete_user(user_id=27f0ba5d00bb42299bad85ffb447b744)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:00.132470 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afdba2-7461-4332-8467-da5bf572e36e admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:00.161312 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:00.179295 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-49afdba2-7461-4332-8467-da5bf572e36e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27f0ba5d00bb42299bad85ffb447b744'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:00.179938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-49afdba2-7461-4332-8467-da5bf572e36e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27f0ba5d00bb42299bad85ffb447b744'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:00.186598 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-49afdba2-7461-4332-8467-da5bf572e36e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27f0ba5d00bb42299bad85ffb447b744'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:00.187209 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-49afdba2-7461-4332-8467-da5bf572e36e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27f0ba5d00bb42299bad85ffb447b744'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:00.199149 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-49afdba2-7461-4332-8467-da5bf572e36e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27f0ba5d00bb42299bad85ffb447b744'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:00.211801 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1294/2571] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:50:00 2022] DELETE /identity/v3/users/27f0ba5d00bb42299bad85ffb447b744 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:00.216620 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48f6af-0256-43b6-92a5-8159805a424e None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:00.216943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48f6af-0256-43b6-92a5-8159805a424e None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:00.217204 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48f6af-0256-43b6-92a5-8159805a424e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:00.234633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-4d48f6af-0256-43b6-92a5-8159805a424e None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:00.235853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-4d48f6af-0256-43b6-92a5-8159805a424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:00.294929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1278/2572] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:00.304601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afdba2-7461-4332-8467-da5bf572e36e admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:00.306095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-49afdba2-7461-4332-8467-da5bf572e36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:00.363143 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afdba2-7461-4332-8467-da5bf572e36e admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:00.367299 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529427c-b708-49ff-b7e7-261c895a716d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:00.367938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529427c-b708-49ff-b7e7-261c895a716d service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:00.368219 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529427c-b708-49ff-b7e7-261c895a716d service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:00.368491 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529427c-b708-49ff-b7e7-261c895a716d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:00.377327 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529427c-b708-49ff-b7e7-261c895a716d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:00.378774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529427c-b708-49ff-b7e7-261c895a716d service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:00.388640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1295/2573] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:50:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:00.664937 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48f6af-0256-43b6-92a5-8159805a424e None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:00.666386 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-4d48f6af-0256-43b6-92a5-8159805a424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:00.682653 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48f6af-0256-43b6-92a5-8159805a424e None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:00.688344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e1540-f768-418e-989d-9b66d32e699d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:00.689189 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e1540-f768-418e-989d-9b66d32e699d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:00.689472 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e1540-f768-418e-989d-9b66d32e699d admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:00.689766 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e1540-f768-418e-989d-9b66d32e699d admin admin] PATH_INFO: `/v3/projects/74747559eccd42619d007dcc0609b6a5` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:00.690978 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e1540-f768-418e-989d-9b66d32e699d admin admin] RBAC: Authorizing `identity:delete_project(project_id=74747559eccd42619d007dcc0609b6a5)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:00.692872 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e1540-f768-418e-989d-9b66d32e699d admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:00.739758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-188e1540-f768-418e-989d-9b66d32e699d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74747559eccd42619d007dcc0609b6a5', 'request_id': 'req-188e1540-f768-418e-989d-9b66d32e699d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:00.747756 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-188e1540-f768-418e-989d-9b66d32e699d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74747559eccd42619d007dcc0609b6a5', 'request_id': 'req-188e1540-f768-418e-989d-9b66d32e699d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:00.754026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-188e1540-f768-418e-989d-9b66d32e699d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74747559eccd42619d007dcc0609b6a5', 'request_id': 'req-188e1540-f768-418e-989d-9b66d32e699d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:00.764808 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-188e1540-f768-418e-989d-9b66d32e699d admin admin] The token cache is being invalidate because project 74747559eccd42619d007dcc0609b6a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:50:00.765099 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-188e1540-f768-418e-989d-9b66d32e699d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:00.765727 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-188e1540-f768-418e-989d-9b66d32e699d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:00.767355 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1279/2574] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:50:00 2022] DELETE /identity/v3/projects/74747559eccd42619d007dcc0609b6a5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:00.771244 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529427c-b708-49ff-b7e7-261c895a716d service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:00.781336 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529427c-b708-49ff-b7e7-261c895a716d service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:00.835889 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66983897-e65a-4dbb-84f2-eb7a941f4346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:00.836691 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66983897-e65a-4dbb-84f2-eb7a941f4346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:00.836978 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66983897-e65a-4dbb-84f2-eb7a941f4346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:00.837257 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66983897-e65a-4dbb-84f2-eb7a941f4346 admin admin] PATH_INFO: `/v3/users/90ce4d1142fb432d99953108e387c872` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:00.838460 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66983897-e65a-4dbb-84f2-eb7a941f4346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90ce4d1142fb432d99953108e387c872)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:00.841180 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66983897-e65a-4dbb-84f2-eb7a941f4346 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:00.891324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-66983897-e65a-4dbb-84f2-eb7a941f4346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90ce4d1142fb432d99953108e387c872'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:00.892002 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-66983897-e65a-4dbb-84f2-eb7a941f4346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90ce4d1142fb432d99953108e387c872'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:00.894029 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:00.901336 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-66983897-e65a-4dbb-84f2-eb7a941f4346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90ce4d1142fb432d99953108e387c872'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:00.902205 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-66983897-e65a-4dbb-84f2-eb7a941f4346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90ce4d1142fb432d99953108e387c872'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:00.914574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-66983897-e65a-4dbb-84f2-eb7a941f4346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90ce4d1142fb432d99953108e387c872'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:00.927185 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1296/2575] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:50:00 2022] DELETE /identity/v3/users/90ce4d1142fb432d99953108e387c872 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:01.204628 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e1540-f768-418e-989d-9b66d32e699d admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:01.206157 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-188e1540-f768-418e-989d-9b66d32e699d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:01.221626 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e1540-f768-418e-989d-9b66d32e699d admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:01.280209 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4489c-3377-4d49-8835-a37fd4ba8f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:01.281093 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4489c-3377-4d49-8835-a37fd4ba8f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:01.281378 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4489c-3377-4d49-8835-a37fd4ba8f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:01.281674 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4489c-3377-4d49-8835-a37fd4ba8f0b admin admin] PATH_INFO: `/v3/projects/ac2431074251485da1041f4c66985d8d` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:01.282877 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4489c-3377-4d49-8835-a37fd4ba8f0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac2431074251485da1041f4c66985d8d)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:01.284817 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4489c-3377-4d49-8835-a37fd4ba8f0b admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:01.295094 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:01.331174 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-dca4489c-3377-4d49-8835-a37fd4ba8f0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac2431074251485da1041f4c66985d8d', 'request_id': 'req-dca4489c-3377-4d49-8835-a37fd4ba8f0b'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:01.338035 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-dca4489c-3377-4d49-8835-a37fd4ba8f0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac2431074251485da1041f4c66985d8d', 'request_id': 'req-dca4489c-3377-4d49-8835-a37fd4ba8f0b'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:01.344410 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-dca4489c-3377-4d49-8835-a37fd4ba8f0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac2431074251485da1041f4c66985d8d', 'request_id': 'req-dca4489c-3377-4d49-8835-a37fd4ba8f0b'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:01.354992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-dca4489c-3377-4d49-8835-a37fd4ba8f0b admin admin] The token cache is being invalidate because project ac2431074251485da1041f4c66985d8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:50:01.355297 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-dca4489c-3377-4d49-8835-a37fd4ba8f0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:01.355924 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-dca4489c-3377-4d49-8835-a37fd4ba8f0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:01.357444 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1280/2576] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:50:01 2022] DELETE /identity/v3/projects/ac2431074251485da1041f4c66985d8d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:01.363296 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad99cb6-0f7c-4fbe-965f-07e6b44d81c1 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:01.363607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad99cb6-0f7c-4fbe-965f-07e6b44d81c1 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:01.363906 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad99cb6-0f7c-4fbe-965f-07e6b44d81c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:01.384175 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-5ad99cb6-0f7c-4fbe-965f-07e6b44d81c1 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:01.385373 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-5ad99cb6-0f7c-4fbe-965f-07e6b44d81c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:01.449176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1297/2577] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:01.457082 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee6252-4eeb-4505-82bd-f37ebe526cf5 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:01.457401 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee6252-4eeb-4505-82bd-f37ebe526cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:01.457679 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee6252-4eeb-4505-82bd-f37ebe526cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:01.476593 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-28ee6252-4eeb-4505-82bd-f37ebe526cf5 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:01.477802 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-28ee6252-4eeb-4505-82bd-f37ebe526cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:01.485612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1281/2578] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:01.489674 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad99cb6-0f7c-4fbe-965f-07e6b44d81c1 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:01.499334 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad99cb6-0f7c-4fbe-965f-07e6b44d81c1 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:01.503793 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664455e-90a4-4bdc-a7a8-f0b2bd76d15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:01.504438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664455e-90a4-4bdc-a7a8-f0b2bd76d15e admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:01.504719 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664455e-90a4-4bdc-a7a8-f0b2bd76d15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:01.504990 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664455e-90a4-4bdc-a7a8-f0b2bd76d15e admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:01.505696 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664455e-90a4-4bdc-a7a8-f0b2bd76d15e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:50:01.506004 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664455e-90a4-4bdc-a7a8-f0b2bd76d15e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:01.508143 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664455e-90a4-4bdc-a7a8-f0b2bd76d15e admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:01.519301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1298/2579] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:50:01.524040 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee6252-4eeb-4505-82bd-f37ebe526cf5 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:01.533182 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee6252-4eeb-4505-82bd-f37ebe526cf5 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:01.537801 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b3f65-db78-45a0-8da0-93e6d00402fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:01.540647 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b3f65-db78-45a0-8da0-93e6d00402fd admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:01.540931 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b3f65-db78-45a0-8da0-93e6d00402fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:01.541202 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b3f65-db78-45a0-8da0-93e6d00402fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:01.541881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b3f65-db78-45a0-8da0-93e6d00402fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:01.543807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b3f65-db78-45a0-8da0-93e6d00402fd admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:01.568934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1282/2580] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:50:01 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:50:01.573591 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664455e-90a4-4bdc-a7a8-f0b2bd76d15e admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:01.583552 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664455e-90a4-4bdc-a7a8-f0b2bd76d15e admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:01.638408 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3f283-ddee-4637-860a-674d8a5cd07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:01.639004 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3f283-ddee-4637-860a-674d8a5cd07c admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:01.639306 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3f283-ddee-4637-860a-674d8a5cd07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:01.639592 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3f283-ddee-4637-860a-674d8a5cd07c admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:01.640283 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3f283-ddee-4637-860a-674d8a5cd07c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:01.642189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3f283-ddee-4637-860a-674d8a5cd07c admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:01.662229 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1299/2581] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:50:01 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:50:01.666739 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b3f65-db78-45a0-8da0-93e6d00402fd admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:01.676999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b3f65-db78-45a0-8da0-93e6d00402fd admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:01.682227 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8adf01-cf4e-458e-a725-4d4e34428c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:01.682888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8adf01-cf4e-458e-a725-4d4e34428c4a admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:01.683174 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8adf01-cf4e-458e-a725-4d4e34428c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:01.683485 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8adf01-cf4e-458e-a725-4d4e34428c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:01.684211 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8adf01-cf4e-458e-a725-4d4e34428c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:01.685802 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8adf01-cf4e-458e-a725-4d4e34428c4a admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:01.696101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1283/2582] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:50:01.700006 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3f283-ddee-4637-860a-674d8a5cd07c admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:01.710960 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3f283-ddee-4637-860a-674d8a5cd07c admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:01.715887 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741e0d8-6170-4742-b42e-57e7aa5a7e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:01.716543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741e0d8-6170-4742-b42e-57e7aa5a7e5f admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:01.716828 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741e0d8-6170-4742-b42e-57e7aa5a7e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:01.717106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741e0d8-6170-4742-b42e-57e7aa5a7e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:01.717831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741e0d8-6170-4742-b42e-57e7aa5a7e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:01.719456 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741e0d8-6170-4742-b42e-57e7aa5a7e5f admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:01.729786 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1300/2583] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:50:01.733880 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8adf01-cf4e-458e-a725-4d4e34428c4a admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:01.744105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8adf01-cf4e-458e-a725-4d4e34428c4a admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:01.748691 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fff685-2d0e-4a0b-957d-cbb6c3bcb05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:01.749733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fff685-2d0e-4a0b-957d-cbb6c3bcb05d admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:01.749996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fff685-2d0e-4a0b-957d-cbb6c3bcb05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:01.750291 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fff685-2d0e-4a0b-957d-cbb6c3bcb05d admin admin] PATH_INFO: `/v3/projects/a754a36a8e6749108f8b10d673277397/users/70821b7a9fd248b7a977d27a67e0feb1/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:01.765029 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fff685-2d0e-4a0b-957d-cbb6c3bcb05d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a754a36a8e6749108f8b10d673277397, user_id=70821b7a9fd248b7a977d27a67e0feb1, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:01.767722 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fff685-2d0e-4a0b-957d-cbb6c3bcb05d admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:01.780524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1284/2584] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:50:01 2022] PUT /identity/v3/projects/a754a36a8e6749108f8b10d673277397/users/70821b7a9fd248b7a977d27a67e0feb1/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:01.791037 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bd245-93c3-42dd-b161-86ef25549e1c None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:01.791548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bd245-93c3-42dd-b161-86ef25549e1c None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:01.791657 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bd245-93c3-42dd-b161-86ef25549e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:01.817607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-4c1bd245-93c3-42dd-b161-86ef25549e1c None None] MFA Rules not processed for user `70821b7a9fd248b7a977d27a67e0feb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:01.818827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-4c1bd245-93c3-42dd-b161-86ef25549e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:01.839046 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:01.886734 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1301/2585] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:50:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:01.891335 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fff685-2d0e-4a0b-957d-cbb6c3bcb05d admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:01.953009 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fff685-2d0e-4a0b-957d-cbb6c3bcb05d admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:01.957584 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebe380-a49a-4ac1-8107-dd52c620f96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:01.958239 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebe380-a49a-4ac1-8107-dd52c620f96d admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:01.958519 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebe380-a49a-4ac1-8107-dd52c620f96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:01.958792 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebe380-a49a-4ac1-8107-dd52c620f96d admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:01.959543 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebe380-a49a-4ac1-8107-dd52c620f96d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:01.962122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebe380-a49a-4ac1-8107-dd52c620f96d admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:01.987466 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1285/2586] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:50:01 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:50:01.992014 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bd245-93c3-42dd-b161-86ef25549e1c None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:02.002648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bd245-93c3-42dd-b161-86ef25549e1c None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:02.058793 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba86cdf-bf71-4ece-be9d-6fc0d5c7c510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:02.059497 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba86cdf-bf71-4ece-be9d-6fc0d5c7c510 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:02.059785 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba86cdf-bf71-4ece-be9d-6fc0d5c7c510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:02.060062 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba86cdf-bf71-4ece-be9d-6fc0d5c7c510 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:02.060748 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba86cdf-bf71-4ece-be9d-6fc0d5c7c510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:02.062680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba86cdf-bf71-4ece-be9d-6fc0d5c7c510 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:02.082630 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1302/2587] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:50:01 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:50:02.086578 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebe380-a49a-4ac1-8107-dd52c620f96d admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:02.097499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebe380-a49a-4ac1-8107-dd52c620f96d admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:02.102604 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5946656-3d8b-4564-a768-b5be06541361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:02.103256 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5946656-3d8b-4564-a768-b5be06541361 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:02.103569 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5946656-3d8b-4564-a768-b5be06541361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:02.103847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5946656-3d8b-4564-a768-b5be06541361 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:02.104564 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5946656-3d8b-4564-a768-b5be06541361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:02.106176 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5946656-3d8b-4564-a768-b5be06541361 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:02.117159 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1286/2588] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:50:02.121347 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba86cdf-bf71-4ece-be9d-6fc0d5c7c510 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:02.130914 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba86cdf-bf71-4ece-be9d-6fc0d5c7c510 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:02.135552 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683bcd1-555d-4d5a-9334-c54cb716eef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:02.136413 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683bcd1-555d-4d5a-9334-c54cb716eef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:02.136693 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683bcd1-555d-4d5a-9334-c54cb716eef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:02.136968 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683bcd1-555d-4d5a-9334-c54cb716eef0 admin admin] PATH_INFO: `/v3/projects/97efe0b112414d9396808dbfef451fba/users/c45bf6e12c3a4fbc9c8ba4399665f63f/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:02.151583 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683bcd1-555d-4d5a-9334-c54cb716eef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97efe0b112414d9396808dbfef451fba, user_id=c45bf6e12c3a4fbc9c8ba4399665f63f, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:02.154448 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683bcd1-555d-4d5a-9334-c54cb716eef0 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:02.168103 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1303/2589] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:50:02 2022] PUT /identity/v3/projects/97efe0b112414d9396808dbfef451fba/users/c45bf6e12c3a4fbc9c8ba4399665f63f/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:02.172416 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5946656-3d8b-4564-a768-b5be06541361 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:02.183664 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5946656-3d8b-4564-a768-b5be06541361 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:02.196772 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:02.249873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e0d2b-9860-488e-a760-875d98024d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:02.250542 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e0d2b-9860-488e-a760-875d98024d88 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:02.250824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e0d2b-9860-488e-a760-875d98024d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:02.251097 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e0d2b-9860-488e-a760-875d98024d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:02.251848 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e0d2b-9860-488e-a760-875d98024d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:02.253427 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e0d2b-9860-488e-a760-875d98024d88 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:02.262964 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1287/2590] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:50:02.267116 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683bcd1-555d-4d5a-9334-c54cb716eef0 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:02.277684 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683bcd1-555d-4d5a-9334-c54cb716eef0 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:02.282258 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0c17e-1700-47d1-a6ca-231543b9eca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:02.283158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0c17e-1700-47d1-a6ca-231543b9eca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:02.283567 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0c17e-1700-47d1-a6ca-231543b9eca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:02.283848 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0c17e-1700-47d1-a6ca-231543b9eca3 admin admin] PATH_INFO: `/v3/projects/97efe0b112414d9396808dbfef451fba/users/c45bf6e12c3a4fbc9c8ba4399665f63f/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:02.285780 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de0c17e-1700-47d1-a6ca-231543b9eca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97efe0b112414d9396808dbfef451fba, user_id=c45bf6e12c3a4fbc9c8ba4399665f63f, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:02.289017 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de0c17e-1700-47d1-a6ca-231543b9eca3 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:02.299250 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1304/2591] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:50:02 2022] PUT /identity/v3/projects/97efe0b112414d9396808dbfef451fba/users/c45bf6e12c3a4fbc9c8ba4399665f63f/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:02.311159 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1f390-7a59-4ff9-b2ea-a669923400b1 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:02.311489 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1f390-7a59-4ff9-b2ea-a669923400b1 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:02.311768 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1f390-7a59-4ff9-b2ea-a669923400b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:02.338574 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-dac1f390-7a59-4ff9-b2ea-a669923400b1 None None] MFA Rules not processed for user `c45bf6e12c3a4fbc9c8ba4399665f63f`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:02.340055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-dac1f390-7a59-4ff9-b2ea-a669923400b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:02.408236 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1288/2592] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:50:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:02.418566 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0c17e-1700-47d1-a6ca-231543b9eca3 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:02.420239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-3de0c17e-1700-47d1-a6ca-231543b9eca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:02.478501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0c17e-1700-47d1-a6ca-231543b9eca3 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:02.482176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed09ae3-1819-41b6-b719-32fb9197c45b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:02.482821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed09ae3-1819-41b6-b719-32fb9197c45b service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:02.483105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed09ae3-1819-41b6-b719-32fb9197c45b service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:02.483416 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed09ae3-1819-41b6-b719-32fb9197c45b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:02.512606 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:02.542539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed09ae3-1819-41b6-b719-32fb9197c45b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:02.544057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed09ae3-1819-41b6-b719-32fb9197c45b service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:02.552873 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1305/2593] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:50:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:06.725328 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fd977-4073-4e54-ac3c-b5036908c0ee None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:06.725869 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fd977-4073-4e54-ac3c-b5036908c0ee None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:06.725869 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fd977-4073-4e54-ac3c-b5036908c0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:06.743461 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-1c3fd977-4073-4e54-ac3c-b5036908c0ee None None] MFA Rules not processed for user `8d96e9d955934f0e883df57a3bcf934d`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:06.744613 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-1c3fd977-4073-4e54-ac3c-b5036908c0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:06.754339 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed09ae3-1819-41b6-b719-32fb9197c45b service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:06.755914 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-5ed09ae3-1819-41b6-b719-32fb9197c45b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:06.768824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed09ae3-1819-41b6-b719-32fb9197c45b service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:06.773902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65486161-3377-48d2-affa-23577404d1cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:06.774548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65486161-3377-48d2-affa-23577404d1cd service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:06.774832 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65486161-3377-48d2-affa-23577404d1cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:06.775110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65486161-3377-48d2-affa-23577404d1cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:06.784238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65486161-3377-48d2-affa-23577404d1cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:06.785673 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65486161-3377-48d2-affa-23577404d1cd service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:06.795341 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1306/2594] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:50:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:06.801972 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1289/2595] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:50:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:07.450972 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65486161-3377-48d2-affa-23577404d1cd service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:07.452605 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-65486161-3377-48d2-affa-23577404d1cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:07.523469 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65486161-3377-48d2-affa-23577404d1cd service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:07.528424 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0770f7a-1b6e-4da2-b513-90e3d5bc015d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746fd8ed517446fe89c53df873abb2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:07.529077 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0770f7a-1b6e-4da2-b513-90e3d5bc015d service placement] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:07.529363 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0770f7a-1b6e-4da2-b513-90e3d5bc015d service placement] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:07.529645 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0770f7a-1b6e-4da2-b513-90e3d5bc015d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:07.531445 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-e0770f7a-1b6e-4da2-b513-90e3d5bc015d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:07.543232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0770f7a-1b6e-4da2-b513-90e3d5bc015d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:07.544845 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0770f7a-1b6e-4da2-b513-90e3d5bc015d service placement] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:07.555199 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1307/2596] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:50:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:11.663395 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fd977-4073-4e54-ac3c-b5036908c0ee None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:11.702651 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:11.727779 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fd977-4073-4e54-ac3c-b5036908c0ee None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:11.735916 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad88d9-15a1-4ecf-83b2-86f4669031c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:11.736805 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad88d9-15a1-4ecf-83b2-86f4669031c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:11.737091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad88d9-15a1-4ecf-83b2-86f4669031c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:11.737368 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad88d9-15a1-4ecf-83b2-86f4669031c3 admin admin] PATH_INFO: `/v3/users/70821b7a9fd248b7a977d27a67e0feb1` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:11.740701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad88d9-15a1-4ecf-83b2-86f4669031c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70821b7a9fd248b7a977d27a67e0feb1)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:11.743694 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad88d9-15a1-4ecf-83b2-86f4669031c3 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:11.793541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-abad88d9-15a1-4ecf-83b2-86f4669031c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70821b7a9fd248b7a977d27a67e0feb1'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:11.800437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-abad88d9-15a1-4ecf-83b2-86f4669031c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70821b7a9fd248b7a977d27a67e0feb1'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:11.801099 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-abad88d9-15a1-4ecf-83b2-86f4669031c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70821b7a9fd248b7a977d27a67e0feb1'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:11.813300 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-abad88d9-15a1-4ecf-83b2-86f4669031c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70821b7a9fd248b7a977d27a67e0feb1'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:11.820380 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-abad88d9-15a1-4ecf-83b2-86f4669031c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70821b7a9fd248b7a977d27a67e0feb1'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:11.826390 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1290/2597] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:50:11 2022] DELETE /identity/v3/users/70821b7a9fd248b7a977d27a67e0feb1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:11.830906 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f86b6-7a84-41ad-ad3f-308e4adf8bbb None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:11.831393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f86b6-7a84-41ad-ad3f-308e4adf8bbb None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:11.831489 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f86b6-7a84-41ad-ad3f-308e4adf8bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:11.848525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-8c3f86b6-7a84-41ad-ad3f-308e4adf8bbb None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:11.849722 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-8c3f86b6-7a84-41ad-ad3f-308e4adf8bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:11.908083 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1308/2598] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:11.918035 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad88d9-15a1-4ecf-83b2-86f4669031c3 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:11.919460 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-abad88d9-15a1-4ecf-83b2-86f4669031c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:11.977212 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad88d9-15a1-4ecf-83b2-86f4669031c3 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:11.980784 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10586d05-9dcc-4279-a62a-b2be7226f788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:11.981421 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10586d05-9dcc-4279-a62a-b2be7226f788 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:11.981701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10586d05-9dcc-4279-a62a-b2be7226f788 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:11.981976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10586d05-9dcc-4279-a62a-b2be7226f788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:11.990932 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10586d05-9dcc-4279-a62a-b2be7226f788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:11.992393 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10586d05-9dcc-4279-a62a-b2be7226f788 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:12.001834 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1291/2599] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:50:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:12.303639 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f86b6-7a84-41ad-ad3f-308e4adf8bbb None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:12.305108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-8c3f86b6-7a84-41ad-ad3f-308e4adf8bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:12.317469 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f86b6-7a84-41ad-ad3f-308e4adf8bbb None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:12.322739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa02e6-39ca-4268-abae-774462b58567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:12.323724 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa02e6-39ca-4268-abae-774462b58567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:12.323900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa02e6-39ca-4268-abae-774462b58567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:12.324184 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa02e6-39ca-4268-abae-774462b58567 admin admin] PATH_INFO: `/v3/projects/a754a36a8e6749108f8b10d673277397` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:12.325369 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa02e6-39ca-4268-abae-774462b58567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a754a36a8e6749108f8b10d673277397)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:12.327319 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa02e6-39ca-4268-abae-774462b58567 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:12.369527 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:12.375988 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-16aa02e6-39ca-4268-abae-774462b58567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a754a36a8e6749108f8b10d673277397', 'request_id': 'req-16aa02e6-39ca-4268-abae-774462b58567'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:12.383247 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-16aa02e6-39ca-4268-abae-774462b58567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a754a36a8e6749108f8b10d673277397', 'request_id': 'req-16aa02e6-39ca-4268-abae-774462b58567'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:12.388680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-16aa02e6-39ca-4268-abae-774462b58567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a754a36a8e6749108f8b10d673277397', 'request_id': 'req-16aa02e6-39ca-4268-abae-774462b58567'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:12.401569 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-16aa02e6-39ca-4268-abae-774462b58567 admin admin] The token cache is being invalidate because project a754a36a8e6749108f8b10d673277397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:50:12.401877 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-16aa02e6-39ca-4268-abae-774462b58567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:12.402512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-16aa02e6-39ca-4268-abae-774462b58567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:12.404083 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1309/2600] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:50:12 2022] DELETE /identity/v3/projects/a754a36a8e6749108f8b10d673277397 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:12.408065 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10586d05-9dcc-4279-a62a-b2be7226f788 service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:12.418149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10586d05-9dcc-4279-a62a-b2be7226f788 service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:12.467348 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:12.473711 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ac48c-84a4-46e3-8b33-50974d54ee96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:12.474588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ac48c-84a4-46e3-8b33-50974d54ee96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:12.475234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ac48c-84a4-46e3-8b33-50974d54ee96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:12.475596 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ac48c-84a4-46e3-8b33-50974d54ee96 admin admin] PATH_INFO: `/v3/users/c45bf6e12c3a4fbc9c8ba4399665f63f` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:12.477393 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ac48c-84a4-46e3-8b33-50974d54ee96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c45bf6e12c3a4fbc9c8ba4399665f63f)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:12.479720 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ac48c-84a4-46e3-8b33-50974d54ee96 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:12.524333 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-4c2ac48c-84a4-46e3-8b33-50974d54ee96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c45bf6e12c3a4fbc9c8ba4399665f63f'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:12.532648 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-4c2ac48c-84a4-46e3-8b33-50974d54ee96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c45bf6e12c3a4fbc9c8ba4399665f63f'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:12.533295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-4c2ac48c-84a4-46e3-8b33-50974d54ee96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c45bf6e12c3a4fbc9c8ba4399665f63f'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:12.546248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-4c2ac48c-84a4-46e3-8b33-50974d54ee96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c45bf6e12c3a4fbc9c8ba4399665f63f'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:12.553473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-4c2ac48c-84a4-46e3-8b33-50974d54ee96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c45bf6e12c3a4fbc9c8ba4399665f63f'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:12.559999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1292/2601] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:50:12 2022] DELETE /identity/v3/users/c45bf6e12c3a4fbc9c8ba4399665f63f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:12.826865 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa02e6-39ca-4268-abae-774462b58567 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:12.828473 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-16aa02e6-39ca-4268-abae-774462b58567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:12.842523 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa02e6-39ca-4268-abae-774462b58567 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:12.899670 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6f1df-c5c5-4a7c-82ae-43b5858af730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:12.900550 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6f1df-c5c5-4a7c-82ae-43b5858af730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:12.900840 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6f1df-c5c5-4a7c-82ae-43b5858af730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:12.901117 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6f1df-c5c5-4a7c-82ae-43b5858af730 admin admin] PATH_INFO: `/v3/projects/97efe0b112414d9396808dbfef451fba` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:12.902297 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6f1df-c5c5-4a7c-82ae-43b5858af730 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97efe0b112414d9396808dbfef451fba)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:12.904259 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6f1df-c5c5-4a7c-82ae-43b5858af730 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:12.949445 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-16c6f1df-c5c5-4a7c-82ae-43b5858af730 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97efe0b112414d9396808dbfef451fba', 'request_id': 'req-16c6f1df-c5c5-4a7c-82ae-43b5858af730'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:12.956549 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-16c6f1df-c5c5-4a7c-82ae-43b5858af730 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97efe0b112414d9396808dbfef451fba', 'request_id': 'req-16c6f1df-c5c5-4a7c-82ae-43b5858af730'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:12.962388 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-16c6f1df-c5c5-4a7c-82ae-43b5858af730 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97efe0b112414d9396808dbfef451fba', 'request_id': 'req-16c6f1df-c5c5-4a7c-82ae-43b5858af730'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:12.973319 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-16c6f1df-c5c5-4a7c-82ae-43b5858af730 admin admin] The token cache is being invalidate because project 97efe0b112414d9396808dbfef451fba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:50:12.973639 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-16c6f1df-c5c5-4a7c-82ae-43b5858af730 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:12.974300 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-16c6f1df-c5c5-4a7c-82ae-43b5858af730 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:12.975857 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1310/2602] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:50:12 2022] DELETE /identity/v3/projects/97efe0b112414d9396808dbfef451fba => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:12.981712 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6736b24-1c07-4c19-9b38-2b2359e9e27e None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:12.982175 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6736b24-1c07-4c19-9b38-2b2359e9e27e None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:12.982439 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6736b24-1c07-4c19-9b38-2b2359e9e27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:13.000816 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-a6736b24-1c07-4c19-9b38-2b2359e9e27e None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:13.002012 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-a6736b24-1c07-4c19-9b38-2b2359e9e27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:13.060380 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1293/2603] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:13.069101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728cb74-134b-4bd2-ab94-c68adfeca5ad None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:13.069394 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728cb74-134b-4bd2-ab94-c68adfeca5ad None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:13.069674 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728cb74-134b-4bd2-ab94-c68adfeca5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:13.088424 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-1728cb74-134b-4bd2-ab94-c68adfeca5ad None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:13.089903 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-1728cb74-134b-4bd2-ab94-c68adfeca5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:13.098542 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1311/2604] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:13.104409 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6736b24-1c07-4c19-9b38-2b2359e9e27e None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:13.112315 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6736b24-1c07-4c19-9b38-2b2359e9e27e None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:13.117498 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31824726-eeba-4d22-8287-e8b4b69ab9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:13.118167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31824726-eeba-4d22-8287-e8b4b69ab9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:13.118455 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31824726-eeba-4d22-8287-e8b4b69ab9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:13.118729 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31824726-eeba-4d22-8287-e8b4b69ab9d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:13.119502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31824726-eeba-4d22-8287-e8b4b69ab9d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:50:13.119817 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31824726-eeba-4d22-8287-e8b4b69ab9d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:13.121478 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31824726-eeba-4d22-8287-e8b4b69ab9d1 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:13.134544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1294/2605] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:50:13.139422 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728cb74-134b-4bd2-ab94-c68adfeca5ad None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:13.150215 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728cb74-134b-4bd2-ab94-c68adfeca5ad None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:13.154816 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293e7a7-0dde-4f5f-b0eb-fd33fb38c2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:13.155502 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293e7a7-0dde-4f5f-b0eb-fd33fb38c2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:13.155790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293e7a7-0dde-4f5f-b0eb-fd33fb38c2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:13.156067 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293e7a7-0dde-4f5f-b0eb-fd33fb38c2f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:13.156785 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293e7a7-0dde-4f5f-b0eb-fd33fb38c2f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:13.158693 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293e7a7-0dde-4f5f-b0eb-fd33fb38c2f0 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:13.186350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1312/2606] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:50:13 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:50:13.190353 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31824726-eeba-4d22-8287-e8b4b69ab9d1 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:13.200997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31824726-eeba-4d22-8287-e8b4b69ab9d1 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:13.259969 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dc7ab-5572-4396-a586-357165d32b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:13.260651 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dc7ab-5572-4396-a586-357165d32b1d admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:13.261076 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dc7ab-5572-4396-a586-357165d32b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:13.261358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dc7ab-5572-4396-a586-357165d32b1d admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:13.262047 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dc7ab-5572-4396-a586-357165d32b1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:13.264003 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dc7ab-5572-4396-a586-357165d32b1d admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:13.275424 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:13.292445 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293e7a7-0dde-4f5f-b0eb-fd33fb38c2f0 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:13.295123 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1295/2607] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:50:13 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:50:13.304855 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293e7a7-0dde-4f5f-b0eb-fd33fb38c2f0 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:13.310583 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb93af8-0cb2-466a-b217-40ddab7e8836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:13.310769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb93af8-0cb2-466a-b217-40ddab7e8836 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:13.311053 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb93af8-0cb2-466a-b217-40ddab7e8836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:13.311377 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb93af8-0cb2-466a-b217-40ddab7e8836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:13.312155 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb93af8-0cb2-466a-b217-40ddab7e8836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:13.313761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb93af8-0cb2-466a-b217-40ddab7e8836 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:13.325630 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1313/2608] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:50:13.329608 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dc7ab-5572-4396-a586-357165d32b1d admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:13.340394 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dc7ab-5572-4396-a586-357165d32b1d admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:13.345977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba8f0b-41ed-4790-b7c2-0b49ddbe7442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:13.346638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba8f0b-41ed-4790-b7c2-0b49ddbe7442 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:13.346919 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba8f0b-41ed-4790-b7c2-0b49ddbe7442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:13.347595 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba8f0b-41ed-4790-b7c2-0b49ddbe7442 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:13.347939 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba8f0b-41ed-4790-b7c2-0b49ddbe7442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:13.349512 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba8f0b-41ed-4790-b7c2-0b49ddbe7442 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:13.360943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1296/2609] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:50:13.364806 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb93af8-0cb2-466a-b217-40ddab7e8836 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:13.375525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb93af8-0cb2-466a-b217-40ddab7e8836 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:13.380324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51544b7-5d04-4835-b548-b6962d6f4f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:13.381275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51544b7-5d04-4835-b548-b6962d6f4f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:13.381560 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51544b7-5d04-4835-b548-b6962d6f4f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:13.381836 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51544b7-5d04-4835-b548-b6962d6f4f47 admin admin] PATH_INFO: `/v3/projects/851f609548bf406fb069c6153d0c8488/users/f13a87aef5ed40189524ba899e35fd4e/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:13.396965 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51544b7-5d04-4835-b548-b6962d6f4f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=851f609548bf406fb069c6153d0c8488, user_id=f13a87aef5ed40189524ba899e35fd4e, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:13.399706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51544b7-5d04-4835-b548-b6962d6f4f47 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:13.402912 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:13.415636 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1314/2610] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:50:13 2022] PUT /identity/v3/projects/851f609548bf406fb069c6153d0c8488/users/f13a87aef5ed40189524ba899e35fd4e/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:13.427797 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74ea9c-7531-4af2-8f4a-b12a5e99f236 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:13.428179 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74ea9c-7531-4af2-8f4a-b12a5e99f236 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:13.428547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74ea9c-7531-4af2-8f4a-b12a5e99f236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:13.459521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-0e74ea9c-7531-4af2-8f4a-b12a5e99f236 None None] MFA Rules not processed for user `f13a87aef5ed40189524ba899e35fd4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:13.460685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-0e74ea9c-7531-4af2-8f4a-b12a5e99f236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:13.541454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1297/2611] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:50:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:13.553269 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51544b7-5d04-4835-b548-b6962d6f4f47 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:13.555761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d51544b7-5d04-4835-b548-b6962d6f4f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:13.612814 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51544b7-5d04-4835-b548-b6962d6f4f47 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:13.616557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a5726-4c8d-4e18-9a8a-60149cf3a289 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:13.618978 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a5726-4c8d-4e18-9a8a-60149cf3a289 service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:13.618978 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a5726-4c8d-4e18-9a8a-60149cf3a289 service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:13.618978 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a5726-4c8d-4e18-9a8a-60149cf3a289 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:13.629077 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a5726-4c8d-4e18-9a8a-60149cf3a289 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:13.630517 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a5726-4c8d-4e18-9a8a-60149cf3a289 service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:13.639791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1315/2612] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:50:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:17.232288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74ea9c-7531-4af2-8f4a-b12a5e99f236 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:17.233723 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-0e74ea9c-7531-4af2-8f4a-b12a5e99f236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:17.312283 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74ea9c-7531-4af2-8f4a-b12a5e99f236 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:17.317628 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9599128-cf97-49b7-856f-8214f0e47402 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:17.318273 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9599128-cf97-49b7-856f-8214f0e47402 service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:17.318554 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9599128-cf97-49b7-856f-8214f0e47402 service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:17.318829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9599128-cf97-49b7-856f-8214f0e47402 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:17.321120 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e9599128-cf97-49b7-856f-8214f0e47402 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:17.333030 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9599128-cf97-49b7-856f-8214f0e47402 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:17.334580 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9599128-cf97-49b7-856f-8214f0e47402 service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:17.345799 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1298/2613] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:50:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:23.635576 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=28 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:27.341466 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:INSERT=1,keystone:SELECT=73 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:38.370679 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a5726-4c8d-4e18-9a8a-60149cf3a289 service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:38.432470 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a5726-4c8d-4e18-9a8a-60149cf3a289 service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:38.436985 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865548a-8dbd-4eb5-a660-9954150b75f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:38.437838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865548a-8dbd-4eb5-a660-9954150b75f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:38.438119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865548a-8dbd-4eb5-a660-9954150b75f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:38.438391 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865548a-8dbd-4eb5-a660-9954150b75f3 admin admin] PATH_INFO: `/v3/users/f13a87aef5ed40189524ba899e35fd4e` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:38.439590 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865548a-8dbd-4eb5-a660-9954150b75f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f13a87aef5ed40189524ba899e35fd4e)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:38.441508 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865548a-8dbd-4eb5-a660-9954150b75f3 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:38.485812 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e865548a-8dbd-4eb5-a660-9954150b75f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f13a87aef5ed40189524ba899e35fd4e'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:38.486459 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e865548a-8dbd-4eb5-a660-9954150b75f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f13a87aef5ed40189524ba899e35fd4e'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:38.493318 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e865548a-8dbd-4eb5-a660-9954150b75f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f13a87aef5ed40189524ba899e35fd4e'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:38.493953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e865548a-8dbd-4eb5-a660-9954150b75f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f13a87aef5ed40189524ba899e35fd4e'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:38.505619 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-e865548a-8dbd-4eb5-a660-9954150b75f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f13a87aef5ed40189524ba899e35fd4e'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:38.517967 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1316/2614] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:50:38 2022] DELETE /identity/v3/users/f13a87aef5ed40189524ba899e35fd4e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:38.522547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c03bc-1114-4052-80db-3144e32a9519 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:38.523046 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c03bc-1114-4052-80db-3144e32a9519 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:38.523161 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c03bc-1114-4052-80db-3144e32a9519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:38.541615 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-3a8c03bc-1114-4052-80db-3144e32a9519 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:38.542866 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-3a8c03bc-1114-4052-80db-3144e32a9519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:38.600101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1299/2615] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:38.610140 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865548a-8dbd-4eb5-a660-9954150b75f3 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:38.611604 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-e865548a-8dbd-4eb5-a660-9954150b75f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:38.672026 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865548a-8dbd-4eb5-a660-9954150b75f3 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:38.675644 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16044c-821a-4fa9-843b-e030eee3ad69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:38.676291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16044c-821a-4fa9-843b-e030eee3ad69 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:38.676573 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16044c-821a-4fa9-843b-e030eee3ad69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:38.676850 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16044c-821a-4fa9-843b-e030eee3ad69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:38.685840 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16044c-821a-4fa9-843b-e030eee3ad69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:38.687303 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16044c-821a-4fa9-843b-e030eee3ad69 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:38.696584 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1317/2616] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:50:38.955077 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c03bc-1114-4052-80db-3144e32a9519 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:38.956504 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-3a8c03bc-1114-4052-80db-3144e32a9519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:38.970400 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c03bc-1114-4052-80db-3144e32a9519 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:38.975099 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1182d-3063-4166-93dc-bca7cc504342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:38.975995 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1182d-3063-4166-93dc-bca7cc504342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:38.976279 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1182d-3063-4166-93dc-bca7cc504342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:38.976557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1182d-3063-4166-93dc-bca7cc504342 admin admin] PATH_INFO: `/v3/projects/851f609548bf406fb069c6153d0c8488` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:38.977732 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1182d-3063-4166-93dc-bca7cc504342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=851f609548bf406fb069c6153d0c8488)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:38.979682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1182d-3063-4166-93dc-bca7cc504342 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:39.027552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-b0c1182d-3063-4166-93dc-bca7cc504342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '851f609548bf406fb069c6153d0c8488', 'request_id': 'req-b0c1182d-3063-4166-93dc-bca7cc504342'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:39.034827 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-b0c1182d-3063-4166-93dc-bca7cc504342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '851f609548bf406fb069c6153d0c8488', 'request_id': 'req-b0c1182d-3063-4166-93dc-bca7cc504342'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:39.041484 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-b0c1182d-3063-4166-93dc-bca7cc504342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '851f609548bf406fb069c6153d0c8488', 'request_id': 'req-b0c1182d-3063-4166-93dc-bca7cc504342'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:39.051883 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-b0c1182d-3063-4166-93dc-bca7cc504342 admin admin] The token cache is being invalidate because project 851f609548bf406fb069c6153d0c8488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:50:39.052172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-b0c1182d-3063-4166-93dc-bca7cc504342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:39.052828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-b0c1182d-3063-4166-93dc-bca7cc504342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:39.054361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1300/2617] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:50:38 2022] DELETE /identity/v3/projects/851f609548bf406fb069c6153d0c8488 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:39.059692 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b140988-1909-4391-a7bd-8ca2914b61e8 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:39.059979 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b140988-1909-4391-a7bd-8ca2914b61e8 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:39.060258 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b140988-1909-4391-a7bd-8ca2914b61e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:39.077950 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-9b140988-1909-4391-a7bd-8ca2914b61e8 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:39.079132 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-9b140988-1909-4391-a7bd-8ca2914b61e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:39.096260 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:39.139872 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1318/2618] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:39.147764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2f9ee-10e1-44f2-a96b-7f832843b6d5 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:39.148057 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2f9ee-10e1-44f2-a96b-7f832843b6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:39.148340 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2f9ee-10e1-44f2-a96b-7f832843b6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:39.166383 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-38a2f9ee-10e1-44f2-a96b-7f832843b6d5 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:39.167611 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-38a2f9ee-10e1-44f2-a96b-7f832843b6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:39.175360 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1301/2619] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:39.179236 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b140988-1909-4391-a7bd-8ca2914b61e8 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:39.189197 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b140988-1909-4391-a7bd-8ca2914b61e8 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:39.193632 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0c28f-2fa1-4640-afcf-3f5e05942e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:39.194301 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0c28f-2fa1-4640-afcf-3f5e05942e72 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:39.194582 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0c28f-2fa1-4640-afcf-3f5e05942e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:39.194857 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0c28f-2fa1-4640-afcf-3f5e05942e72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:39.195607 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0c28f-2fa1-4640-afcf-3f5e05942e72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:50:39.195915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0c28f-2fa1-4640-afcf-3f5e05942e72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:39.198144 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0c28f-2fa1-4640-afcf-3f5e05942e72 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:39.209512 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1319/2620] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:50:39.213508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2f9ee-10e1-44f2-a96b-7f832843b6d5 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:39.222781 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2f9ee-10e1-44f2-a96b-7f832843b6d5 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:39.227387 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4ddb5-c682-4514-aaae-98fb82d49f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:39.228030 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4ddb5-c682-4514-aaae-98fb82d49f6f admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:39.228313 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4ddb5-c682-4514-aaae-98fb82d49f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:39.228588 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4ddb5-c682-4514-aaae-98fb82d49f6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:39.229266 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4ddb5-c682-4514-aaae-98fb82d49f6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:39.231154 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4ddb5-c682-4514-aaae-98fb82d49f6f admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:39.256398 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1302/2621] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:50:39 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:50:39.261055 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0c28f-2fa1-4640-afcf-3f5e05942e72 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:39.270745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0c28f-2fa1-4640-afcf-3f5e05942e72 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:39.325109 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1dc7f6-5674-4af6-a183-3aa89440955a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:39.325766 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dc7f6-5674-4af6-a183-3aa89440955a admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:39.326047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dc7f6-5674-4af6-a183-3aa89440955a admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:39.326322 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dc7f6-5674-4af6-a183-3aa89440955a admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:39.327008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1dc7f6-5674-4af6-a183-3aa89440955a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:39.328952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1dc7f6-5674-4af6-a183-3aa89440955a admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:39.348073 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1320/2622] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:50:39 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:50:39.352043 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4ddb5-c682-4514-aaae-98fb82d49f6f admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:39.362163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4ddb5-c682-4514-aaae-98fb82d49f6f admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:39.366673 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682bad2-5e9d-4dd9-9363-eacc8fc62dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:39.367355 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682bad2-5e9d-4dd9-9363-eacc8fc62dbd admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:39.367639 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682bad2-5e9d-4dd9-9363-eacc8fc62dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:39.367910 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682bad2-5e9d-4dd9-9363-eacc8fc62dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:39.369131 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682bad2-5e9d-4dd9-9363-eacc8fc62dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:39.370700 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682bad2-5e9d-4dd9-9363-eacc8fc62dbd admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:39.380884 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1303/2623] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:50:39.385285 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1dc7f6-5674-4af6-a183-3aa89440955a admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:39.395646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1dc7f6-5674-4af6-a183-3aa89440955a admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:39.400742 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf645a5-d059-459b-80c6-0271174e4db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:39.401397 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf645a5-d059-459b-80c6-0271174e4db3 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:39.401680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf645a5-d059-459b-80c6-0271174e4db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:39.401955 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf645a5-d059-459b-80c6-0271174e4db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:39.402672 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf645a5-d059-459b-80c6-0271174e4db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:39.404293 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf645a5-d059-459b-80c6-0271174e4db3 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:39.414105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1321/2624] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:50:39.418585 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682bad2-5e9d-4dd9-9363-eacc8fc62dbd admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:39.428408 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682bad2-5e9d-4dd9-9363-eacc8fc62dbd admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:39.432951 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7aafec-c7fd-4e59-8e42-4c461b76e015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:39.433836 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7aafec-c7fd-4e59-8e42-4c461b76e015 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:39.434107 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7aafec-c7fd-4e59-8e42-4c461b76e015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:39.434382 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7aafec-c7fd-4e59-8e42-4c461b76e015 admin admin] PATH_INFO: `/v3/projects/0fb2f335c9b540af8f7119c85656efad/users/f1fa5f1765ed4995b31a1600ce3edb07/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:39.448575 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7aafec-c7fd-4e59-8e42-4c461b76e015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fb2f335c9b540af8f7119c85656efad, user_id=f1fa5f1765ed4995b31a1600ce3edb07, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:39.451217 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7aafec-c7fd-4e59-8e42-4c461b76e015 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:39.465337 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1304/2625] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:50:39 2022] PUT /identity/v3/projects/0fb2f335c9b540af8f7119c85656efad/users/f1fa5f1765ed4995b31a1600ce3edb07/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:39.470248 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1c473-2d23-44ca-bd1a-ca938f5278f6 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:39.470548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1c473-2d23-44ca-bd1a-ca938f5278f6 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:39.470832 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1c473-2d23-44ca-bd1a-ca938f5278f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:39.490240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-ccc1c473-2d23-44ca-bd1a-ca938f5278f6 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:39.491484 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-ccc1c473-2d23-44ca-bd1a-ca938f5278f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:39.549559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1322/2626] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:39.559080 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7aafec-c7fd-4e59-8e42-4c461b76e015 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:39.560795 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-9e7aafec-c7fd-4e59-8e42-4c461b76e015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:39.583417 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:39.619971 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7aafec-c7fd-4e59-8e42-4c461b76e015 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:39.623658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d49b2-2575-49d1-9201-35da15262684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:39.624298 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d49b2-2575-49d1-9201-35da15262684 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:39.624584 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d49b2-2575-49d1-9201-35da15262684 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:39.624861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d49b2-2575-49d1-9201-35da15262684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:39.634838 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d49b2-2575-49d1-9201-35da15262684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:39.636288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d49b2-2575-49d1-9201-35da15262684 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:39.645598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1305/2627] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:50:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:43.489403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a23dd9-29cd-4fc6-ac06-4122d717d4c3 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:43.489971 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a23dd9-29cd-4fc6-ac06-4122d717d4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:43.490369 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a23dd9-29cd-4fc6-ac06-4122d717d4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:43.546381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-28a23dd9-29cd-4fc6-ac06-4122d717d4c3 None None] MFA Rules not processed for user `f1fa5f1765ed4995b31a1600ce3edb07`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:43.550425 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-28a23dd9-29cd-4fc6-ac06-4122d717d4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:43.569854 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:43.632850 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1323/2628] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:50:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:43.638065 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d49b2-2575-49d1-9201-35da15262684 service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:43.647824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d49b2-2575-49d1-9201-35da15262684 service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:43.652482 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29cd39-9fe9-4ecf-984c-54f943aba4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:43.653143 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29cd39-9fe9-4ecf-984c-54f943aba4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:43.653425 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29cd39-9fe9-4ecf-984c-54f943aba4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:43.653699 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29cd39-9fe9-4ecf-984c-54f943aba4d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:43.654401 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29cd39-9fe9-4ecf-984c-54f943aba4d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:43.656348 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29cd39-9fe9-4ecf-984c-54f943aba4d0 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:43.687313 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1306/2629] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:50:43 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:50:43.690700 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a23dd9-29cd-4fc6-ac06-4122d717d4c3 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:43.702754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a23dd9-29cd-4fc6-ac06-4122d717d4c3 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:43.766704 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0c93d-43ce-48e4-9464-8a5443a6de49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:43.767546 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0c93d-43ce-48e4-9464-8a5443a6de49 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:43.767840 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0c93d-43ce-48e4-9464-8a5443a6de49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:43.768121 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0c93d-43ce-48e4-9464-8a5443a6de49 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:43.768827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0c93d-43ce-48e4-9464-8a5443a6de49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:43.770849 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0c93d-43ce-48e4-9464-8a5443a6de49 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:43.798459 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1324/2630] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:50:43 2022] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:50:43.799712 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29cd39-9fe9-4ecf-984c-54f943aba4d0 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:43.810930 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29cd39-9fe9-4ecf-984c-54f943aba4d0 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:43.815711 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a3463-4c3f-4fab-8df9-58e28784c467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:43.816390 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a3463-4c3f-4fab-8df9-58e28784c467 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:43.816676 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a3463-4c3f-4fab-8df9-58e28784c467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:43.816987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a3463-4c3f-4fab-8df9-58e28784c467 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:43.817714 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a3463-4c3f-4fab-8df9-58e28784c467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:43.819345 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a3463-4c3f-4fab-8df9-58e28784c467 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:43.831382 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1307/2631] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:50:43.835443 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0c93d-43ce-48e4-9464-8a5443a6de49 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:43.846129 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0c93d-43ce-48e4-9464-8a5443a6de49 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:43.850841 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859eefd9-a89b-4516-9b7c-363e1a3ae512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:43.851776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859eefd9-a89b-4516-9b7c-363e1a3ae512 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:43.852060 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859eefd9-a89b-4516-9b7c-363e1a3ae512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:43.852336 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859eefd9-a89b-4516-9b7c-363e1a3ae512 admin admin] PATH_INFO: `/v3/projects/581004a638af4993abf350d76570222b/users/0029abfb31974095afcca4bd9c3a3202/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:43.868321 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859eefd9-a89b-4516-9b7c-363e1a3ae512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=581004a638af4993abf350d76570222b, user_id=0029abfb31974095afcca4bd9c3a3202, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:43.871711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859eefd9-a89b-4516-9b7c-363e1a3ae512 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:43.887198 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1325/2632] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:50:43 2022] PUT /identity/v3/projects/581004a638af4993abf350d76570222b/users/0029abfb31974095afcca4bd9c3a3202/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:43.891093 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a3463-4c3f-4fab-8df9-58e28784c467 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:43.902173 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a3463-4c3f-4fab-8df9-58e28784c467 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:43.970708 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e2f89-bfe2-4142-84e0-5529d6372a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:43.971426 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e2f89-bfe2-4142-84e0-5529d6372a5d admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:43.971710 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e2f89-bfe2-4142-84e0-5529d6372a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:43.971983 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e2f89-bfe2-4142-84e0-5529d6372a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:43.972750 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e2f89-bfe2-4142-84e0-5529d6372a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:43.974494 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e2f89-bfe2-4142-84e0-5529d6372a5d admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:43.989804 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1308/2633] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:50:43.994223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859eefd9-a89b-4516-9b7c-363e1a3ae512 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:44.015841 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859eefd9-a89b-4516-9b7c-363e1a3ae512 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:44.020803 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b2b8e-e920-44bd-b57d-05ae36ae4466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:44.021761 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b2b8e-e920-44bd-b57d-05ae36ae4466 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:44.022040 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b2b8e-e920-44bd-b57d-05ae36ae4466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:44.022314 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b2b8e-e920-44bd-b57d-05ae36ae4466 admin admin] PATH_INFO: `/v3/projects/581004a638af4993abf350d76570222b/users/0029abfb31974095afcca4bd9c3a3202/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:44.024426 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b2b8e-e920-44bd-b57d-05ae36ae4466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=581004a638af4993abf350d76570222b, user_id=0029abfb31974095afcca4bd9c3a3202, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:44.027767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b2b8e-e920-44bd-b57d-05ae36ae4466 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:44.038595 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1326/2634] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:50:43 2022] PUT /identity/v3/projects/581004a638af4993abf350d76570222b/users/0029abfb31974095afcca4bd9c3a3202/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:50:48.405976 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70249152-d056-4be0-a01f-5fd8ec41ae3c None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:48.406518 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70249152-d056-4be0-a01f-5fd8ec41ae3c None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:48.406518 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70249152-d056-4be0-a01f-5fd8ec41ae3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:48.437173 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-70249152-d056-4be0-a01f-5fd8ec41ae3c None None] MFA Rules not processed for user `0029abfb31974095afcca4bd9c3a3202`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:48.438920 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-70249152-d056-4be0-a01f-5fd8ec41ae3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:48.518841 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1309/2635] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:50:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:48.533118 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b2b8e-e920-44bd-b57d-05ae36ae4466 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:48.535036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-955b2b8e-e920-44bd-b57d-05ae36ae4466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:48.623018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b2b8e-e920-44bd-b57d-05ae36ae4466 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:48.628742 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a8aaa-52a3-4f4e-8eb1-5a15511aa243 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:48.629409 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a8aaa-52a3-4f4e-8eb1-5a15511aa243 service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:48.629695 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a8aaa-52a3-4f4e-8eb1-5a15511aa243 service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:48.629975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a8aaa-52a3-4f4e-8eb1-5a15511aa243 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:48.636136 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:48.698469 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a8aaa-52a3-4f4e-8eb1-5a15511aa243 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:48.700357 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a8aaa-52a3-4f4e-8eb1-5a15511aa243 service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:48.710316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1327/2636] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:50:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:50:48.963737 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70249152-d056-4be0-a01f-5fd8ec41ae3c None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:48.978768 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:49.063350 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70249152-d056-4be0-a01f-5fd8ec41ae3c None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:49.067386 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5d66c-d2a6-47f0-8c32-af3cd8948c29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:49.068076 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5d66c-d2a6-47f0-8c32-af3cd8948c29 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:49.068363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5d66c-d2a6-47f0-8c32-af3cd8948c29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:49.068638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5d66c-d2a6-47f0-8c32-af3cd8948c29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:49.070636 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f7a5d66c-d2a6-47f0-8c32-af3cd8948c29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:49.149038 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5d66c-d2a6-47f0-8c32-af3cd8948c29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:49.151042 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5d66c-d2a6-47f0-8c32-af3cd8948c29 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:49.162991 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1310/2637] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:50:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:54.048945 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a8aaa-52a3-4f4e-8eb1-5a15511aa243 service nova] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:54.074781 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a8aaa-52a3-4f4e-8eb1-5a15511aa243 service nova] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:54.095519 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9557e4-d983-46c5-bf66-19f052c689f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:54.095519 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9557e4-d983-46c5-bf66-19f052c689f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:54.095519 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9557e4-d983-46c5-bf66-19f052c689f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:54.095519 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9557e4-d983-46c5-bf66-19f052c689f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:54.096182 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-9d9557e4-d983-46c5-bf66-19f052c689f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:54.212052 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9557e4-d983-46c5-bf66-19f052c689f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:54.213800 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9557e4-d983-46c5-bf66-19f052c689f7 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:54.224929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1328/2638] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:50:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:55.502164 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5d66c-d2a6-47f0-8c32-af3cd8948c29 service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:55.504342 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f7a5d66c-d2a6-47f0-8c32-af3cd8948c29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:55.562676 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5d66c-d2a6-47f0-8c32-af3cd8948c29 service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:55.567041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbea937-62e4-42a0-9a60-574b73863f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:55.567955 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbea937-62e4-42a0-9a60-574b73863f32 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:55.568352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbea937-62e4-42a0-9a60-574b73863f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:55.568840 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbea937-62e4-42a0-9a60-574b73863f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:55.570718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-fdbea937-62e4-42a0-9a60-574b73863f32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:55.596974 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbea937-62e4-42a0-9a60-574b73863f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:55.598689 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbea937-62e4-42a0-9a60-574b73863f32 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:55.610352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1311/2639] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:50:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:50:58.207695 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9557e4-d983-46c5-bf66-19f052c689f7 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:58.209720 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-9d9557e4-d983-46c5-bf66-19f052c689f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:58.233446 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9557e4-d983-46c5-bf66-19f052c689f7 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:58.239334 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596431e-7385-45c7-9a5e-2e2e36539e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:58.240192 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596431e-7385-45c7-9a5e-2e2e36539e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:58.240476 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596431e-7385-45c7-9a5e-2e2e36539e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:58.240785 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596431e-7385-45c7-9a5e-2e2e36539e99 admin admin] PATH_INFO: `/v3/users/5b0d25ff6a664177b463b834124802d5` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:58.242023 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596431e-7385-45c7-9a5e-2e2e36539e99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b0d25ff6a664177b463b834124802d5)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:58.244022 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596431e-7385-45c7-9a5e-2e2e36539e99 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:58.294054 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0596431e-7385-45c7-9a5e-2e2e36539e99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b0d25ff6a664177b463b834124802d5'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:58.294721 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0596431e-7385-45c7-9a5e-2e2e36539e99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b0d25ff6a664177b463b834124802d5'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:58.306753 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0596431e-7385-45c7-9a5e-2e2e36539e99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b0d25ff6a664177b463b834124802d5'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:58.307757 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0596431e-7385-45c7-9a5e-2e2e36539e99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b0d25ff6a664177b463b834124802d5'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:58.309275 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:58.329166 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0596431e-7385-45c7-9a5e-2e2e36539e99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b0d25ff6a664177b463b834124802d5'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:58.348860 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1329/2640] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:50:58 2022] DELETE /identity/v3/users/5b0d25ff6a664177b463b834124802d5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:58.703475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbea937-62e4-42a0-9a60-574b73863f32 service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:58.721039 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbea937-62e4-42a0-9a60-574b73863f32 service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:58.811070 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56763b-4c68-43e9-9642-9982c18c8c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:58.812900 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56763b-4c68-43e9-9642-9982c18c8c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:58.813382 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56763b-4c68-43e9-9642-9982c18c8c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:58.813663 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56763b-4c68-43e9-9642-9982c18c8c0a admin admin] PATH_INFO: `/v3/projects/fbb8746f17d6410f9c82d0fde348d1f9` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:58.815250 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56763b-4c68-43e9-9642-9982c18c8c0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbb8746f17d6410f9c82d0fde348d1f9)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:58.818268 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56763b-4c68-43e9-9642-9982c18c8c0a admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:58.846790 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:58.892358 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-9e56763b-4c68-43e9-9642-9982c18c8c0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbb8746f17d6410f9c82d0fde348d1f9', 'request_id': 'req-9e56763b-4c68-43e9-9642-9982c18c8c0a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:58.898887 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-9e56763b-4c68-43e9-9642-9982c18c8c0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbb8746f17d6410f9c82d0fde348d1f9', 'request_id': 'req-9e56763b-4c68-43e9-9642-9982c18c8c0a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:58.909313 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-9e56763b-4c68-43e9-9642-9982c18c8c0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbb8746f17d6410f9c82d0fde348d1f9', 'request_id': 'req-9e56763b-4c68-43e9-9642-9982c18c8c0a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:58.926254 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-9e56763b-4c68-43e9-9642-9982c18c8c0a admin admin] The token cache is being invalidate because project fbb8746f17d6410f9c82d0fde348d1f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:50:58.926670 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-9e56763b-4c68-43e9-9642-9982c18c8c0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:58.927326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-9e56763b-4c68-43e9-9642-9982c18c8c0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:50:58.929193 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1312/2641] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:50:58 2022] DELETE /identity/v3/projects/fbb8746f17d6410f9c82d0fde348d1f9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:58.934741 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2ac4a-3945-43e1-8371-2aa0dc32010d None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:58.935036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2ac4a-3945-43e1-8371-2aa0dc32010d None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:58.935424 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2ac4a-3945-43e1-8371-2aa0dc32010d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:58.957377 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-30c2ac4a-3945-43e1-8371-2aa0dc32010d None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:58.958651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-30c2ac4a-3945-43e1-8371-2aa0dc32010d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:59.042017 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1330/2642] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:59.045001 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de590c16-faf1-4178-9cc9-212e6dbb20c4 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:59.045595 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de590c16-faf1-4178-9cc9-212e6dbb20c4 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:59.046034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de590c16-faf1-4178-9cc9-212e6dbb20c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:59.078215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-de590c16-faf1-4178-9cc9-212e6dbb20c4 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:59.079825 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-de590c16-faf1-4178-9cc9-212e6dbb20c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:59.093101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1313/2643] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:50:59.093824 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2ac4a-3945-43e1-8371-2aa0dc32010d None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:59.105688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2ac4a-3945-43e1-8371-2aa0dc32010d None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:59.112533 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ffc82-e860-4092-a286-604f3c87a5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:59.113587 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ffc82-e860-4092-a286-604f3c87a5ad admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:59.113962 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ffc82-e860-4092-a286-604f3c87a5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:59.114862 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ffc82-e860-4092-a286-604f3c87a5ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:59.115998 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ffc82-e860-4092-a286-604f3c87a5ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:50:59.116772 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ffc82-e860-4092-a286-604f3c87a5ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:59.119915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ffc82-e860-4092-a286-604f3c87a5ad admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:59.146058 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de590c16-faf1-4178-9cc9-212e6dbb20c4 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:59.150783 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1331/2644] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:50:59.160824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de590c16-faf1-4178-9cc9-212e6dbb20c4 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:59.166861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b0049-db1c-4483-b6fe-8a3187daa72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:59.167645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b0049-db1c-4483-b6fe-8a3187daa72d admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:59.167936 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b0049-db1c-4483-b6fe-8a3187daa72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:59.168215 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b0049-db1c-4483-b6fe-8a3187daa72d admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:59.168917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b0049-db1c-4483-b6fe-8a3187daa72d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:59.170849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b0049-db1c-4483-b6fe-8a3187daa72d admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:59.217434 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ffc82-e860-4092-a286-604f3c87a5ad admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:59.236013 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1314/2645] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:50:59 2022] POST /identity/v3/projects => generated 379 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:50:59.236611 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ffc82-e860-4092-a286-604f3c87a5ad admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:59.317077 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ce648-52cb-45bb-8e49-24c89d16e709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:59.317790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ce648-52cb-45bb-8e49-24c89d16e709 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:59.318141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ce648-52cb-45bb-8e49-24c89d16e709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:59.318484 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ce648-52cb-45bb-8e49-24c89d16e709 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:59.324136 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ce648-52cb-45bb-8e49-24c89d16e709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:59.326248 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ce648-52cb-45bb-8e49-24c89d16e709 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:59.357226 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1332/2646] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:50:59 2022] POST /identity/v3/users => generated 290 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:50:59.361137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b0049-db1c-4483-b6fe-8a3187daa72d admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:59.375490 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b0049-db1c-4483-b6fe-8a3187daa72d admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:59.380257 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa19423-53e8-4057-9d6d-b1543d5a3763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:59.380926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa19423-53e8-4057-9d6d-b1543d5a3763 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:59.381268 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa19423-53e8-4057-9d6d-b1543d5a3763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:59.381756 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa19423-53e8-4057-9d6d-b1543d5a3763 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:59.382625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa19423-53e8-4057-9d6d-b1543d5a3763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:59.387339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa19423-53e8-4057-9d6d-b1543d5a3763 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:59.400361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1315/2647] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:50:59.404392 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ce648-52cb-45bb-8e49-24c89d16e709 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:59.425602 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ce648-52cb-45bb-8e49-24c89d16e709 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:59.434381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599d9d9-140d-4f1a-a58f-b56de1947ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:59.435103 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599d9d9-140d-4f1a-a58f-b56de1947ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:59.435421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599d9d9-140d-4f1a-a58f-b56de1947ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:59.435926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599d9d9-140d-4f1a-a58f-b56de1947ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:59.436708 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599d9d9-140d-4f1a-a58f-b56de1947ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:59.439105 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599d9d9-140d-4f1a-a58f-b56de1947ad0 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:59.455312 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1333/2648] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:50:59.459159 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa19423-53e8-4057-9d6d-b1543d5a3763 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:59.474055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa19423-53e8-4057-9d6d-b1543d5a3763 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:59.479034 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32242c6e-e2ca-408f-a609-ecdadb275cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:59.480075 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32242c6e-e2ca-408f-a609-ecdadb275cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:59.480463 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32242c6e-e2ca-408f-a609-ecdadb275cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:59.480840 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32242c6e-e2ca-408f-a609-ecdadb275cbc admin admin] PATH_INFO: `/v3/projects/21d4e0a9d56a4fbb8ed5e03cf76fae88/users/c1f46ea393714fc6827a75e6bbd6d03b/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:59.506634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32242c6e-e2ca-408f-a609-ecdadb275cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d4e0a9d56a4fbb8ed5e03cf76fae88, user_id=c1f46ea393714fc6827a75e6bbd6d03b, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:59.510072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32242c6e-e2ca-408f-a609-ecdadb275cbc admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:59.528295 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1316/2649] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:50:59 2022] PUT /identity/v3/projects/21d4e0a9d56a4fbb8ed5e03cf76fae88/users/c1f46ea393714fc6827a75e6bbd6d03b/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:50:59.538946 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9194a-40d3-4b9e-80f1-d00d988bcfc0 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:59.539265 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9194a-40d3-4b9e-80f1-d00d988bcfc0 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:59.539557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9194a-40d3-4b9e-80f1-d00d988bcfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:59.568720 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-1db9194a-40d3-4b9e-80f1-d00d988bcfc0 None None] MFA Rules not processed for user `c1f46ea393714fc6827a75e6bbd6d03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:50:59.569952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-1db9194a-40d3-4b9e-80f1-d00d988bcfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:50:59.609599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:59.669345 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1334/2650] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:50:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:50:59.674219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32242c6e-e2ca-408f-a609-ecdadb275cbc admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:59.745532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32242c6e-e2ca-408f-a609-ecdadb275cbc admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:59.750886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a391ae-def4-4b24-8618-5baef185f0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:59.751336 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a391ae-def4-4b24-8618-5baef185f0fe admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:59.751621 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a391ae-def4-4b24-8618-5baef185f0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:59.751897 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a391ae-def4-4b24-8618-5baef185f0fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:59.752607 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a391ae-def4-4b24-8618-5baef185f0fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:59.754547 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a391ae-def4-4b24-8618-5baef185f0fe admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:59.787338 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1317/2651] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:50:59 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:50:59.788630 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9194a-40d3-4b9e-80f1-d00d988bcfc0 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:59.800651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9194a-40d3-4b9e-80f1-d00d988bcfc0 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:59.874264 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f883554-c488-43bb-a721-6ca58d5187ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:59.875901 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f883554-c488-43bb-a721-6ca58d5187ee admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:59.876423 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f883554-c488-43bb-a721-6ca58d5187ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:59.876808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f883554-c488-43bb-a721-6ca58d5187ee admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:59.877634 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f883554-c488-43bb-a721-6ca58d5187ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:59.879776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f883554-c488-43bb-a721-6ca58d5187ee admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:59.901796 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1335/2652] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:50:59 2022] POST /identity/v3/users => generated 296 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:50:59.905847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a391ae-def4-4b24-8618-5baef185f0fe admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:59.917269 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a391ae-def4-4b24-8618-5baef185f0fe admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:59.924133 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2a377-bd8d-4ee5-b357-353ee9a6bc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:59.924820 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2a377-bd8d-4ee5-b357-353ee9a6bc2e admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:59.925740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2a377-bd8d-4ee5-b357-353ee9a6bc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:59.926023 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2a377-bd8d-4ee5-b357-353ee9a6bc2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:59.926754 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2a377-bd8d-4ee5-b357-353ee9a6bc2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:59.928914 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2a377-bd8d-4ee5-b357-353ee9a6bc2e admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:50:59.942894 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1318/2653] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:50:59.947741 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f883554-c488-43bb-a721-6ca58d5187ee admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:50:59.958355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f883554-c488-43bb-a721-6ca58d5187ee admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:50:59.964007 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a18fa0-bfce-4264-ba09-3ea23b28214a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:50:59.964910 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a18fa0-bfce-4264-ba09-3ea23b28214a admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:50:59.965211 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a18fa0-bfce-4264-ba09-3ea23b28214a admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:50:59.965486 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a18fa0-bfce-4264-ba09-3ea23b28214a admin admin] PATH_INFO: `/v3/projects/6b12b7d4fe42432288e60bbc839e915b/users/9b1150e41f6e49f688b905afb9c4b6f7/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:50:59.981923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a18fa0-bfce-4264-ba09-3ea23b28214a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b12b7d4fe42432288e60bbc839e915b, user_id=9b1150e41f6e49f688b905afb9c4b6f7, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:50:59.984859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a18fa0-bfce-4264-ba09-3ea23b28214a admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:00.001104 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1336/2654] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:50:59 2022] PUT /identity/v3/projects/6b12b7d4fe42432288e60bbc839e915b/users/9b1150e41f6e49f688b905afb9c4b6f7/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:00.005795 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2a377-bd8d-4ee5-b357-353ee9a6bc2e admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:00.017721 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2a377-bd8d-4ee5-b357-353ee9a6bc2e admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:00.030438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:00.084450 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7cee1-3576-4a1f-b43c-bf100911b1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:00.085132 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7cee1-3576-4a1f-b43c-bf100911b1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:00.085412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7cee1-3576-4a1f-b43c-bf100911b1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:00.085689 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7cee1-3576-4a1f-b43c-bf100911b1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:00.086406 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7cee1-3576-4a1f-b43c-bf100911b1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:00.088911 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7cee1-3576-4a1f-b43c-bf100911b1b4 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:00.099205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1319/2655] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:51:00.103543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a18fa0-bfce-4264-ba09-3ea23b28214a admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:00.113797 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a18fa0-bfce-4264-ba09-3ea23b28214a admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:00.118944 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907810f5-a95e-47d8-ad6e-d7d53681a127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:00.119954 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907810f5-a95e-47d8-ad6e-d7d53681a127 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:00.120168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907810f5-a95e-47d8-ad6e-d7d53681a127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:00.120449 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907810f5-a95e-47d8-ad6e-d7d53681a127 admin admin] PATH_INFO: `/v3/projects/6b12b7d4fe42432288e60bbc839e915b/users/9b1150e41f6e49f688b905afb9c4b6f7/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:00.122432 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907810f5-a95e-47d8-ad6e-d7d53681a127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b12b7d4fe42432288e60bbc839e915b, user_id=9b1150e41f6e49f688b905afb9c4b6f7, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:00.125244 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907810f5-a95e-47d8-ad6e-d7d53681a127 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:00.136574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1337/2656] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:51:00 2022] PUT /identity/v3/projects/6b12b7d4fe42432288e60bbc839e915b/users/9b1150e41f6e49f688b905afb9c4b6f7/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:00.146655 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738a168-4dd9-49d0-8d09-92be7bd3e82c None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:00.147063 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738a168-4dd9-49d0-8d09-92be7bd3e82c None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:00.147510 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738a168-4dd9-49d0-8d09-92be7bd3e82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:00.183625 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-f738a168-4dd9-49d0-8d09-92be7bd3e82c None None] MFA Rules not processed for user `9b1150e41f6e49f688b905afb9c4b6f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:00.185004 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-f738a168-4dd9-49d0-8d09-92be7bd3e82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:00.264467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1320/2657] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:00.275816 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907810f5-a95e-47d8-ad6e-d7d53681a127 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:00.277550 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-907810f5-a95e-47d8-ad6e-d7d53681a127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:00.339169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907810f5-a95e-47d8-ad6e-d7d53681a127 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:00.343097 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8d3d4-2840-4859-92e3-7256d6836039 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:00.343799 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8d3d4-2840-4859-92e3-7256d6836039 service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:00.344089 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8d3d4-2840-4859-92e3-7256d6836039 service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:00.344368 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8d3d4-2840-4859-92e3-7256d6836039 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:00.354978 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8d3d4-2840-4859-92e3-7256d6836039 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:00.356500 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8d3d4-2840-4859-92e3-7256d6836039 service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:00.366853 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1338/2658] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:51:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:51:00.443842 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738a168-4dd9-49d0-8d09-92be7bd3e82c None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:00.453847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738a168-4dd9-49d0-8d09-92be7bd3e82c None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:00.457695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7725d6-93e0-440f-986c-e04c15d00ac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:00.458405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7725d6-93e0-440f-986c-e04c15d00ac3 service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:00.458819 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7725d6-93e0-440f-986c-e04c15d00ac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:00.459112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7725d6-93e0-440f-986c-e04c15d00ac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:00.549014 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7725d6-93e0-440f-986c-e04c15d00ac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:00.550465 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7725d6-93e0-440f-986c-e04c15d00ac3 service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:00.562172 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1321/2659] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:51:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:51:02.771476 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8d3d4-2840-4859-92e3-7256d6836039 service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:02.773460 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-e3d8d3d4-2840-4859-92e3-7256d6836039 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:02.803988 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:02.845492 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8d3d4-2840-4859-92e3-7256d6836039 service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:02.850018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90af2d-5fec-4ded-9b72-85dde65d638a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:02.850894 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90af2d-5fec-4ded-9b72-85dde65d638a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:02.851177 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90af2d-5fec-4ded-9b72-85dde65d638a admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:02.851492 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90af2d-5fec-4ded-9b72-85dde65d638a admin admin] PATH_INFO: `/v3/users/5b1a972ace154e93aeb19a53930fd306` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:02.852711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90af2d-5fec-4ded-9b72-85dde65d638a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b1a972ace154e93aeb19a53930fd306)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:02.854639 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90af2d-5fec-4ded-9b72-85dde65d638a admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:02.904670 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ce90af2d-5fec-4ded-9b72-85dde65d638a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b1a972ace154e93aeb19a53930fd306'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:02.905550 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ce90af2d-5fec-4ded-9b72-85dde65d638a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b1a972ace154e93aeb19a53930fd306'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:02.912413 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ce90af2d-5fec-4ded-9b72-85dde65d638a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b1a972ace154e93aeb19a53930fd306'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:02.913033 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ce90af2d-5fec-4ded-9b72-85dde65d638a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b1a972ace154e93aeb19a53930fd306'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:02.924831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-ce90af2d-5fec-4ded-9b72-85dde65d638a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b1a972ace154e93aeb19a53930fd306'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:02.937373 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1339/2660] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:51:02 2022] DELETE /identity/v3/users/5b1a972ace154e93aeb19a53930fd306 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:03.114027 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7725d6-93e0-440f-986c-e04c15d00ac3 service cinder] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:03.127633 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7725d6-93e0-440f-986c-e04c15d00ac3 service cinder] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:03.165137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:03.189490 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1d9bd-62ae-4365-bd57-777bf74f6625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:03.190223 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1d9bd-62ae-4365-bd57-777bf74f6625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:03.190534 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1d9bd-62ae-4365-bd57-777bf74f6625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:03.190810 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1d9bd-62ae-4365-bd57-777bf74f6625 admin admin] PATH_INFO: `/v3/projects/2ed0733b1ce342f2a6ecac960523f85f` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:03.191991 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1d9bd-62ae-4365-bd57-777bf74f6625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ed0733b1ce342f2a6ecac960523f85f)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:03.193865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1d9bd-62ae-4365-bd57-777bf74f6625 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:03.239964 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a1e1d9bd-62ae-4365-bd57-777bf74f6625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed0733b1ce342f2a6ecac960523f85f', 'request_id': 'req-a1e1d9bd-62ae-4365-bd57-777bf74f6625'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:03.247535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a1e1d9bd-62ae-4365-bd57-777bf74f6625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed0733b1ce342f2a6ecac960523f85f', 'request_id': 'req-a1e1d9bd-62ae-4365-bd57-777bf74f6625'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:03.253804 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a1e1d9bd-62ae-4365-bd57-777bf74f6625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed0733b1ce342f2a6ecac960523f85f', 'request_id': 'req-a1e1d9bd-62ae-4365-bd57-777bf74f6625'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:03.265276 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a1e1d9bd-62ae-4365-bd57-777bf74f6625 admin admin] The token cache is being invalidate because project 2ed0733b1ce342f2a6ecac960523f85f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:51:03.265558 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a1e1d9bd-62ae-4365-bd57-777bf74f6625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:03.266201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a1e1d9bd-62ae-4365-bd57-777bf74f6625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:03.267859 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1322/2661] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:51:03 2022] DELETE /identity/v3/projects/2ed0733b1ce342f2a6ecac960523f85f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:03.271971 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90af2d-5fec-4ded-9b72-85dde65d638a admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:03.273507 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-ce90af2d-5fec-4ded-9b72-85dde65d638a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:03.286505 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90af2d-5fec-4ded-9b72-85dde65d638a admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:03.351736 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8abf19-5e2e-46dd-ad13-5eacfeaa768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:03.353768 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8abf19-5e2e-46dd-ad13-5eacfeaa768b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:03.355128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8abf19-5e2e-46dd-ad13-5eacfeaa768b admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:03.355558 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8abf19-5e2e-46dd-ad13-5eacfeaa768b admin admin] PATH_INFO: `/v3/users/150042280c2c4c5299cb63730d67b8d5` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:03.359455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8abf19-5e2e-46dd-ad13-5eacfeaa768b admin admin] RBAC: Authorizing `identity:delete_user(user_id=150042280c2c4c5299cb63730d67b8d5)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:03.359689 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8abf19-5e2e-46dd-ad13-5eacfeaa768b admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:03.420488 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:03.422900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-1c8abf19-5e2e-46dd-ad13-5eacfeaa768b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '150042280c2c4c5299cb63730d67b8d5'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:03.423745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-1c8abf19-5e2e-46dd-ad13-5eacfeaa768b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '150042280c2c4c5299cb63730d67b8d5'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:03.433581 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-1c8abf19-5e2e-46dd-ad13-5eacfeaa768b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '150042280c2c4c5299cb63730d67b8d5'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:03.434663 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-1c8abf19-5e2e-46dd-ad13-5eacfeaa768b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '150042280c2c4c5299cb63730d67b8d5'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:03.453774 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-1c8abf19-5e2e-46dd-ad13-5eacfeaa768b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '150042280c2c4c5299cb63730d67b8d5'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:03.468429 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1340/2662] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:51:03 2022] DELETE /identity/v3/users/150042280c2c4c5299cb63730d67b8d5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:51:03.642578 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1d9bd-62ae-4365-bd57-777bf74f6625 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:03.644103 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-a1e1d9bd-62ae-4365-bd57-777bf74f6625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:03.657484 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1d9bd-62ae-4365-bd57-777bf74f6625 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:03.716479 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5512e78-08f2-4d41-8669-dd6d848e884c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:03.717386 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5512e78-08f2-4d41-8669-dd6d848e884c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:03.717667 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5512e78-08f2-4d41-8669-dd6d848e884c admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:03.717943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5512e78-08f2-4d41-8669-dd6d848e884c admin admin] PATH_INFO: `/v3/projects/e45e0a6597e548d6800eb3c3f91313b0` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:03.719153 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5512e78-08f2-4d41-8669-dd6d848e884c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e45e0a6597e548d6800eb3c3f91313b0)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:03.721111 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5512e78-08f2-4d41-8669-dd6d848e884c admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:03.766760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f5512e78-08f2-4d41-8669-dd6d848e884c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e45e0a6597e548d6800eb3c3f91313b0', 'request_id': 'req-f5512e78-08f2-4d41-8669-dd6d848e884c'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:03.773690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f5512e78-08f2-4d41-8669-dd6d848e884c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e45e0a6597e548d6800eb3c3f91313b0', 'request_id': 'req-f5512e78-08f2-4d41-8669-dd6d848e884c'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:03.779751 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f5512e78-08f2-4d41-8669-dd6d848e884c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e45e0a6597e548d6800eb3c3f91313b0', 'request_id': 'req-f5512e78-08f2-4d41-8669-dd6d848e884c'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:03.785944 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:03.791517 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f5512e78-08f2-4d41-8669-dd6d848e884c admin admin] The token cache is being invalidate because project e45e0a6597e548d6800eb3c3f91313b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:51:03.792019 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f5512e78-08f2-4d41-8669-dd6d848e884c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:03.793277 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f5512e78-08f2-4d41-8669-dd6d848e884c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:03.795030 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1323/2663] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:51:03 2022] DELETE /identity/v3/projects/e45e0a6597e548d6800eb3c3f91313b0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:51:12.506595 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8abf19-5e2e-46dd-ad13-5eacfeaa768b admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:12.508042 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-1c8abf19-5e2e-46dd-ad13-5eacfeaa768b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:12.520620 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8abf19-5e2e-46dd-ad13-5eacfeaa768b admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:12.575779 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0437d-a6bb-4d73-839e-54feab33f0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:12.576648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0437d-a6bb-4d73-839e-54feab33f0ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:12.576934 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0437d-a6bb-4d73-839e-54feab33f0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:12.577212 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0437d-a6bb-4d73-839e-54feab33f0ff admin admin] PATH_INFO: `/v3/users/c1f46ea393714fc6827a75e6bbd6d03b` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:12.578381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0437d-a6bb-4d73-839e-54feab33f0ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1f46ea393714fc6827a75e6bbd6d03b)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:12.580339 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0437d-a6bb-4d73-839e-54feab33f0ff admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:12.627130 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-64d0437d-a6bb-4d73-839e-54feab33f0ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1f46ea393714fc6827a75e6bbd6d03b'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:12.627732 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-64d0437d-a6bb-4d73-839e-54feab33f0ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1f46ea393714fc6827a75e6bbd6d03b'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:12.635052 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-64d0437d-a6bb-4d73-839e-54feab33f0ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1f46ea393714fc6827a75e6bbd6d03b'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:12.635735 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-64d0437d-a6bb-4d73-839e-54feab33f0ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1f46ea393714fc6827a75e6bbd6d03b'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:12.648491 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-64d0437d-a6bb-4d73-839e-54feab33f0ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1f46ea393714fc6827a75e6bbd6d03b'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:12.664291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1341/2664] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:51:12 2022] DELETE /identity/v3/users/c1f46ea393714fc6827a75e6bbd6d03b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:12.670426 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48934d-1125-4247-9a49-f40491b13e18 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:12.671186 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48934d-1125-4247-9a49-f40491b13e18 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:12.671436 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48934d-1125-4247-9a49-f40491b13e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:12.689399 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-3d48934d-1125-4247-9a49-f40491b13e18 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:12.690596 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-3d48934d-1125-4247-9a49-f40491b13e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:12.749793 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1324/2665] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:12.759578 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0437d-a6bb-4d73-839e-54feab33f0ff admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:12.760977 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-64d0437d-a6bb-4d73-839e-54feab33f0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:12.809049 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:12.826788 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0437d-a6bb-4d73-839e-54feab33f0ff admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:12.830469 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b718a-e376-4272-9af8-55c7d210e062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:12.831117 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b718a-e376-4272-9af8-55c7d210e062 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:12.831439 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b718a-e376-4272-9af8-55c7d210e062 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:12.831718 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b718a-e376-4272-9af8-55c7d210e062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:12.841571 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b718a-e376-4272-9af8-55c7d210e062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:12.843046 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b718a-e376-4272-9af8-55c7d210e062 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:12.852413 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1342/2666] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:51:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:51:13.123064 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48934d-1125-4247-9a49-f40491b13e18 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:13.124495 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-3d48934d-1125-4247-9a49-f40491b13e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:13.137686 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48934d-1125-4247-9a49-f40491b13e18 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:13.142502 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6db49-fe08-405f-b831-72c106eb3913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:13.143499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6db49-fe08-405f-b831-72c106eb3913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:13.143784 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6db49-fe08-405f-b831-72c106eb3913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:13.144060 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6db49-fe08-405f-b831-72c106eb3913 admin admin] PATH_INFO: `/v3/projects/21d4e0a9d56a4fbb8ed5e03cf76fae88` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:13.145238 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6db49-fe08-405f-b831-72c106eb3913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21d4e0a9d56a4fbb8ed5e03cf76fae88)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:13.147142 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6db49-fe08-405f-b831-72c106eb3913 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:13.194443 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a1b6db49-fe08-405f-b831-72c106eb3913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21d4e0a9d56a4fbb8ed5e03cf76fae88', 'request_id': 'req-a1b6db49-fe08-405f-b831-72c106eb3913'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:13.203032 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a1b6db49-fe08-405f-b831-72c106eb3913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21d4e0a9d56a4fbb8ed5e03cf76fae88', 'request_id': 'req-a1b6db49-fe08-405f-b831-72c106eb3913'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:13.209341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a1b6db49-fe08-405f-b831-72c106eb3913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21d4e0a9d56a4fbb8ed5e03cf76fae88', 'request_id': 'req-a1b6db49-fe08-405f-b831-72c106eb3913'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:13.219851 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a1b6db49-fe08-405f-b831-72c106eb3913 admin admin] The token cache is being invalidate because project 21d4e0a9d56a4fbb8ed5e03cf76fae88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:51:13.220133 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a1b6db49-fe08-405f-b831-72c106eb3913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:13.220754 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a1b6db49-fe08-405f-b831-72c106eb3913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:13.222265 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1325/2667] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:51:13 2022] DELETE /identity/v3/projects/21d4e0a9d56a4fbb8ed5e03cf76fae88 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:13.226191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b718a-e376-4272-9af8-55c7d210e062 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:13.236413 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b718a-e376-4272-9af8-55c7d210e062 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:13.291784 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029f26e-b445-4c12-9718-b533aa8f7953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:13.292657 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029f26e-b445-4c12-9718-b533aa8f7953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:13.292942 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029f26e-b445-4c12-9718-b533aa8f7953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:13.293216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029f26e-b445-4c12-9718-b533aa8f7953 admin admin] PATH_INFO: `/v3/users/9b1150e41f6e49f688b905afb9c4b6f7` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:13.294402 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029f26e-b445-4c12-9718-b533aa8f7953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b1150e41f6e49f688b905afb9c4b6f7)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:13.296374 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029f26e-b445-4c12-9718-b533aa8f7953 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:13.342267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-a029f26e-b445-4c12-9718-b533aa8f7953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b1150e41f6e49f688b905afb9c4b6f7'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:13.342919 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-a029f26e-b445-4c12-9718-b533aa8f7953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b1150e41f6e49f688b905afb9c4b6f7'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:13.349811 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-a029f26e-b445-4c12-9718-b533aa8f7953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b1150e41f6e49f688b905afb9c4b6f7'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:13.350439 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-a029f26e-b445-4c12-9718-b533aa8f7953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b1150e41f6e49f688b905afb9c4b6f7'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:13.362654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-a029f26e-b445-4c12-9718-b533aa8f7953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b1150e41f6e49f688b905afb9c4b6f7'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:13.375612 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1343/2668] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:51:13 2022] DELETE /identity/v3/users/9b1150e41f6e49f688b905afb9c4b6f7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:13.641486 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6db49-fe08-405f-b831-72c106eb3913 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:13.643083 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-a1b6db49-fe08-405f-b831-72c106eb3913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:13.659546 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6db49-fe08-405f-b831-72c106eb3913 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:13.717780 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562940d-a15a-49b3-a5be-0ef38cdaa51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:13.718646 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562940d-a15a-49b3-a5be-0ef38cdaa51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:13.718981 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562940d-a15a-49b3-a5be-0ef38cdaa51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:13.719207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562940d-a15a-49b3-a5be-0ef38cdaa51f admin admin] PATH_INFO: `/v3/projects/6b12b7d4fe42432288e60bbc839e915b` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:13.720430 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562940d-a15a-49b3-a5be-0ef38cdaa51f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b12b7d4fe42432288e60bbc839e915b)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:13.722352 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562940d-a15a-49b3-a5be-0ef38cdaa51f admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:13.747764 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:13.770255 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a562940d-a15a-49b3-a5be-0ef38cdaa51f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b12b7d4fe42432288e60bbc839e915b', 'request_id': 'req-a562940d-a15a-49b3-a5be-0ef38cdaa51f'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:13.777740 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a562940d-a15a-49b3-a5be-0ef38cdaa51f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b12b7d4fe42432288e60bbc839e915b', 'request_id': 'req-a562940d-a15a-49b3-a5be-0ef38cdaa51f'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:13.783806 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a562940d-a15a-49b3-a5be-0ef38cdaa51f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b12b7d4fe42432288e60bbc839e915b', 'request_id': 'req-a562940d-a15a-49b3-a5be-0ef38cdaa51f'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:13.794558 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a562940d-a15a-49b3-a5be-0ef38cdaa51f admin admin] The token cache is being invalidate because project 6b12b7d4fe42432288e60bbc839e915b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:51:13.794839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a562940d-a15a-49b3-a5be-0ef38cdaa51f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:13.795483 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a562940d-a15a-49b3-a5be-0ef38cdaa51f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:13.797027 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1326/2669] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:51:13 2022] DELETE /identity/v3/projects/6b12b7d4fe42432288e60bbc839e915b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:51:13.802004 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbd5e1-8aa6-4bc1-9d58-bd35eef28209 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:13.802465 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbd5e1-8aa6-4bc1-9d58-bd35eef28209 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:13.802564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbd5e1-8aa6-4bc1-9d58-bd35eef28209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:13.819986 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-f9bbd5e1-8aa6-4bc1-9d58-bd35eef28209 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:13.821238 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f9bbd5e1-8aa6-4bc1-9d58-bd35eef28209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:13.886313 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1344/2670] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:13.895263 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8d13a-782d-4ac2-8f0c-d14b50479b9f None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:13.895641 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8d13a-782d-4ac2-8f0c-d14b50479b9f None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:13.895915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8d13a-782d-4ac2-8f0c-d14b50479b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:13.920388 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-6cd8d13a-782d-4ac2-8f0c-d14b50479b9f None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:13.921612 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-6cd8d13a-782d-4ac2-8f0c-d14b50479b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:13.929415 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1327/2671] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:13.933576 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbd5e1-8aa6-4bc1-9d58-bd35eef28209 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:13.939778 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:13.943511 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbd5e1-8aa6-4bc1-9d58-bd35eef28209 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:13.949980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4831ae-3c10-40c5-baba-c7a11acef50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:13.950855 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4831ae-3c10-40c5-baba-c7a11acef50b admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:13.951366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4831ae-3c10-40c5-baba-c7a11acef50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:13.951710 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4831ae-3c10-40c5-baba-c7a11acef50b admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:13.952580 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4831ae-3c10-40c5-baba-c7a11acef50b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:51:13.952897 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4831ae-3c10-40c5-baba-c7a11acef50b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:13.954508 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4831ae-3c10-40c5-baba-c7a11acef50b admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:13.966557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1345/2672] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:51:13.970847 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8d13a-782d-4ac2-8f0c-d14b50479b9f None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:13.979963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8d13a-782d-4ac2-8f0c-d14b50479b9f None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:13.984628 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2a069-a897-493d-b173-c8951629278a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:13.985272 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2a069-a897-493d-b173-c8951629278a admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:13.985555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2a069-a897-493d-b173-c8951629278a admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:13.985830 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2a069-a897-493d-b173-c8951629278a admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:13.986525 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2a069-a897-493d-b173-c8951629278a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:13.988449 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2a069-a897-493d-b173-c8951629278a admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:14.013538 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1328/2673] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:51:13 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:51:14.017414 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4831ae-3c10-40c5-baba-c7a11acef50b admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:14.027815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4831ae-3c10-40c5-baba-c7a11acef50b admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:14.085203 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352e513-1efd-4c5d-88c4-c1c49fb2e831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:14.085876 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352e513-1efd-4c5d-88c4-c1c49fb2e831 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:14.086158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352e513-1efd-4c5d-88c4-c1c49fb2e831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:14.086428 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352e513-1efd-4c5d-88c4-c1c49fb2e831 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:14.087119 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352e513-1efd-4c5d-88c4-c1c49fb2e831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:14.089749 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352e513-1efd-4c5d-88c4-c1c49fb2e831 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:14.109329 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1346/2674] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:51:14 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:51:14.113733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2a069-a897-493d-b173-c8951629278a admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:14.124516 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2a069-a897-493d-b173-c8951629278a admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:14.129216 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9038bf6-c920-4f53-bee9-a67007c23203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:14.129875 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9038bf6-c920-4f53-bee9-a67007c23203 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:14.130158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9038bf6-c920-4f53-bee9-a67007c23203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:14.130432 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9038bf6-c920-4f53-bee9-a67007c23203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:14.131149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9038bf6-c920-4f53-bee9-a67007c23203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:14.132787 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9038bf6-c920-4f53-bee9-a67007c23203 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:14.143985 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1329/2675] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:51:14.147899 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352e513-1efd-4c5d-88c4-c1c49fb2e831 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:14.158432 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352e513-1efd-4c5d-88c4-c1c49fb2e831 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:14.163024 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc2833-394f-4633-a361-2b81900d1e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:14.163711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc2833-394f-4633-a361-2b81900d1e42 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:14.164001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc2833-394f-4633-a361-2b81900d1e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:14.164282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc2833-394f-4633-a361-2b81900d1e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:14.165003 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc2833-394f-4633-a361-2b81900d1e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:14.166610 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc2833-394f-4633-a361-2b81900d1e42 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:14.176380 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1347/2676] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:51:14.180269 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9038bf6-c920-4f53-bee9-a67007c23203 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:14.190114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9038bf6-c920-4f53-bee9-a67007c23203 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:14.194732 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382da72-b901-445c-a324-492ced40eae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:14.195624 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382da72-b901-445c-a324-492ced40eae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:14.195904 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382da72-b901-445c-a324-492ced40eae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:14.196182 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382da72-b901-445c-a324-492ced40eae9 admin admin] PATH_INFO: `/v3/projects/8e1c37e25f154ebd8170e5656a2b74fd/users/bbcec91ceb0c44909c950df0842d81d1/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:14.210735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382da72-b901-445c-a324-492ced40eae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1c37e25f154ebd8170e5656a2b74fd, user_id=bbcec91ceb0c44909c950df0842d81d1, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:14.214093 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382da72-b901-445c-a324-492ced40eae9 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:14.227101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1330/2677] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:51:14 2022] PUT /identity/v3/projects/8e1c37e25f154ebd8170e5656a2b74fd/users/bbcec91ceb0c44909c950df0842d81d1/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:51:14.237102 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9e0fd-b20c-4e4c-98a1-97579c2c0d7f None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:14.237400 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9e0fd-b20c-4e4c-98a1-97579c2c0d7f None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:14.237688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9e0fd-b20c-4e4c-98a1-97579c2c0d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:14.264159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-47c9e0fd-b20c-4e4c-98a1-97579c2c0d7f None None] MFA Rules not processed for user `bbcec91ceb0c44909c950df0842d81d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:14.265363 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-47c9e0fd-b20c-4e4c-98a1-97579c2c0d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:14.328361 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1348/2678] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:14.332685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382da72-b901-445c-a324-492ced40eae9 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:14.396488 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382da72-b901-445c-a324-492ced40eae9 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:14.401197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8a621-91b0-43d1-bc42-756359f0e45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:14.401861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8a621-91b0-43d1-bc42-756359f0e45c admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:14.402148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8a621-91b0-43d1-bc42-756359f0e45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:14.402426 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8a621-91b0-43d1-bc42-756359f0e45c admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:14.403115 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8a621-91b0-43d1-bc42-756359f0e45c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:14.405055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8a621-91b0-43d1-bc42-756359f0e45c admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:14.429807 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1331/2679] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:51:14 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:51:14.434291 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9e0fd-b20c-4e4c-98a1-97579c2c0d7f None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:14.444940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9e0fd-b20c-4e4c-98a1-97579c2c0d7f None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:14.500486 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c59241-bf6d-4ea5-8a13-24e01e26ffbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:14.501080 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c59241-bf6d-4ea5-8a13-24e01e26ffbb admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:14.501367 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c59241-bf6d-4ea5-8a13-24e01e26ffbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:14.501649 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c59241-bf6d-4ea5-8a13-24e01e26ffbb admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:14.502347 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c59241-bf6d-4ea5-8a13-24e01e26ffbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:14.504325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c59241-bf6d-4ea5-8a13-24e01e26ffbb admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:14.511398 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:14.525757 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1349/2680] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:51:14 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:51:14.529663 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8a621-91b0-43d1-bc42-756359f0e45c admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:14.540113 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8a621-91b0-43d1-bc42-756359f0e45c admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:14.544674 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb404b87-311a-429f-888f-e0e1a6d43382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:14.545328 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb404b87-311a-429f-888f-e0e1a6d43382 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:14.545609 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb404b87-311a-429f-888f-e0e1a6d43382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:14.545883 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb404b87-311a-429f-888f-e0e1a6d43382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:14.546590 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb404b87-311a-429f-888f-e0e1a6d43382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:14.548206 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb404b87-311a-429f-888f-e0e1a6d43382 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:14.559072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1332/2681] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:51:14.562925 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c59241-bf6d-4ea5-8a13-24e01e26ffbb admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:14.573140 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c59241-bf6d-4ea5-8a13-24e01e26ffbb admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:14.577648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2d376-ac18-4052-b5df-f85b6575bf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:14.578508 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2d376-ac18-4052-b5df-f85b6575bf01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:14.578791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2d376-ac18-4052-b5df-f85b6575bf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:14.579071 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2d376-ac18-4052-b5df-f85b6575bf01 admin admin] PATH_INFO: `/v3/projects/9ca36cb0c39a48aba7779d4676cbcc5c/users/564af828e9364571b84d09cf4207a21d/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:14.593634 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2d376-ac18-4052-b5df-f85b6575bf01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca36cb0c39a48aba7779d4676cbcc5c, user_id=564af828e9364571b84d09cf4207a21d, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:14.596326 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2d376-ac18-4052-b5df-f85b6575bf01 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:14.609076 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1350/2682] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:51:14 2022] PUT /identity/v3/projects/9ca36cb0c39a48aba7779d4676cbcc5c/users/564af828e9364571b84d09cf4207a21d/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:51:14.612898 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb404b87-311a-429f-888f-e0e1a6d43382 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:14.623326 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb404b87-311a-429f-888f-e0e1a6d43382 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:14.642533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:14.680871 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fd307-e3b8-40d7-9cef-02e3baa4dda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:14.681541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fd307-e3b8-40d7-9cef-02e3baa4dda9 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:14.682332 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fd307-e3b8-40d7-9cef-02e3baa4dda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:14.682609 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fd307-e3b8-40d7-9cef-02e3baa4dda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:14.683356 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fd307-e3b8-40d7-9cef-02e3baa4dda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:14.684941 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fd307-e3b8-40d7-9cef-02e3baa4dda9 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:14.694480 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1333/2683] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:51:14.698522 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2d376-ac18-4052-b5df-f85b6575bf01 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:14.708688 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2d376-ac18-4052-b5df-f85b6575bf01 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:14.713319 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029552e5-0498-499b-b0b0-61b3785a0900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:14.714463 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029552e5-0498-499b-b0b0-61b3785a0900 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:14.714749 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029552e5-0498-499b-b0b0-61b3785a0900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:14.715026 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029552e5-0498-499b-b0b0-61b3785a0900 admin admin] PATH_INFO: `/v3/projects/9ca36cb0c39a48aba7779d4676cbcc5c/users/564af828e9364571b84d09cf4207a21d/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:14.717046 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029552e5-0498-499b-b0b0-61b3785a0900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca36cb0c39a48aba7779d4676cbcc5c, user_id=564af828e9364571b84d09cf4207a21d, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:14.719736 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029552e5-0498-499b-b0b0-61b3785a0900 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:14.730276 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1351/2684] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:51:14 2022] PUT /identity/v3/projects/9ca36cb0c39a48aba7779d4676cbcc5c/users/564af828e9364571b84d09cf4207a21d/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:14.740181 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9184af-6e13-48c3-83fc-9c24fd1e455a None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:14.740660 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9184af-6e13-48c3-83fc-9c24fd1e455a None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:14.740781 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9184af-6e13-48c3-83fc-9c24fd1e455a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:14.767216 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-5e9184af-6e13-48c3-83fc-9c24fd1e455a None None] MFA Rules not processed for user `564af828e9364571b84d09cf4207a21d`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:14.768461 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-5e9184af-6e13-48c3-83fc-9c24fd1e455a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:14.836576 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1334/2685] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:14 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:14.847939 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029552e5-0498-499b-b0b0-61b3785a0900 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:14.849676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-029552e5-0498-499b-b0b0-61b3785a0900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:14.907507 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029552e5-0498-499b-b0b0-61b3785a0900 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:14.911345 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e2500-d44f-4a6f-bcba-c983ca353cdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:14.911996 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e2500-d44f-4a6f-bcba-c983ca353cdc service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:14.912283 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e2500-d44f-4a6f-bcba-c983ca353cdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:14.912564 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e2500-d44f-4a6f-bcba-c983ca353cdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:14.926135 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e2500-d44f-4a6f-bcba-c983ca353cdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:14.927601 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e2500-d44f-4a6f-bcba-c983ca353cdc service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:14.937548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1352/2686] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:51:14 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:51:14.981575 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9184af-6e13-48c3-83fc-9c24fd1e455a None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:14.982963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-5e9184af-6e13-48c3-83fc-9c24fd1e455a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:14.995339 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9184af-6e13-48c3-83fc-9c24fd1e455a None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:14.998886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22e54f-2261-467d-850d-4782f21c46fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:14.999539 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22e54f-2261-467d-850d-4782f21c46fe service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:14.999819 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22e54f-2261-467d-850d-4782f21c46fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:15.000090 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22e54f-2261-467d-850d-4782f21c46fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:15.055882 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22e54f-2261-467d-850d-4782f21c46fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:15.057835 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22e54f-2261-467d-850d-4782f21c46fe service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:15.067234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1335/2687] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:51:14 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:51:18.298859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e2500-d44f-4a6f-bcba-c983ca353cdc service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:18.361234 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e2500-d44f-4a6f-bcba-c983ca353cdc service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:18.365820 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e073c4-2f1e-47c3-afa1-652787397f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:18.366692 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e073c4-2f1e-47c3-afa1-652787397f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:18.366976 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e073c4-2f1e-47c3-afa1-652787397f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:18.367251 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e073c4-2f1e-47c3-afa1-652787397f93 admin admin] PATH_INFO: `/v3/users/bbcec91ceb0c44909c950df0842d81d1` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:18.368467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e073c4-2f1e-47c3-afa1-652787397f93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbcec91ceb0c44909c950df0842d81d1)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:18.370889 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e073c4-2f1e-47c3-afa1-652787397f93 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:18.416580 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-05e073c4-2f1e-47c3-afa1-652787397f93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbcec91ceb0c44909c950df0842d81d1'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:18.417222 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-05e073c4-2f1e-47c3-afa1-652787397f93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbcec91ceb0c44909c950df0842d81d1'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:18.424017 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-05e073c4-2f1e-47c3-afa1-652787397f93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbcec91ceb0c44909c950df0842d81d1'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:18.424650 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-05e073c4-2f1e-47c3-afa1-652787397f93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbcec91ceb0c44909c950df0842d81d1'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:18.425756 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:18.439113 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-05e073c4-2f1e-47c3-afa1-652787397f93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbcec91ceb0c44909c950df0842d81d1'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:18.451641 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1353/2688] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:51:18 2022] DELETE /identity/v3/users/bbcec91ceb0c44909c950df0842d81d1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:18.456205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d36ad-0587-4a5b-b08d-4b6ccf4430a3 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:18.456685 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d36ad-0587-4a5b-b08d-4b6ccf4430a3 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:18.456788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d36ad-0587-4a5b-b08d-4b6ccf4430a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:18.473803 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-4d5d36ad-0587-4a5b-b08d-4b6ccf4430a3 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:18.474999 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-4d5d36ad-0587-4a5b-b08d-4b6ccf4430a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:18.513492 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=100 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:18.533674 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1336/2689] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:18.543875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e073c4-2f1e-47c3-afa1-652787397f93 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:18.545273 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-05e073c4-2f1e-47c3-afa1-652787397f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:18.601076 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e073c4-2f1e-47c3-afa1-652787397f93 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:18.605159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2b63e-fee8-4311-8b16-1daf272b5d63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:18.605802 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2b63e-fee8-4311-8b16-1daf272b5d63 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:18.606082 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2b63e-fee8-4311-8b16-1daf272b5d63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:18.606356 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2b63e-fee8-4311-8b16-1daf272b5d63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:18.615329 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2b63e-fee8-4311-8b16-1daf272b5d63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:18.616762 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2b63e-fee8-4311-8b16-1daf272b5d63 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:18.626530 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1354/2690] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:51:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:51:18.887145 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d36ad-0587-4a5b-b08d-4b6ccf4430a3 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:18.888931 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-4d5d36ad-0587-4a5b-b08d-4b6ccf4430a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:18.901850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d36ad-0587-4a5b-b08d-4b6ccf4430a3 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:18.906405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d09a00-d680-481b-96bf-84795602835a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:18.907267 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d09a00-d680-481b-96bf-84795602835a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:18.907645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d09a00-d680-481b-96bf-84795602835a admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:18.907917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d09a00-d680-481b-96bf-84795602835a admin admin] PATH_INFO: `/v3/projects/8e1c37e25f154ebd8170e5656a2b74fd` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:18.909205 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d09a00-d680-481b-96bf-84795602835a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e1c37e25f154ebd8170e5656a2b74fd)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:18.911019 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d09a00-d680-481b-96bf-84795602835a admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:18.958375 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-45d09a00-d680-481b-96bf-84795602835a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e1c37e25f154ebd8170e5656a2b74fd', 'request_id': 'req-45d09a00-d680-481b-96bf-84795602835a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:18.966956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-45d09a00-d680-481b-96bf-84795602835a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e1c37e25f154ebd8170e5656a2b74fd', 'request_id': 'req-45d09a00-d680-481b-96bf-84795602835a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:18.973576 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-45d09a00-d680-481b-96bf-84795602835a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e1c37e25f154ebd8170e5656a2b74fd', 'request_id': 'req-45d09a00-d680-481b-96bf-84795602835a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:18.984207 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-45d09a00-d680-481b-96bf-84795602835a admin admin] The token cache is being invalidate because project 8e1c37e25f154ebd8170e5656a2b74fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:51:18.984490 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-45d09a00-d680-481b-96bf-84795602835a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:18.985111 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-45d09a00-d680-481b-96bf-84795602835a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:18.986627 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1337/2691] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:51:18 2022] DELETE /identity/v3/projects/8e1c37e25f154ebd8170e5656a2b74fd => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:18.990595 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2b63e-fee8-4311-8b16-1daf272b5d63 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:19.000052 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2b63e-fee8-4311-8b16-1daf272b5d63 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:19.055305 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67791e1a-5bca-4f5f-8457-3ed29567afe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:19.056190 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67791e1a-5bca-4f5f-8457-3ed29567afe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:19.056473 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67791e1a-5bca-4f5f-8457-3ed29567afe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:19.056748 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67791e1a-5bca-4f5f-8457-3ed29567afe4 admin admin] PATH_INFO: `/v3/users/564af828e9364571b84d09cf4207a21d` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:19.057921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67791e1a-5bca-4f5f-8457-3ed29567afe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=564af828e9364571b84d09cf4207a21d)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:19.059900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67791e1a-5bca-4f5f-8457-3ed29567afe4 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:19.112759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-67791e1a-5bca-4f5f-8457-3ed29567afe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '564af828e9364571b84d09cf4207a21d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:19.113483 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-67791e1a-5bca-4f5f-8457-3ed29567afe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '564af828e9364571b84d09cf4207a21d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:19.130141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-67791e1a-5bca-4f5f-8457-3ed29567afe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '564af828e9364571b84d09cf4207a21d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:19.130857 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-67791e1a-5bca-4f5f-8457-3ed29567afe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '564af828e9364571b84d09cf4207a21d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:19.143263 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-67791e1a-5bca-4f5f-8457-3ed29567afe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '564af828e9364571b84d09cf4207a21d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:19.146830 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:19.156958 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1355/2692] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:51:18 2022] DELETE /identity/v3/users/564af828e9364571b84d09cf4207a21d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:51:19.418982 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d09a00-d680-481b-96bf-84795602835a admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:19.421540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-45d09a00-d680-481b-96bf-84795602835a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:19.436423 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d09a00-d680-481b-96bf-84795602835a admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:19.494259 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54faad4b-27c4-4353-b063-380ffbc11160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:19.495121 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54faad4b-27c4-4353-b063-380ffbc11160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:19.495441 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54faad4b-27c4-4353-b063-380ffbc11160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:19.495718 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54faad4b-27c4-4353-b063-380ffbc11160 admin admin] PATH_INFO: `/v3/projects/9ca36cb0c39a48aba7779d4676cbcc5c` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:19.496875 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54faad4b-27c4-4353-b063-380ffbc11160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca36cb0c39a48aba7779d4676cbcc5c)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:19.498773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54faad4b-27c4-4353-b063-380ffbc11160 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:19.544478 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-54faad4b-27c4-4353-b063-380ffbc11160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca36cb0c39a48aba7779d4676cbcc5c', 'request_id': 'req-54faad4b-27c4-4353-b063-380ffbc11160'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:19.551661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-54faad4b-27c4-4353-b063-380ffbc11160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca36cb0c39a48aba7779d4676cbcc5c', 'request_id': 'req-54faad4b-27c4-4353-b063-380ffbc11160'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:19.557749 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-54faad4b-27c4-4353-b063-380ffbc11160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca36cb0c39a48aba7779d4676cbcc5c', 'request_id': 'req-54faad4b-27c4-4353-b063-380ffbc11160'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:19.562282 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:19.570603 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-54faad4b-27c4-4353-b063-380ffbc11160 admin admin] The token cache is being invalidate because project 9ca36cb0c39a48aba7779d4676cbcc5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:51:19.571017 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-54faad4b-27c4-4353-b063-380ffbc11160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:19.572046 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-54faad4b-27c4-4353-b063-380ffbc11160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:19.574091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1338/2693] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:51:19 2022] DELETE /identity/v3/projects/9ca36cb0c39a48aba7779d4676cbcc5c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:19.579226 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af889e-2b62-4e54-882d-a9945ef2db5e None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:19.579720 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af889e-2b62-4e54-882d-a9945ef2db5e None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:19.579814 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af889e-2b62-4e54-882d-a9945ef2db5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:19.597742 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-b8af889e-2b62-4e54-882d-a9945ef2db5e None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:19.598934 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-b8af889e-2b62-4e54-882d-a9945ef2db5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:19.657176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1356/2694] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:19.664947 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42729441-64bd-4f9d-89d5-122e487ad928 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:19.665242 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42729441-64bd-4f9d-89d5-122e487ad928 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:19.665524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42729441-64bd-4f9d-89d5-122e487ad928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:19.683944 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-42729441-64bd-4f9d-89d5-122e487ad928 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:19.685149 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-42729441-64bd-4f9d-89d5-122e487ad928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:19.693006 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1339/2695] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:19.697114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af889e-2b62-4e54-882d-a9945ef2db5e None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:19.707268 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af889e-2b62-4e54-882d-a9945ef2db5e None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:19.711825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf994a-1d00-4de9-b4c5-f2b97df9f83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:19.712475 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf994a-1d00-4de9-b4c5-f2b97df9f83b admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:19.712760 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf994a-1d00-4de9-b4c5-f2b97df9f83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:19.713038 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf994a-1d00-4de9-b4c5-f2b97df9f83b admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:19.714030 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf994a-1d00-4de9-b4c5-f2b97df9f83b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:51:19.714338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf994a-1d00-4de9-b4c5-f2b97df9f83b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:19.715975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf994a-1d00-4de9-b4c5-f2b97df9f83b admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:19.727357 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1357/2696] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:51:19.731614 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42729441-64bd-4f9d-89d5-122e487ad928 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:19.740823 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42729441-64bd-4f9d-89d5-122e487ad928 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:19.746026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fa019-7d4f-4e0b-866d-f845e9193e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:19.746669 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fa019-7d4f-4e0b-866d-f845e9193e5f admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:19.746955 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fa019-7d4f-4e0b-866d-f845e9193e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:19.747232 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fa019-7d4f-4e0b-866d-f845e9193e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:19.747941 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fa019-7d4f-4e0b-866d-f845e9193e5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:19.749827 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fa019-7d4f-4e0b-866d-f845e9193e5f admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:19.775520 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1340/2697] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:51:19 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:51:19.779535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf994a-1d00-4de9-b4c5-f2b97df9f83b admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:19.789313 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf994a-1d00-4de9-b4c5-f2b97df9f83b admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:19.845594 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f9b82-f439-4c87-ad85-7cc68a3b8de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:19.846217 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f9b82-f439-4c87-ad85-7cc68a3b8de4 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:19.846503 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f9b82-f439-4c87-ad85-7cc68a3b8de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:19.846782 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f9b82-f439-4c87-ad85-7cc68a3b8de4 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:19.847516 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f9b82-f439-4c87-ad85-7cc68a3b8de4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:19.849444 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f9b82-f439-4c87-ad85-7cc68a3b8de4 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:19.868401 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1358/2698] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:51:19 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:51:19.873109 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fa019-7d4f-4e0b-866d-f845e9193e5f admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:19.883826 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fa019-7d4f-4e0b-866d-f845e9193e5f admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:19.889496 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecf0a7-ee6b-46e4-8c38-c2da4811d82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:19.890183 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecf0a7-ee6b-46e4-8c38-c2da4811d82b admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:19.890463 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecf0a7-ee6b-46e4-8c38-c2da4811d82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:19.890758 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecf0a7-ee6b-46e4-8c38-c2da4811d82b admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:19.891529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecf0a7-ee6b-46e4-8c38-c2da4811d82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:19.893112 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecf0a7-ee6b-46e4-8c38-c2da4811d82b admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:19.903474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1341/2699] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:51:19.907146 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f9b82-f439-4c87-ad85-7cc68a3b8de4 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:19.917009 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f9b82-f439-4c87-ad85-7cc68a3b8de4 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:19.921548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b4259-56ac-403b-9059-d953b7935808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:19.922194 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b4259-56ac-403b-9059-d953b7935808 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:19.922481 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b4259-56ac-403b-9059-d953b7935808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:19.922757 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b4259-56ac-403b-9059-d953b7935808 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:19.923509 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b4259-56ac-403b-9059-d953b7935808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:19.925091 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b4259-56ac-403b-9059-d953b7935808 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:19.935725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1359/2700] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:51:19.939729 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecf0a7-ee6b-46e4-8c38-c2da4811d82b admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:19.950587 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecf0a7-ee6b-46e4-8c38-c2da4811d82b admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:19.955130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872bdfbd-4d10-46b0-aef2-2a44ad7e6b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:19.956044 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bdfbd-4d10-46b0-aef2-2a44ad7e6b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:19.956325 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bdfbd-4d10-46b0-aef2-2a44ad7e6b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:19.956596 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bdfbd-4d10-46b0-aef2-2a44ad7e6b0d admin admin] PATH_INFO: `/v3/projects/8344ddaa26fc498f89e75de2f7d8a331/users/b7b977521df6493eb1dabef2844c9329/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:19.971057 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872bdfbd-4d10-46b0-aef2-2a44ad7e6b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8344ddaa26fc498f89e75de2f7d8a331, user_id=b7b977521df6493eb1dabef2844c9329, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:19.973702 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872bdfbd-4d10-46b0-aef2-2a44ad7e6b0d admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:19.986586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1342/2701] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:51:19 2022] PUT /identity/v3/projects/8344ddaa26fc498f89e75de2f7d8a331/users/b7b977521df6493eb1dabef2844c9329/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:19.997256 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961f8aa-e3c0-4623-b814-a81dd1e489f1 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:19.997545 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961f8aa-e3c0-4623-b814-a81dd1e489f1 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:19.997823 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961f8aa-e3c0-4623-b814-a81dd1e489f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:20.024158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-0961f8aa-e3c0-4623-b814-a81dd1e489f1 None None] MFA Rules not processed for user `b7b977521df6493eb1dabef2844c9329`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:20.025354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-0961f8aa-e3c0-4623-b814-a81dd1e489f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:20.073986 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:20.091297 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1360/2702] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:20.095777 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872bdfbd-4d10-46b0-aef2-2a44ad7e6b0d admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:20.156839 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872bdfbd-4d10-46b0-aef2-2a44ad7e6b0d admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:20.161475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304ad72-32cd-4d2e-82c4-a4a30c7ecac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:20.162129 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304ad72-32cd-4d2e-82c4-a4a30c7ecac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:20.162411 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304ad72-32cd-4d2e-82c4-a4a30c7ecac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:20.162687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304ad72-32cd-4d2e-82c4-a4a30c7ecac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:20.163403 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304ad72-32cd-4d2e-82c4-a4a30c7ecac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:20.165370 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304ad72-32cd-4d2e-82c4-a4a30c7ecac9 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:20.191563 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1343/2703] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:51:20 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:51:20.195654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961f8aa-e3c0-4623-b814-a81dd1e489f1 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:20.206612 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961f8aa-e3c0-4623-b814-a81dd1e489f1 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:20.228095 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa70376-c601-4be9-8ea3-1ec3930d13fe None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:20.228421 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa70376-c601-4be9-8ea3-1ec3930d13fe None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:20.229249 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa70376-c601-4be9-8ea3-1ec3930d13fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:20.247520 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-3aa70376-c601-4be9-8ea3-1ec3930d13fe None None] MFA Rules not processed for user `f1fa5f1765ed4995b31a1600ce3edb07`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:20.248743 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-3aa70376-c601-4be9-8ea3-1ec3930d13fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:20.263426 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f3b95-ecad-4c0f-98f2-835ed42c013e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:20.264104 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f3b95-ecad-4c0f-98f2-835ed42c013e admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:20.264390 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f3b95-ecad-4c0f-98f2-835ed42c013e admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:20.264669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f3b95-ecad-4c0f-98f2-835ed42c013e admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:20.265387 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f3b95-ecad-4c0f-98f2-835ed42c013e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:20.267370 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f3b95-ecad-4c0f-98f2-835ed42c013e admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:20.287919 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1361/2704] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:51:20 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:51:20.292234 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f3b95-ecad-4c0f-98f2-835ed42c013e admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:20.301911 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f3b95-ecad-4c0f-98f2-835ed42c013e admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:20.306441 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3acd8-2dd8-4881-9646-832c3a3c53d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:20.307652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3acd8-2dd8-4881-9646-832c3a3c53d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:20.307935 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3acd8-2dd8-4881-9646-832c3a3c53d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:20.308212 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3acd8-2dd8-4881-9646-832c3a3c53d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:20.313668 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1344/2705] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:20.317311 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3acd8-2dd8-4881-9646-832c3a3c53d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:20.317311 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3acd8-2dd8-4881-9646-832c3a3c53d2 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:20.325835 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1362/2706] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:51:20.329302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa70376-c601-4be9-8ea3-1ec3930d13fe None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:20.342735 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa70376-c601-4be9-8ea3-1ec3930d13fe None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:20.347788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946af862-f2e6-4936-be5a-e1f4df411ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:20.348898 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946af862-f2e6-4936-be5a-e1f4df411ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:20.349196 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946af862-f2e6-4936-be5a-e1f4df411ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:20.349475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946af862-f2e6-4936-be5a-e1f4df411ed1 admin admin] PATH_INFO: `/v3/projects/c0295f6e34ee4a45ab808fa06d6c248e/users/92d3e59fdd4e4adb8cb47ac69a8167ed/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:20.366904 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946af862-f2e6-4936-be5a-e1f4df411ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0295f6e34ee4a45ab808fa06d6c248e, user_id=92d3e59fdd4e4adb8cb47ac69a8167ed, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:20.370402 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946af862-f2e6-4936-be5a-e1f4df411ed1 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:20.379233 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:20.394257 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1345/2707] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:51:20 2022] PUT /identity/v3/projects/c0295f6e34ee4a45ab808fa06d6c248e/users/92d3e59fdd4e4adb8cb47ac69a8167ed/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:20.398131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3acd8-2dd8-4881-9646-832c3a3c53d2 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:20.408298 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3acd8-2dd8-4881-9646-832c3a3c53d2 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:20.465752 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4f5ed-8c7b-4a6d-87d6-81972925ee4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:20.466429 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4f5ed-8c7b-4a6d-87d6-81972925ee4b admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:20.466713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4f5ed-8c7b-4a6d-87d6-81972925ee4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:20.466987 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4f5ed-8c7b-4a6d-87d6-81972925ee4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:20.467748 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4f5ed-8c7b-4a6d-87d6-81972925ee4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:20.469381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4f5ed-8c7b-4a6d-87d6-81972925ee4b admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:20.485778 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1363/2708] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:51:20.487029 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946af862-f2e6-4936-be5a-e1f4df411ed1 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:20.498517 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946af862-f2e6-4936-be5a-e1f4df411ed1 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:20.504964 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849ff27-79b0-46df-adc0-08a9fb73dd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:20.506025 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849ff27-79b0-46df-adc0-08a9fb73dd9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:20.506382 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849ff27-79b0-46df-adc0-08a9fb73dd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:20.506734 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849ff27-79b0-46df-adc0-08a9fb73dd9b admin admin] PATH_INFO: `/v3/projects/c0295f6e34ee4a45ab808fa06d6c248e/users/92d3e59fdd4e4adb8cb47ac69a8167ed/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:20.509042 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849ff27-79b0-46df-adc0-08a9fb73dd9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0295f6e34ee4a45ab808fa06d6c248e, user_id=92d3e59fdd4e4adb8cb47ac69a8167ed, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:20.512729 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849ff27-79b0-46df-adc0-08a9fb73dd9b admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:20.523722 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1346/2709] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:51:20 2022] PUT /identity/v3/projects/c0295f6e34ee4a45ab808fa06d6c248e/users/92d3e59fdd4e4adb8cb47ac69a8167ed/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:20.535398 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf34b62-f10c-4989-b5a3-65eceb1b9fa2 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:20.535848 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf34b62-f10c-4989-b5a3-65eceb1b9fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:20.536200 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf34b62-f10c-4989-b5a3-65eceb1b9fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:20.563731 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-cdf34b62-f10c-4989-b5a3-65eceb1b9fa2 None None] MFA Rules not processed for user `92d3e59fdd4e4adb8cb47ac69a8167ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:20.564928 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-cdf34b62-f10c-4989-b5a3-65eceb1b9fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:20.618125 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:20.638139 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1364/2710] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:20.650283 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849ff27-79b0-46df-adc0-08a9fb73dd9b admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:20.651991 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-3849ff27-79b0-46df-adc0-08a9fb73dd9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:20.711240 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849ff27-79b0-46df-adc0-08a9fb73dd9b admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:20.715166 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5db89-cf7a-43ba-9cdc-0a282545b5b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:20.715842 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5db89-cf7a-43ba-9cdc-0a282545b5b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:20.716126 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5db89-cf7a-43ba-9cdc-0a282545b5b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:20.716402 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5db89-cf7a-43ba-9cdc-0a282545b5b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:20.725965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5db89-cf7a-43ba-9cdc-0a282545b5b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:20.727440 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5db89-cf7a-43ba-9cdc-0a282545b5b8 service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:20.737975 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1347/2711] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:51:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:51:21.051186 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf34b62-f10c-4989-b5a3-65eceb1b9fa2 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:21.061066 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf34b62-f10c-4989-b5a3-65eceb1b9fa2 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:21.067520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d65512-8b5c-4ae1-b300-e3c17c23e7f5 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d3e59fdd4e4adb8cb47ac69a8167ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0295f6e34ee4a45ab808fa06d6c248e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:21.067520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d65512-8b5c-4ae1-b300-e3c17c23e7f5 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:21.067520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d65512-8b5c-4ae1-b300-e3c17c23e7f5 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:21.068328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d65512-8b5c-4ae1-b300-e3c17c23e7f5 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:21.068328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d65512-8b5c-4ae1-b300-e3c17c23e7f5 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:51:21.068495 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d65512-8b5c-4ae1-b300-e3c17c23e7f5 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:21.070056 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d65512-8b5c-4ae1-b300-e3c17c23e7f5 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:21.084007 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1365/2712] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:51:21.090121 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5db89-cf7a-43ba-9cdc-0a282545b5b8 service cinder] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:21.101167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5db89-cf7a-43ba-9cdc-0a282545b5b8 service cinder] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:21.107160 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4fe4f-6789-44a2-a5c7-c3ff4265eb3f tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d3e59fdd4e4adb8cb47ac69a8167ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0295f6e34ee4a45ab808fa06d6c248e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:21.108005 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4fe4f-6789-44a2-a5c7-c3ff4265eb3f tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:21.108363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4fe4f-6789-44a2-a5c7-c3ff4265eb3f tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:21.108705 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4fe4f-6789-44a2-a5c7-c3ff4265eb3f tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:21.109458 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4fe4f-6789-44a2-a5c7-c3ff4265eb3f tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:21.111472 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4fe4f-6789-44a2-a5c7-c3ff4265eb3f tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:21.142963 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1348/2713] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:51:21 2022] POST /identity/v3/projects => generated 355 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:51:21.147224 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d65512-8b5c-4ae1-b300-e3c17c23e7f5 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:21.160692 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d65512-8b5c-4ae1-b300-e3c17c23e7f5 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:21.223987 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22914b-2296-4cfb-b69e-61e655e0d947 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d3e59fdd4e4adb8cb47ac69a8167ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0295f6e34ee4a45ab808fa06d6c248e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:21.224661 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22914b-2296-4cfb-b69e-61e655e0d947 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:21.224954 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22914b-2296-4cfb-b69e-61e655e0d947 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:21.225234 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22914b-2296-4cfb-b69e-61e655e0d947 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:21.226271 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22914b-2296-4cfb-b69e-61e655e0d947 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:51:21.226680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22914b-2296-4cfb-b69e-61e655e0d947 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:21.228216 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22914b-2296-4cfb-b69e-61e655e0d947 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:21.242056 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1366/2714] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 09:51:21.279183 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4fe4f-6789-44a2-a5c7-c3ff4265eb3f tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:21.290263 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4fe4f-6789-44a2-a5c7-c3ff4265eb3f tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:21.295315 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456db17-fccc-40c8-bdd7-dfd166128896 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d3e59fdd4e4adb8cb47ac69a8167ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0295f6e34ee4a45ab808fa06d6c248e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:21.296201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456db17-fccc-40c8-bdd7-dfd166128896 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:21.296485 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456db17-fccc-40c8-bdd7-dfd166128896 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:21.296760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456db17-fccc-40c8-bdd7-dfd166128896 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] PATH_INFO: `/v3/projects/3f4b62ad6ab14b319c3bec6a299966c9` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:21.298489 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456db17-fccc-40c8-bdd7-dfd166128896 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3f4b62ad6ab14b319c3bec6a299966c9)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:21.301223 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456db17-fccc-40c8-bdd7-dfd166128896 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:21.360649 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a456db17-fccc-40c8-bdd7-dfd166128896 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f4b62ad6ab14b319c3bec6a299966c9', 'request_id': 'req-a456db17-fccc-40c8-bdd7-dfd166128896'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:21.367557 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a456db17-fccc-40c8-bdd7-dfd166128896 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f4b62ad6ab14b319c3bec6a299966c9', 'request_id': 'req-a456db17-fccc-40c8-bdd7-dfd166128896'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:21.374695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a456db17-fccc-40c8-bdd7-dfd166128896 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f4b62ad6ab14b319c3bec6a299966c9', 'request_id': 'req-a456db17-fccc-40c8-bdd7-dfd166128896'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:21.386208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a456db17-fccc-40c8-bdd7-dfd166128896 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] The token cache is being invalidate because project 3f4b62ad6ab14b319c3bec6a299966c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:51:21.386536 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a456db17-fccc-40c8-bdd7-dfd166128896 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:21.387241 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-a456db17-fccc-40c8-bdd7-dfd166128896 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:21.389340 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1349/2715] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:51:21 2022] DELETE /identity/v3/projects/3f4b62ad6ab14b319c3bec6a299966c9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:21.597963 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22914b-2296-4cfb-b69e-61e655e0d947 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:21.599697 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-2b22914b-2296-4cfb-b69e-61e655e0d947 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:21.666788 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22914b-2296-4cfb-b69e-61e655e0d947 tempest-VolumeQuotaClassesTest-1461928094 tempest-VolumeQuotaClassesTest-1461928094-project-admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:21.733886 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135add0-6d44-440b-b7cd-a113dfd388e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:21.734760 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135add0-6d44-440b-b7cd-a113dfd388e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:21.735045 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135add0-6d44-440b-b7cd-a113dfd388e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:21.735357 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135add0-6d44-440b-b7cd-a113dfd388e6 admin admin] PATH_INFO: `/v3/users/b7b977521df6493eb1dabef2844c9329` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:21.736559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135add0-6d44-440b-b7cd-a113dfd388e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b977521df6493eb1dabef2844c9329)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:21.738507 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135add0-6d44-440b-b7cd-a113dfd388e6 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:21.760917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:21.785429 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4135add0-6d44-440b-b7cd-a113dfd388e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b977521df6493eb1dabef2844c9329'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:21.786083 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4135add0-6d44-440b-b7cd-a113dfd388e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b977521df6493eb1dabef2844c9329'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:21.792868 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4135add0-6d44-440b-b7cd-a113dfd388e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b977521df6493eb1dabef2844c9329'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:21.793495 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4135add0-6d44-440b-b7cd-a113dfd388e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b977521df6493eb1dabef2844c9329'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:21.805526 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-4135add0-6d44-440b-b7cd-a113dfd388e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b977521df6493eb1dabef2844c9329'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:21.818325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1367/2716] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:51:21 2022] DELETE /identity/v3/users/b7b977521df6493eb1dabef2844c9329 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:21.823469 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4c6bd-7855-4401-8aca-f25a66180f02 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:21.823957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4c6bd-7855-4401-8aca-f25a66180f02 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:21.824070 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4c6bd-7855-4401-8aca-f25a66180f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:21.842413 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-9bc4c6bd-7855-4401-8aca-f25a66180f02 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:21.843643 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-9bc4c6bd-7855-4401-8aca-f25a66180f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:21.889038 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:21.905605 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1350/2717] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:21.915163 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135add0-6d44-440b-b7cd-a113dfd388e6 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:21.916648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-4135add0-6d44-440b-b7cd-a113dfd388e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:21.979857 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135add0-6d44-440b-b7cd-a113dfd388e6 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:21.983598 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c711a-9c2b-4335-8348-6ea4f961b0d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:21.984306 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c711a-9c2b-4335-8348-6ea4f961b0d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:21.984612 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c711a-9c2b-4335-8348-6ea4f961b0d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:21.984891 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c711a-9c2b-4335-8348-6ea4f961b0d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:21.994723 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c711a-9c2b-4335-8348-6ea4f961b0d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:21.996194 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c711a-9c2b-4335-8348-6ea4f961b0d7 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:22.005706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1368/2718] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:51:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:51:22.294344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4c6bd-7855-4401-8aca-f25a66180f02 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:22.296391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-9bc4c6bd-7855-4401-8aca-f25a66180f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:22.317076 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4c6bd-7855-4401-8aca-f25a66180f02 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:22.322868 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c0dfc-85c8-4b8e-bb09-f6afd492f920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:22.323241 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c0dfc-85c8-4b8e-bb09-f6afd492f920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:22.323555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c0dfc-85c8-4b8e-bb09-f6afd492f920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:22.323833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c0dfc-85c8-4b8e-bb09-f6afd492f920 admin admin] PATH_INFO: `/v3/projects/8344ddaa26fc498f89e75de2f7d8a331` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:22.325041 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c0dfc-85c8-4b8e-bb09-f6afd492f920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8344ddaa26fc498f89e75de2f7d8a331)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:22.326988 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c0dfc-85c8-4b8e-bb09-f6afd492f920 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:22.380945 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e05c0dfc-85c8-4b8e-bb09-f6afd492f920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8344ddaa26fc498f89e75de2f7d8a331', 'request_id': 'req-e05c0dfc-85c8-4b8e-bb09-f6afd492f920'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:22.389755 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e05c0dfc-85c8-4b8e-bb09-f6afd492f920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8344ddaa26fc498f89e75de2f7d8a331', 'request_id': 'req-e05c0dfc-85c8-4b8e-bb09-f6afd492f920'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:22.396063 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e05c0dfc-85c8-4b8e-bb09-f6afd492f920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8344ddaa26fc498f89e75de2f7d8a331', 'request_id': 'req-e05c0dfc-85c8-4b8e-bb09-f6afd492f920'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:22.406957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e05c0dfc-85c8-4b8e-bb09-f6afd492f920 admin admin] The token cache is being invalidate because project 8344ddaa26fc498f89e75de2f7d8a331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:51:22.407245 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e05c0dfc-85c8-4b8e-bb09-f6afd492f920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:22.407913 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e05c0dfc-85c8-4b8e-bb09-f6afd492f920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:22.409457 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1351/2719] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:51:22 2022] DELETE /identity/v3/projects/8344ddaa26fc498f89e75de2f7d8a331 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:22.413574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c711a-9c2b-4335-8348-6ea4f961b0d7 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:22.423375 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c711a-9c2b-4335-8348-6ea4f961b0d7 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:22.481897 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fab2f-a34c-4234-b14a-51bcfd61e286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:22.482800 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fab2f-a34c-4234-b14a-51bcfd61e286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:22.483170 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fab2f-a34c-4234-b14a-51bcfd61e286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:22.483543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fab2f-a34c-4234-b14a-51bcfd61e286 admin admin] PATH_INFO: `/v3/users/92d3e59fdd4e4adb8cb47ac69a8167ed` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:22.484796 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fab2f-a34c-4234-b14a-51bcfd61e286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92d3e59fdd4e4adb8cb47ac69a8167ed)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:22.486869 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fab2f-a34c-4234-b14a-51bcfd61e286 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:22.533078 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:22.535516 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3b7fab2f-a34c-4234-b14a-51bcfd61e286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92d3e59fdd4e4adb8cb47ac69a8167ed'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:22.536169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3b7fab2f-a34c-4234-b14a-51bcfd61e286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92d3e59fdd4e4adb8cb47ac69a8167ed'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:22.543988 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3b7fab2f-a34c-4234-b14a-51bcfd61e286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92d3e59fdd4e4adb8cb47ac69a8167ed'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:22.544730 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3b7fab2f-a34c-4234-b14a-51bcfd61e286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92d3e59fdd4e4adb8cb47ac69a8167ed'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:22.557691 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-3b7fab2f-a34c-4234-b14a-51bcfd61e286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92d3e59fdd4e4adb8cb47ac69a8167ed'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:22.572064 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1369/2720] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:51:22 2022] DELETE /identity/v3/users/92d3e59fdd4e4adb8cb47ac69a8167ed => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:22.867589 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c0dfc-85c8-4b8e-bb09-f6afd492f920 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:22.870108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e05c0dfc-85c8-4b8e-bb09-f6afd492f920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:22.895062 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c0dfc-85c8-4b8e-bb09-f6afd492f920 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:22.992398 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d0ae9-d324-41f5-9c30-cb6daa448b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:22.995060 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d0ae9-d324-41f5-9c30-cb6daa448b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:22.995459 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d0ae9-d324-41f5-9c30-cb6daa448b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:22.997369 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d0ae9-d324-41f5-9c30-cb6daa448b42 admin admin] PATH_INFO: `/v3/projects/c0295f6e34ee4a45ab808fa06d6c248e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:22.998964 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d0ae9-d324-41f5-9c30-cb6daa448b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0295f6e34ee4a45ab808fa06d6c248e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:23.001090 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d0ae9-d324-41f5-9c30-cb6daa448b42 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:23.088134 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-635d0ae9-d324-41f5-9c30-cb6daa448b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0295f6e34ee4a45ab808fa06d6c248e', 'request_id': 'req-635d0ae9-d324-41f5-9c30-cb6daa448b42'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:23.098580 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-635d0ae9-d324-41f5-9c30-cb6daa448b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0295f6e34ee4a45ab808fa06d6c248e', 'request_id': 'req-635d0ae9-d324-41f5-9c30-cb6daa448b42'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:23.107940 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-635d0ae9-d324-41f5-9c30-cb6daa448b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0295f6e34ee4a45ab808fa06d6c248e', 'request_id': 'req-635d0ae9-d324-41f5-9c30-cb6daa448b42'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:23.122118 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-635d0ae9-d324-41f5-9c30-cb6daa448b42 admin admin] The token cache is being invalidate because project c0295f6e34ee4a45ab808fa06d6c248e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:51:23.122406 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-635d0ae9-d324-41f5-9c30-cb6daa448b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:23.123415 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-635d0ae9-d324-41f5-9c30-cb6daa448b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:23.125354 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1352/2721] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:51:22 2022] DELETE /identity/v3/projects/c0295f6e34ee4a45ab808fa06d6c248e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:23.130237 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5a853-6bca-4348-982c-e73735809b47 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:23.130714 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5a853-6bca-4348-982c-e73735809b47 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:23.130954 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5a853-6bca-4348-982c-e73735809b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:23.148818 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-93b5a853-6bca-4348-982c-e73735809b47 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:23.150045 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-93b5a853-6bca-4348-982c-e73735809b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:23.218697 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1370/2722] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:23.226280 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fb1d2-6975-40b4-9043-565336b39d83 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:23.226575 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fb1d2-6975-40b4-9043-565336b39d83 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:23.226861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fb1d2-6975-40b4-9043-565336b39d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:23.234010 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:23.247362 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-839fb1d2-6975-40b4-9043-565336b39d83 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:23.249408 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-839fb1d2-6975-40b4-9043-565336b39d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:23.257873 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1353/2723] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:23.262305 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5a853-6bca-4348-982c-e73735809b47 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:23.271977 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5a853-6bca-4348-982c-e73735809b47 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:23.276684 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed03320-0bc6-4342-ad74-0a6d99380048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:23.277347 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed03320-0bc6-4342-ad74-0a6d99380048 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:23.278597 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed03320-0bc6-4342-ad74-0a6d99380048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:23.278597 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed03320-0bc6-4342-ad74-0a6d99380048 admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:23.278597 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed03320-0bc6-4342-ad74-0a6d99380048 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:51:23.278908 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed03320-0bc6-4342-ad74-0a6d99380048 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:23.280567 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed03320-0bc6-4342-ad74-0a6d99380048 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:23.292958 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1371/2724] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:51:23.297387 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839fb1d2-6975-40b4-9043-565336b39d83 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:23.307913 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839fb1d2-6975-40b4-9043-565336b39d83 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:23.313773 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f6e5c-f05f-4537-acf8-5601c2368d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:23.314451 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f6e5c-f05f-4537-acf8-5601c2368d38 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:23.314736 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f6e5c-f05f-4537-acf8-5601c2368d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:23.315014 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f6e5c-f05f-4537-acf8-5601c2368d38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:23.315745 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f6e5c-f05f-4537-acf8-5601c2368d38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:23.317648 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f6e5c-f05f-4537-acf8-5601c2368d38 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:23.354737 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1354/2725] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:51:23 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:51:23.355944 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed03320-0bc6-4342-ad74-0a6d99380048 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:23.366415 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed03320-0bc6-4342-ad74-0a6d99380048 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:23.427570 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72544eca-2874-4f10-80f9-f8d7d5762301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:23.428395 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72544eca-2874-4f10-80f9-f8d7d5762301 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:23.428686 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72544eca-2874-4f10-80f9-f8d7d5762301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:23.428977 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72544eca-2874-4f10-80f9-f8d7d5762301 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:23.429703 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72544eca-2874-4f10-80f9-f8d7d5762301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:23.431766 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72544eca-2874-4f10-80f9-f8d7d5762301 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:23.452568 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1372/2726] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:51:23 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:51:23.456634 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f6e5c-f05f-4537-acf8-5601c2368d38 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:23.468389 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f6e5c-f05f-4537-acf8-5601c2368d38 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:23.473268 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f23483-20f6-4eeb-afce-27eac1700a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:23.473939 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f23483-20f6-4eeb-afce-27eac1700a3a admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:23.474227 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f23483-20f6-4eeb-afce-27eac1700a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:23.474508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f23483-20f6-4eeb-afce-27eac1700a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:23.475494 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f23483-20f6-4eeb-afce-27eac1700a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:23.476883 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f23483-20f6-4eeb-afce-27eac1700a3a admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:23.491440 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1355/2727] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:51:23.493695 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72544eca-2874-4f10-80f9-f8d7d5762301 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:23.507552 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72544eca-2874-4f10-80f9-f8d7d5762301 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:23.514236 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa1478-cb36-4493-8483-c3a2234314a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:23.515189 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa1478-cb36-4493-8483-c3a2234314a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:23.515689 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa1478-cb36-4493-8483-c3a2234314a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:23.516613 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa1478-cb36-4493-8483-c3a2234314a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:23.517530 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa1478-cb36-4493-8483-c3a2234314a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:23.519606 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa1478-cb36-4493-8483-c3a2234314a8 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:23.542364 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1373/2728] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:51:23.546475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f23483-20f6-4eeb-afce-27eac1700a3a admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:23.560376 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f23483-20f6-4eeb-afce-27eac1700a3a admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:23.565960 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc62da-51a1-439b-b966-bc207cca0458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:23.566872 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc62da-51a1-439b-b966-bc207cca0458 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:23.567223 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc62da-51a1-439b-b966-bc207cca0458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:23.567565 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc62da-51a1-439b-b966-bc207cca0458 admin admin] PATH_INFO: `/v3/projects/a735cb8454dc489a8788386183ff80e4/users/07c944fcc5b042ed8a8bfb2d8f6964e8/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:23.584674 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc62da-51a1-439b-b966-bc207cca0458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a735cb8454dc489a8788386183ff80e4, user_id=07c944fcc5b042ed8a8bfb2d8f6964e8, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:23.587382 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc62da-51a1-439b-b966-bc207cca0458 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:23.605520 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1356/2729] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:51:23 2022] PUT /identity/v3/projects/a735cb8454dc489a8788386183ff80e4/users/07c944fcc5b042ed8a8bfb2d8f6964e8/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:23.616107 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19609b8-d219-4823-bf11-be0bef944f2e None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:23.616426 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19609b8-d219-4823-bf11-be0bef944f2e None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:23.617355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19609b8-d219-4823-bf11-be0bef944f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:23.646361 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-f19609b8-d219-4823-bf11-be0bef944f2e None None] MFA Rules not processed for user `07c944fcc5b042ed8a8bfb2d8f6964e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:23.647355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f19609b8-d219-4823-bf11-be0bef944f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:23.663396 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:23.735580 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1374/2730] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:23.739966 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc62da-51a1-439b-b966-bc207cca0458 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:23.820965 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc62da-51a1-439b-b966-bc207cca0458 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:23.826893 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17536e87-6281-40a3-aa9f-16ceb5643bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:23.827605 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17536e87-6281-40a3-aa9f-16ceb5643bbe admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:23.827888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17536e87-6281-40a3-aa9f-16ceb5643bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:23.828188 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17536e87-6281-40a3-aa9f-16ceb5643bbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:23.828919 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17536e87-6281-40a3-aa9f-16ceb5643bbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:23.830977 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17536e87-6281-40a3-aa9f-16ceb5643bbe admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:23.861208 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1357/2731] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:51:23 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:51:23.865073 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19609b8-d219-4823-bf11-be0bef944f2e None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:23.876468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19609b8-d219-4823-bf11-be0bef944f2e None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:23.945766 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4251bc-fdd8-474a-af0f-2dfed798718d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:23.946449 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4251bc-fdd8-474a-af0f-2dfed798718d admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:23.946733 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4251bc-fdd8-474a-af0f-2dfed798718d admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:23.947010 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4251bc-fdd8-474a-af0f-2dfed798718d admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:23.948312 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4251bc-fdd8-474a-af0f-2dfed798718d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:23.950247 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4251bc-fdd8-474a-af0f-2dfed798718d admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:23.970943 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1375/2732] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:51:23 2022] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:51:23.975081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17536e87-6281-40a3-aa9f-16ceb5643bbe admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:23.989008 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17536e87-6281-40a3-aa9f-16ceb5643bbe admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:23.995567 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e46f3-3281-4d27-b9e7-3e8302a9850e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:23.996263 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e46f3-3281-4d27-b9e7-3e8302a9850e admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:23.996552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e46f3-3281-4d27-b9e7-3e8302a9850e admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:23.996829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e46f3-3281-4d27-b9e7-3e8302a9850e admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:23.997555 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e46f3-3281-4d27-b9e7-3e8302a9850e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:23.999406 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e46f3-3281-4d27-b9e7-3e8302a9850e admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:24.014148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1358/2733] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:51:24.015446 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4251bc-fdd8-474a-af0f-2dfed798718d admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:24.026497 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4251bc-fdd8-474a-af0f-2dfed798718d admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:24.031112 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18fe00-9620-4302-a905-94dfae5baf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:24.032037 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18fe00-9620-4302-a905-94dfae5baf01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:24.032319 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18fe00-9620-4302-a905-94dfae5baf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:24.032723 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18fe00-9620-4302-a905-94dfae5baf01 admin admin] PATH_INFO: `/v3/projects/183b9bbf5d2b49509bf609fcb9524e48/users/00565a6ba2e641bfae7d540771d284e5/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:24.050214 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18fe00-9620-4302-a905-94dfae5baf01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=183b9bbf5d2b49509bf609fcb9524e48, user_id=00565a6ba2e641bfae7d540771d284e5, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:24.053075 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18fe00-9620-4302-a905-94dfae5baf01 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:24.070860 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1376/2734] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:51:24 2022] PUT /identity/v3/projects/183b9bbf5d2b49509bf609fcb9524e48/users/00565a6ba2e641bfae7d540771d284e5/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:24.075336 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e46f3-3281-4d27-b9e7-3e8302a9850e admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:24.085381 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e46f3-3281-4d27-b9e7-3e8302a9850e admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:24.143938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a69d6-cbdc-4cef-86a2-ee9873e39858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:24.144622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a69d6-cbdc-4cef-86a2-ee9873e39858 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:24.144907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a69d6-cbdc-4cef-86a2-ee9873e39858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:24.145184 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a69d6-cbdc-4cef-86a2-ee9873e39858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:24.145980 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a69d6-cbdc-4cef-86a2-ee9873e39858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:24.147642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a69d6-cbdc-4cef-86a2-ee9873e39858 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:24.160870 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1359/2735] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:51:24.162126 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18fe00-9620-4302-a905-94dfae5baf01 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:24.172452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18fe00-9620-4302-a905-94dfae5baf01 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:24.177284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6793166-f1f7-4194-bf47-b200049f2367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:24.178159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6793166-f1f7-4194-bf47-b200049f2367 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:24.178437 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6793166-f1f7-4194-bf47-b200049f2367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:24.178709 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6793166-f1f7-4194-bf47-b200049f2367 admin admin] PATH_INFO: `/v3/projects/183b9bbf5d2b49509bf609fcb9524e48/users/00565a6ba2e641bfae7d540771d284e5/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:24.180685 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6793166-f1f7-4194-bf47-b200049f2367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=183b9bbf5d2b49509bf609fcb9524e48, user_id=00565a6ba2e641bfae7d540771d284e5, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:24.184706 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6793166-f1f7-4194-bf47-b200049f2367 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:24.196032 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1377/2736] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:51:24 2022] PUT /identity/v3/projects/183b9bbf5d2b49509bf609fcb9524e48/users/00565a6ba2e641bfae7d540771d284e5/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:24.209275 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762060b-730c-46b2-a53c-a7d5151d1f7e None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:24.209568 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762060b-730c-46b2-a53c-a7d5151d1f7e None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:24.209849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762060b-730c-46b2-a53c-a7d5151d1f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:24.229072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:24.240001 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-a762060b-730c-46b2-a53c-a7d5151d1f7e None None] MFA Rules not processed for user `00565a6ba2e641bfae7d540771d284e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:24.241290 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-a762060b-730c-46b2-a53c-a7d5151d1f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:24.309558 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1360/2737] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:24.320131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6793166-f1f7-4194-bf47-b200049f2367 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:24.321932 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d6793166-f1f7-4194-bf47-b200049f2367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:24.379421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6793166-f1f7-4194-bf47-b200049f2367 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:24.383044 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc402d-2f4a-4b83-bb9a-d96a7b05562e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:24.383744 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc402d-2f4a-4b83-bb9a-d96a7b05562e service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:24.384032 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc402d-2f4a-4b83-bb9a-d96a7b05562e service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:24.384312 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc402d-2f4a-4b83-bb9a-d96a7b05562e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:24.394329 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc402d-2f4a-4b83-bb9a-d96a7b05562e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:24.395825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc402d-2f4a-4b83-bb9a-d96a7b05562e service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:24.405525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1378/2738] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:51:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:51:24.501995 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762060b-730c-46b2-a53c-a7d5151d1f7e None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:24.511667 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762060b-730c-46b2-a53c-a7d5151d1f7e None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:24.515163 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6a118-5400-4a2e-a722-a03db0bd754c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:24.515826 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6a118-5400-4a2e-a722-a03db0bd754c service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:24.516110 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6a118-5400-4a2e-a722-a03db0bd754c service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:24.516385 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6a118-5400-4a2e-a722-a03db0bd754c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:24.578645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6a118-5400-4a2e-a722-a03db0bd754c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:24.580086 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6a118-5400-4a2e-a722-a03db0bd754c service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:24.589607 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1361/2739] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:51:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:51:27.143571 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc402d-2f4a-4b83-bb9a-d96a7b05562e service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:27.155586 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:27.207223 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc402d-2f4a-4b83-bb9a-d96a7b05562e service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:27.211776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc29a6-9b01-4c38-98a9-37c124ff7f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:27.212633 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc29a6-9b01-4c38-98a9-37c124ff7f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:27.212920 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc29a6-9b01-4c38-98a9-37c124ff7f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:27.213200 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc29a6-9b01-4c38-98a9-37c124ff7f1e admin admin] PATH_INFO: `/v3/users/07c944fcc5b042ed8a8bfb2d8f6964e8` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:27.214637 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc29a6-9b01-4c38-98a9-37c124ff7f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=07c944fcc5b042ed8a8bfb2d8f6964e8)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:27.216605 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc29a6-9b01-4c38-98a9-37c124ff7f1e admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:27.263406 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-65dc29a6-9b01-4c38-98a9-37c124ff7f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07c944fcc5b042ed8a8bfb2d8f6964e8'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:27.264063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-65dc29a6-9b01-4c38-98a9-37c124ff7f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07c944fcc5b042ed8a8bfb2d8f6964e8'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:27.270801 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-65dc29a6-9b01-4c38-98a9-37c124ff7f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07c944fcc5b042ed8a8bfb2d8f6964e8'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:27.271458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-65dc29a6-9b01-4c38-98a9-37c124ff7f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07c944fcc5b042ed8a8bfb2d8f6964e8'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:27.283158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-65dc29a6-9b01-4c38-98a9-37c124ff7f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07c944fcc5b042ed8a8bfb2d8f6964e8'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:27.295791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1379/2740] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:51:27 2022] DELETE /identity/v3/users/07c944fcc5b042ed8a8bfb2d8f6964e8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:27.300324 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a00743-0ee0-4a50-80d6-3446165686fa None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:27.300788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a00743-0ee0-4a50-80d6-3446165686fa None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:27.300910 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a00743-0ee0-4a50-80d6-3446165686fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:27.318334 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-03a00743-0ee0-4a50-80d6-3446165686fa None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:27.319564 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-03a00743-0ee0-4a50-80d6-3446165686fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:27.378646 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1362/2741] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:27.389008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc29a6-9b01-4c38-98a9-37c124ff7f1e admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:27.390346 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-65dc29a6-9b01-4c38-98a9-37c124ff7f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:27.446191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc29a6-9b01-4c38-98a9-37c124ff7f1e admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:27.450308 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfc810-5455-49b1-8227-afae7069d7c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:27.450953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfc810-5455-49b1-8227-afae7069d7c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:27.451241 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfc810-5455-49b1-8227-afae7069d7c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:27.451552 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfc810-5455-49b1-8227-afae7069d7c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:27.460567 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfc810-5455-49b1-8227-afae7069d7c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:27.461999 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfc810-5455-49b1-8227-afae7069d7c2 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:27.471539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1380/2742] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:51:27.724108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a00743-0ee0-4a50-80d6-3446165686fa None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:27.725570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-03a00743-0ee0-4a50-80d6-3446165686fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:27.739037 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a00743-0ee0-4a50-80d6-3446165686fa None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:27.743614 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af8213-b04e-4792-b6c3-e39522eb383a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:27.745060 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af8213-b04e-4792-b6c3-e39522eb383a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:27.745347 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af8213-b04e-4792-b6c3-e39522eb383a admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:27.746118 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af8213-b04e-4792-b6c3-e39522eb383a admin admin] PATH_INFO: `/v3/projects/a735cb8454dc489a8788386183ff80e4` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:27.747541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af8213-b04e-4792-b6c3-e39522eb383a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a735cb8454dc489a8788386183ff80e4)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:27.749440 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af8213-b04e-4792-b6c3-e39522eb383a admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:27.785429 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:27.801677 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-33af8213-b04e-4792-b6c3-e39522eb383a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a735cb8454dc489a8788386183ff80e4', 'request_id': 'req-33af8213-b04e-4792-b6c3-e39522eb383a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:27.809307 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-33af8213-b04e-4792-b6c3-e39522eb383a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a735cb8454dc489a8788386183ff80e4', 'request_id': 'req-33af8213-b04e-4792-b6c3-e39522eb383a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:27.815535 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-33af8213-b04e-4792-b6c3-e39522eb383a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a735cb8454dc489a8788386183ff80e4', 'request_id': 'req-33af8213-b04e-4792-b6c3-e39522eb383a'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:27.825837 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-33af8213-b04e-4792-b6c3-e39522eb383a admin admin] The token cache is being invalidate because project a735cb8454dc489a8788386183ff80e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:51:27.826123 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-33af8213-b04e-4792-b6c3-e39522eb383a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:27.826751 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-33af8213-b04e-4792-b6c3-e39522eb383a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:27.828303 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1363/2743] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:51:27 2022] DELETE /identity/v3/projects/a735cb8454dc489a8788386183ff80e4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:27.832342 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfc810-5455-49b1-8227-afae7069d7c2 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:27.842754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfc810-5455-49b1-8227-afae7069d7c2 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:27.871783 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:27.898851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8ab60-01e4-408a-8d89-08c55a7c0f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:27.899755 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8ab60-01e4-408a-8d89-08c55a7c0f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:27.900044 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8ab60-01e4-408a-8d89-08c55a7c0f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:27.900831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8ab60-01e4-408a-8d89-08c55a7c0f0b admin admin] PATH_INFO: `/v3/users/00565a6ba2e641bfae7d540771d284e5` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:27.902064 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c8ab60-01e4-408a-8d89-08c55a7c0f0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=00565a6ba2e641bfae7d540771d284e5)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:27.903971 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c8ab60-01e4-408a-8d89-08c55a7c0f0b admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:27.948019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-18c8ab60-01e4-408a-8d89-08c55a7c0f0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00565a6ba2e641bfae7d540771d284e5'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:27.948664 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-18c8ab60-01e4-408a-8d89-08c55a7c0f0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00565a6ba2e641bfae7d540771d284e5'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:27.955530 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-18c8ab60-01e4-408a-8d89-08c55a7c0f0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00565a6ba2e641bfae7d540771d284e5'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:27.956167 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-18c8ab60-01e4-408a-8d89-08c55a7c0f0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00565a6ba2e641bfae7d540771d284e5'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:27.968790 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-18c8ab60-01e4-408a-8d89-08c55a7c0f0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00565a6ba2e641bfae7d540771d284e5'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:27.981822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1381/2744] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:51:27 2022] DELETE /identity/v3/users/00565a6ba2e641bfae7d540771d284e5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:28.289448 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af8213-b04e-4792-b6c3-e39522eb383a admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:28.290882 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-33af8213-b04e-4792-b6c3-e39522eb383a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:28.303624 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af8213-b04e-4792-b6c3-e39522eb383a admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:28.361002 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9490cf-6b12-4f8f-99da-fade588eddf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:28.361872 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9490cf-6b12-4f8f-99da-fade588eddf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:28.362158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9490cf-6b12-4f8f-99da-fade588eddf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:28.362438 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9490cf-6b12-4f8f-99da-fade588eddf6 admin admin] PATH_INFO: `/v3/projects/183b9bbf5d2b49509bf609fcb9524e48` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:28.363660 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9490cf-6b12-4f8f-99da-fade588eddf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=183b9bbf5d2b49509bf609fcb9524e48)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:28.365591 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9490cf-6b12-4f8f-99da-fade588eddf6 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:28.412085 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-6e9490cf-6b12-4f8f-99da-fade588eddf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '183b9bbf5d2b49509bf609fcb9524e48', 'request_id': 'req-6e9490cf-6b12-4f8f-99da-fade588eddf6'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:28.419974 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-6e9490cf-6b12-4f8f-99da-fade588eddf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '183b9bbf5d2b49509bf609fcb9524e48', 'request_id': 'req-6e9490cf-6b12-4f8f-99da-fade588eddf6'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:28.426432 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-6e9490cf-6b12-4f8f-99da-fade588eddf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '183b9bbf5d2b49509bf609fcb9524e48', 'request_id': 'req-6e9490cf-6b12-4f8f-99da-fade588eddf6'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:28.436726 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-6e9490cf-6b12-4f8f-99da-fade588eddf6 admin admin] The token cache is being invalidate because project 183b9bbf5d2b49509bf609fcb9524e48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:51:28.437012 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-6e9490cf-6b12-4f8f-99da-fade588eddf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:28.437642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-6e9490cf-6b12-4f8f-99da-fade588eddf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:28.439180 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1364/2745] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:51:28 2022] DELETE /identity/v3/projects/183b9bbf5d2b49509bf609fcb9524e48 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:28.444316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2916d7-5d0d-496c-aa7c-9f24cf4d7ca0 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:28.444831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2916d7-5d0d-496c-aa7c-9f24cf4d7ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:28.444831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2916d7-5d0d-496c-aa7c-9f24cf4d7ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:28.462616 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-cd2916d7-5d0d-496c-aa7c-9f24cf4d7ca0 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:28.465087 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-cd2916d7-5d0d-496c-aa7c-9f24cf4d7ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:28.522005 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1382/2746] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:28.530419 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17341d23-42c8-4cca-a7d1-7443827b0442 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:28.530711 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17341d23-42c8-4cca-a7d1-7443827b0442 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:28.530990 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17341d23-42c8-4cca-a7d1-7443827b0442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:28.548849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-17341d23-42c8-4cca-a7d1-7443827b0442 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:28.550036 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-17341d23-42c8-4cca-a7d1-7443827b0442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:28.557708 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1365/2747] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:28.561672 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2916d7-5d0d-496c-aa7c-9f24cf4d7ca0 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:28.571217 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2916d7-5d0d-496c-aa7c-9f24cf4d7ca0 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:28.576240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22addbe1-36a3-476f-bf3d-081e2cd4c490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:28.576915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22addbe1-36a3-476f-bf3d-081e2cd4c490 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:28.577195 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22addbe1-36a3-476f-bf3d-081e2cd4c490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:28.577467 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22addbe1-36a3-476f-bf3d-081e2cd4c490 admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:28.578177 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22addbe1-36a3-476f-bf3d-081e2cd4c490 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:51:28.578482 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22addbe1-36a3-476f-bf3d-081e2cd4c490 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:28.580102 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22addbe1-36a3-476f-bf3d-081e2cd4c490 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:28.592160 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1383/2748] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:51:28.596244 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17341d23-42c8-4cca-a7d1-7443827b0442 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:28.605188 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17341d23-42c8-4cca-a7d1-7443827b0442 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:28.609745 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bd3e6-a2b6-411a-b7d3-71baf2837a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:28.610416 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bd3e6-a2b6-411a-b7d3-71baf2837a49 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:28.610696 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bd3e6-a2b6-411a-b7d3-71baf2837a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:28.610968 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bd3e6-a2b6-411a-b7d3-71baf2837a49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:28.611681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465bd3e6-a2b6-411a-b7d3-71baf2837a49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:28.613552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465bd3e6-a2b6-411a-b7d3-71baf2837a49 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:28.638744 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1366/2749] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:51:28 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:51:28.642888 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22addbe1-36a3-476f-bf3d-081e2cd4c490 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:28.653025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22addbe1-36a3-476f-bf3d-081e2cd4c490 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:28.689912 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:28.709921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca1a57-0ecb-4371-9fa4-2240c17b2e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:28.710590 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca1a57-0ecb-4371-9fa4-2240c17b2e3c admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:28.710872 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca1a57-0ecb-4371-9fa4-2240c17b2e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:28.711165 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca1a57-0ecb-4371-9fa4-2240c17b2e3c admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:28.711901 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca1a57-0ecb-4371-9fa4-2240c17b2e3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:28.714131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca1a57-0ecb-4371-9fa4-2240c17b2e3c admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:28.733091 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1384/2750] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:51:28 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:51:28.737493 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bd3e6-a2b6-411a-b7d3-71baf2837a49 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:28.748164 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bd3e6-a2b6-411a-b7d3-71baf2837a49 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:28.752778 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3b239-b88c-4220-b53d-2eca1a45c967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:28.753427 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3b239-b88c-4220-b53d-2eca1a45c967 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:28.753707 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3b239-b88c-4220-b53d-2eca1a45c967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:28.753978 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3b239-b88c-4220-b53d-2eca1a45c967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:28.754689 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3b239-b88c-4220-b53d-2eca1a45c967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:28.756296 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3b239-b88c-4220-b53d-2eca1a45c967 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:28.766623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1367/2751] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:51:28.770667 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca1a57-0ecb-4371-9fa4-2240c17b2e3c admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:28.781133 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca1a57-0ecb-4371-9fa4-2240c17b2e3c admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:28.785792 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8ca9d-466d-4925-a0f1-e1f1ef797e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:28.786450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8ca9d-466d-4925-a0f1-e1f1ef797e9e admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:28.786738 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8ca9d-466d-4925-a0f1-e1f1ef797e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:28.787018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8ca9d-466d-4925-a0f1-e1f1ef797e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:28.787791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8ca9d-466d-4925-a0f1-e1f1ef797e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:28.789389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8ca9d-466d-4925-a0f1-e1f1ef797e9e admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:28.800067 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1385/2752] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:51:28.803554 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3b239-b88c-4220-b53d-2eca1a45c967 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:28.813195 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3b239-b88c-4220-b53d-2eca1a45c967 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:28.817674 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8c9b1-dbf0-4227-8212-d124a11d34e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:28.818529 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8c9b1-dbf0-4227-8212-d124a11d34e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:28.818810 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8c9b1-dbf0-4227-8212-d124a11d34e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:28.819084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8c9b1-dbf0-4227-8212-d124a11d34e2 admin admin] PATH_INFO: `/v3/projects/d3275e73cf984d4f9ba8c5a023895576/users/f5ed43d5eb80476d97f3e70f46d6955f/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:28.821286 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:28.836315 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8c9b1-dbf0-4227-8212-d124a11d34e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3275e73cf984d4f9ba8c5a023895576, user_id=f5ed43d5eb80476d97f3e70f46d6955f, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:28.839973 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8c9b1-dbf0-4227-8212-d124a11d34e2 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:28.853048 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1368/2753] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:51:28 2022] PUT /identity/v3/projects/d3275e73cf984d4f9ba8c5a023895576/users/f5ed43d5eb80476d97f3e70f46d6955f/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 09:51:28.863894 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51f1e6-4300-414c-a190-4a099f9d09b6 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:28.864187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51f1e6-4300-414c-a190-4a099f9d09b6 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:28.864468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51f1e6-4300-414c-a190-4a099f9d09b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:28.890061 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-2d51f1e6-4300-414c-a190-4a099f9d09b6 None None] MFA Rules not processed for user `f5ed43d5eb80476d97f3e70f46d6955f`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:28.891251 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-2d51f1e6-4300-414c-a190-4a099f9d09b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:28.953108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1386/2754] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:28.964657 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8c9b1-dbf0-4227-8212-d124a11d34e2 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:28.966311 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-9bc8c9b1-dbf0-4227-8212-d124a11d34e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:29.021944 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8c9b1-dbf0-4227-8212-d124a11d34e2 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:29.026151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3b1dc-fb32-4aa5-b3f9-e5b48b32c005 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:29.026789 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3b1dc-fb32-4aa5-b3f9-e5b48b32c005 service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:29.027076 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3b1dc-fb32-4aa5-b3f9-e5b48b32c005 service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:29.027392 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3b1dc-fb32-4aa5-b3f9-e5b48b32c005 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:29.035845 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3b1dc-fb32-4aa5-b3f9-e5b48b32c005 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:29.037279 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3b1dc-fb32-4aa5-b3f9-e5b48b32c005 service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:29.046472 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1369/2755] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:51:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:51:29.064818 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51f1e6-4300-414c-a190-4a099f9d09b6 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:29.125461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51f1e6-4300-414c-a190-4a099f9d09b6 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:29.129966 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58a164-47ff-4633-8303-a0b9c004eb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:29.130821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58a164-47ff-4633-8303-a0b9c004eb80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:29.131101 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58a164-47ff-4633-8303-a0b9c004eb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:29.131414 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58a164-47ff-4633-8303-a0b9c004eb80 admin admin] PATH_INFO: `/v3/users/f5ed43d5eb80476d97f3e70f46d6955f` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:29.132586 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58a164-47ff-4633-8303-a0b9c004eb80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5ed43d5eb80476d97f3e70f46d6955f)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:29.135106 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58a164-47ff-4633-8303-a0b9c004eb80 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:29.181414 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6f58a164-47ff-4633-8303-a0b9c004eb80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5ed43d5eb80476d97f3e70f46d6955f'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:29.182083 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6f58a164-47ff-4633-8303-a0b9c004eb80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5ed43d5eb80476d97f3e70f46d6955f'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:29.184121 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:29.190458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6f58a164-47ff-4633-8303-a0b9c004eb80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5ed43d5eb80476d97f3e70f46d6955f'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:29.191209 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6f58a164-47ff-4633-8303-a0b9c004eb80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5ed43d5eb80476d97f3e70f46d6955f'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:29.204832 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-6f58a164-47ff-4633-8303-a0b9c004eb80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5ed43d5eb80476d97f3e70f46d6955f'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:29.218648 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1387/2756] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:51:29 2022] DELETE /identity/v3/users/f5ed43d5eb80476d97f3e70f46d6955f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:29.223123 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d108e6e-d492-48c6-8ae7-26515f2cce04 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:29.223475 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d108e6e-d492-48c6-8ae7-26515f2cce04 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:29.223781 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d108e6e-d492-48c6-8ae7-26515f2cce04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:29.240523 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-3d108e6e-d492-48c6-8ae7-26515f2cce04 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:29.241714 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-3d108e6e-d492-48c6-8ae7-26515f2cce04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:29.302650 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1370/2757] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:29.311669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58a164-47ff-4633-8303-a0b9c004eb80 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:29.313149 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-6f58a164-47ff-4633-8303-a0b9c004eb80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:29.374038 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58a164-47ff-4633-8303-a0b9c004eb80 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:29.377693 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef11bc-22bc-4cd8-8df7-6ecc99ec816e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:29.378346 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef11bc-22bc-4cd8-8df7-6ecc99ec816e service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:29.378627 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef11bc-22bc-4cd8-8df7-6ecc99ec816e service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:29.378899 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef11bc-22bc-4cd8-8df7-6ecc99ec816e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:29.389000 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef11bc-22bc-4cd8-8df7-6ecc99ec816e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:29.390430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef11bc-22bc-4cd8-8df7-6ecc99ec816e service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:29.400586 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1388/2758] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:51:29.659313 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d108e6e-d492-48c6-8ae7-26515f2cce04 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:29.660804 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-3d108e6e-d492-48c6-8ae7-26515f2cce04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:29.672727 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d108e6e-d492-48c6-8ae7-26515f2cce04 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:29.677886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb5eb6-8bcd-49ed-a21d-7af9e6899c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:29.678760 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb5eb6-8bcd-49ed-a21d-7af9e6899c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:29.679046 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb5eb6-8bcd-49ed-a21d-7af9e6899c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:29.679363 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb5eb6-8bcd-49ed-a21d-7af9e6899c5b admin admin] PATH_INFO: `/v3/projects/d3275e73cf984d4f9ba8c5a023895576` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:29.680657 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb5eb6-8bcd-49ed-a21d-7af9e6899c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3275e73cf984d4f9ba8c5a023895576)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:29.683318 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb5eb6-8bcd-49ed-a21d-7af9e6899c5b admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:29.732125 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f1cb5eb6-8bcd-49ed-a21d-7af9e6899c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3275e73cf984d4f9ba8c5a023895576', 'request_id': 'req-f1cb5eb6-8bcd-49ed-a21d-7af9e6899c5b'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:29.739343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f1cb5eb6-8bcd-49ed-a21d-7af9e6899c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3275e73cf984d4f9ba8c5a023895576', 'request_id': 'req-f1cb5eb6-8bcd-49ed-a21d-7af9e6899c5b'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:29.746441 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f1cb5eb6-8bcd-49ed-a21d-7af9e6899c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3275e73cf984d4f9ba8c5a023895576', 'request_id': 'req-f1cb5eb6-8bcd-49ed-a21d-7af9e6899c5b'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:29.756971 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f1cb5eb6-8bcd-49ed-a21d-7af9e6899c5b admin admin] The token cache is being invalidate because project d3275e73cf984d4f9ba8c5a023895576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:51:29.757261 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f1cb5eb6-8bcd-49ed-a21d-7af9e6899c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:29.757896 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-f1cb5eb6-8bcd-49ed-a21d-7af9e6899c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:29.759467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1371/2759] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:51:29 2022] DELETE /identity/v3/projects/d3275e73cf984d4f9ba8c5a023895576 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:29.764471 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c94823-4837-45af-abda-721aa9cfe946 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:29.764938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c94823-4837-45af-abda-721aa9cfe946 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:29.765035 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c94823-4837-45af-abda-721aa9cfe946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:29.785623 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-a2c94823-4837-45af-abda-721aa9cfe946 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:29.786945 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-a2c94823-4837-45af-abda-721aa9cfe946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:29.847091 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1389/2760] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:29.856364 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f73c2-0c86-4f25-a906-f7ae0fc504bc None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:29.856661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f73c2-0c86-4f25-a906-f7ae0fc504bc None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:29.856944 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f73c2-0c86-4f25-a906-f7ae0fc504bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:29.875724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-da9f73c2-0c86-4f25-a906-f7ae0fc504bc None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:29.876921 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-da9f73c2-0c86-4f25-a906-f7ae0fc504bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:29.884950 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1372/2761] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:29.889743 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c94823-4837-45af-abda-721aa9cfe946 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:29.899295 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c94823-4837-45af-abda-721aa9cfe946 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:29.903913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2d26b-f5f4-4b2c-bf74-300635b178db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:29.904568 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2d26b-f5f4-4b2c-bf74-300635b178db admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:29.904855 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2d26b-f5f4-4b2c-bf74-300635b178db admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:29.905134 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2d26b-f5f4-4b2c-bf74-300635b178db admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:29.905859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2d26b-f5f4-4b2c-bf74-300635b178db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:51:29.906169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2d26b-f5f4-4b2c-bf74-300635b178db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:29.907822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2d26b-f5f4-4b2c-bf74-300635b178db admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:29.919740 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1390/2762] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:51:29.923806 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f73c2-0c86-4f25-a906-f7ae0fc504bc None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:29.928098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:29.934979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f73c2-0c86-4f25-a906-f7ae0fc504bc None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:29.940405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a9969-d444-4c6d-8c42-7b1f385c01c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:29.941052 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a9969-d444-4c6d-8c42-7b1f385c01c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:29.941334 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a9969-d444-4c6d-8c42-7b1f385c01c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:29.941605 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a9969-d444-4c6d-8c42-7b1f385c01c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:29.942283 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a9969-d444-4c6d-8c42-7b1f385c01c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:29.944244 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a9969-d444-4c6d-8c42-7b1f385c01c4 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:29.969013 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1373/2763] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:51:29 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:51:29.973098 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2d26b-f5f4-4b2c-bf74-300635b178db admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:29.983590 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2d26b-f5f4-4b2c-bf74-300635b178db admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:30.033397 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:30.040521 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0f582-a5cc-468a-af4c-33535839674a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:30.041786 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0f582-a5cc-468a-af4c-33535839674a admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:30.042462 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0f582-a5cc-468a-af4c-33535839674a admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:30.042841 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0f582-a5cc-468a-af4c-33535839674a admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:30.043565 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0f582-a5cc-468a-af4c-33535839674a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:30.046011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0f582-a5cc-468a-af4c-33535839674a admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:30.070434 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1391/2764] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:51:29 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:51:30.074591 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a9969-d444-4c6d-8c42-7b1f385c01c4 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:30.084907 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a9969-d444-4c6d-8c42-7b1f385c01c4 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:30.090182 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcebfe5-828e-4f8b-8af8-1df6cb6a0be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:30.090829 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcebfe5-828e-4f8b-8af8-1df6cb6a0be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:30.091108 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcebfe5-828e-4f8b-8af8-1df6cb6a0be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:30.091423 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcebfe5-828e-4f8b-8af8-1df6cb6a0be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:30.092134 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcebfe5-828e-4f8b-8af8-1df6cb6a0be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:30.093702 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcebfe5-828e-4f8b-8af8-1df6cb6a0be4 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:30.105013 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1374/2765] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:51:30.108806 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0f582-a5cc-468a-af4c-33535839674a admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:30.119137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0f582-a5cc-468a-af4c-33535839674a admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:30.123814 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686881e-cf0f-4eea-b576-6a9f5d745cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:30.124490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686881e-cf0f-4eea-b576-6a9f5d745cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:30.124760 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686881e-cf0f-4eea-b576-6a9f5d745cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:30.125042 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686881e-cf0f-4eea-b576-6a9f5d745cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:30.125769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686881e-cf0f-4eea-b576-6a9f5d745cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:30.127395 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686881e-cf0f-4eea-b576-6a9f5d745cc1 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:30.137123 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1392/2766] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:51:30.140997 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcebfe5-828e-4f8b-8af8-1df6cb6a0be4 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:30.151247 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcebfe5-828e-4f8b-8af8-1df6cb6a0be4 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:30.156153 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9320de6-40bd-4842-bb8a-1515d719d0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:30.157061 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9320de6-40bd-4842-bb8a-1515d719d0af admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:30.157343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9320de6-40bd-4842-bb8a-1515d719d0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:30.157620 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9320de6-40bd-4842-bb8a-1515d719d0af admin admin] PATH_INFO: `/v3/projects/71bb7998eaea4db7bca685055d30672d/users/c178999201c146d2928fa4f614a52cb0/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:30.172527 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9320de6-40bd-4842-bb8a-1515d719d0af admin admin] RBAC: Authorizing `identity:create_grant(project_id=71bb7998eaea4db7bca685055d30672d, user_id=c178999201c146d2928fa4f614a52cb0, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:30.175175 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9320de6-40bd-4842-bb8a-1515d719d0af admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:30.187343 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1375/2767] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:51:30 2022] PUT /identity/v3/projects/71bb7998eaea4db7bca685055d30672d/users/c178999201c146d2928fa4f614a52cb0/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:30.197393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab9c41-5548-4b7d-81d9-259718caec02 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:30.197708 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab9c41-5548-4b7d-81d9-259718caec02 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:30.197990 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab9c41-5548-4b7d-81d9-259718caec02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:30.224515 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-9fab9c41-5548-4b7d-81d9-259718caec02 None None] MFA Rules not processed for user `c178999201c146d2928fa4f614a52cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:30.225727 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-9fab9c41-5548-4b7d-81d9-259718caec02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:30.288067 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1393/2768] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:30.300011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9320de6-40bd-4842-bb8a-1515d719d0af admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:30.301687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-c9320de6-40bd-4842-bb8a-1515d719d0af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:30.358415 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9320de6-40bd-4842-bb8a-1515d719d0af admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:30.362042 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be373823-2037-4067-93b9-3f23cd60508a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:30.362681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be373823-2037-4067-93b9-3f23cd60508a service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:30.362964 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be373823-2037-4067-93b9-3f23cd60508a service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:30.363248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be373823-2037-4067-93b9-3f23cd60508a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:30.371419 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be373823-2037-4067-93b9-3f23cd60508a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:30.372934 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be373823-2037-4067-93b9-3f23cd60508a service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:30.381566 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1376/2769] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:51:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:51:30.401048 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab9c41-5548-4b7d-81d9-259718caec02 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:30.465314 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab9c41-5548-4b7d-81d9-259718caec02 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:30.470117 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e623b-754e-4a5f-a750-54f39b8a8b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:30.471085 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e623b-754e-4a5f-a750-54f39b8a8b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:30.471461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e623b-754e-4a5f-a750-54f39b8a8b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:30.471833 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e623b-754e-4a5f-a750-54f39b8a8b8d admin admin] PATH_INFO: `/v3/users/c178999201c146d2928fa4f614a52cb0` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:30.473183 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e623b-754e-4a5f-a750-54f39b8a8b8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c178999201c146d2928fa4f614a52cb0)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:30.475801 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e623b-754e-4a5f-a750-54f39b8a8b8d admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:30.527691 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-de1e623b-754e-4a5f-a750-54f39b8a8b8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c178999201c146d2928fa4f614a52cb0'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:30.528361 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-de1e623b-754e-4a5f-a750-54f39b8a8b8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c178999201c146d2928fa4f614a52cb0'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:30.535248 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-de1e623b-754e-4a5f-a750-54f39b8a8b8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c178999201c146d2928fa4f614a52cb0'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:30.535953 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-de1e623b-754e-4a5f-a750-54f39b8a8b8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c178999201c146d2928fa4f614a52cb0'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:30.544387 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:30.550715 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-de1e623b-754e-4a5f-a750-54f39b8a8b8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c178999201c146d2928fa4f614a52cb0'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:30.563065 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1394/2770] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:51:30 2022] DELETE /identity/v3/users/c178999201c146d2928fa4f614a52cb0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:30.567615 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896b30f-390f-4cc6-aba7-b8e1b0874266 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:30.567890 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896b30f-390f-4cc6-aba7-b8e1b0874266 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:30.568167 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896b30f-390f-4cc6-aba7-b8e1b0874266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:30.585583 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-8896b30f-390f-4cc6-aba7-b8e1b0874266 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:30.586761 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-8896b30f-390f-4cc6-aba7-b8e1b0874266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:30.644430 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1377/2771] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:51:30.654620 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e623b-754e-4a5f-a750-54f39b8a8b8d admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:30.656030 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-de1e623b-754e-4a5f-a750-54f39b8a8b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:30.711633 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e623b-754e-4a5f-a750-54f39b8a8b8d admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:30.715993 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c6994-9d82-431c-946b-e8c068da4342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:30.716630 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c6994-9d82-431c-946b-e8c068da4342 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:30.716917 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c6994-9d82-431c-946b-e8c068da4342 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:30.717191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c6994-9d82-431c-946b-e8c068da4342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:30.726023 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c6994-9d82-431c-946b-e8c068da4342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:30.727486 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c6994-9d82-431c-946b-e8c068da4342 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:30.736845 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1395/2772] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:51:31.018224 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896b30f-390f-4cc6-aba7-b8e1b0874266 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:31.020349 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-8896b30f-390f-4cc6-aba7-b8e1b0874266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:31.037733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896b30f-390f-4cc6-aba7-b8e1b0874266 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:31.043048 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f58fa6-2fbb-4cf8-8d4a-0b11bd2728eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:31.043943 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f58fa6-2fbb-4cf8-8d4a-0b11bd2728eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:31.044223 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f58fa6-2fbb-4cf8-8d4a-0b11bd2728eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:31.044603 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f58fa6-2fbb-4cf8-8d4a-0b11bd2728eb admin admin] PATH_INFO: `/v3/projects/71bb7998eaea4db7bca685055d30672d` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:31.045782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f58fa6-2fbb-4cf8-8d4a-0b11bd2728eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=71bb7998eaea4db7bca685055d30672d)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:31.047770 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f58fa6-2fbb-4cf8-8d4a-0b11bd2728eb admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:31.092382 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:31.096871 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-31f58fa6-2fbb-4cf8-8d4a-0b11bd2728eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71bb7998eaea4db7bca685055d30672d', 'request_id': 'req-31f58fa6-2fbb-4cf8-8d4a-0b11bd2728eb'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:31.104940 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-31f58fa6-2fbb-4cf8-8d4a-0b11bd2728eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71bb7998eaea4db7bca685055d30672d', 'request_id': 'req-31f58fa6-2fbb-4cf8-8d4a-0b11bd2728eb'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:31.111063 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-31f58fa6-2fbb-4cf8-8d4a-0b11bd2728eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71bb7998eaea4db7bca685055d30672d', 'request_id': 'req-31f58fa6-2fbb-4cf8-8d4a-0b11bd2728eb'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:31.121165 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-31f58fa6-2fbb-4cf8-8d4a-0b11bd2728eb admin admin] The token cache is being invalidate because project 71bb7998eaea4db7bca685055d30672d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:51:31.121451 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-31f58fa6-2fbb-4cf8-8d4a-0b11bd2728eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:31.122079 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-31f58fa6-2fbb-4cf8-8d4a-0b11bd2728eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:51:31.123642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1378/2773] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:51:31 2022] DELETE /identity/v3/projects/71bb7998eaea4db7bca685055d30672d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:31.128450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5431eb-a977-4557-a404-6352c87497ba None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:31.128938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5431eb-a977-4557-a404-6352c87497ba None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:31.129035 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5431eb-a977-4557-a404-6352c87497ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:31.146308 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-6e5431eb-a977-4557-a404-6352c87497ba None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:31.147539 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-6e5431eb-a977-4557-a404-6352c87497ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:31.212637 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1396/2774] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:31.221053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d4b2b-e777-48fd-87db-5c0252071162 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:31.221419 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d4b2b-e777-48fd-87db-5c0252071162 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:31.221763 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d4b2b-e777-48fd-87db-5c0252071162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:31.241558 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-bc4d4b2b-e777-48fd-87db-5c0252071162 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:31.242738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-bc4d4b2b-e777-48fd-87db-5c0252071162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:31.250490 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1379/2775] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:31.254631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5431eb-a977-4557-a404-6352c87497ba None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:31.264698 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5431eb-a977-4557-a404-6352c87497ba None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:31.269299 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4800d-d623-4007-a102-c28e9191ea7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:31.269954 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4800d-d623-4007-a102-c28e9191ea7f admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:31.270240 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4800d-d623-4007-a102-c28e9191ea7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:31.270520 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4800d-d623-4007-a102-c28e9191ea7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:31.271243 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d4800d-d623-4007-a102-c28e9191ea7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:51:31.271583 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d4800d-d623-4007-a102-c28e9191ea7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:31.273196 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d4800d-d623-4007-a102-c28e9191ea7f admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:31.285191 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1397/2776] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:51:31.289280 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d4b2b-e777-48fd-87db-5c0252071162 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:31.298709 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d4b2b-e777-48fd-87db-5c0252071162 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:31.303310 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154cd3d-a978-443c-af4d-adc6c303d337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:31.303951 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154cd3d-a978-443c-af4d-adc6c303d337 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:31.304232 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154cd3d-a978-443c-af4d-adc6c303d337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:31.304508 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154cd3d-a978-443c-af4d-adc6c303d337 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:31.305183 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154cd3d-a978-443c-af4d-adc6c303d337 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:31.307143 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154cd3d-a978-443c-af4d-adc6c303d337 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:31.332534 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1380/2777] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:51:31 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:51:31.336629 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4800d-d623-4007-a102-c28e9191ea7f admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:31.347387 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4800d-d623-4007-a102-c28e9191ea7f admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:31.402518 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a4d96-4b9b-4206-b6e5-514101469123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:31.403215 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a4d96-4b9b-4206-b6e5-514101469123 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:31.403533 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a4d96-4b9b-4206-b6e5-514101469123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:31.403814 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a4d96-4b9b-4206-b6e5-514101469123 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:31.404511 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a4d96-4b9b-4206-b6e5-514101469123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:31.406432 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a4d96-4b9b-4206-b6e5-514101469123 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:31.426078 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1398/2778] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:51:31 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:51:31.430078 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154cd3d-a978-443c-af4d-adc6c303d337 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:31.441219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154cd3d-a978-443c-af4d-adc6c303d337 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:31.445865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14a706-be14-4f7c-a942-7a4d4d72d6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:31.446545 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14a706-be14-4f7c-a942-7a4d4d72d6eb admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:31.446828 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14a706-be14-4f7c-a942-7a4d4d72d6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:31.447105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14a706-be14-4f7c-a942-7a4d4d72d6eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:31.447861 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14a706-be14-4f7c-a942-7a4d4d72d6eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:31.449476 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14a706-be14-4f7c-a942-7a4d4d72d6eb admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:31.460255 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1381/2779] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:51:31.464373 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a4d96-4b9b-4206-b6e5-514101469123 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:31.470913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:31.474791 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a4d96-4b9b-4206-b6e5-514101469123 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:31.481328 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8eda5-323e-44a4-ac15-6d6ce05dbbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:31.482158 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8eda5-323e-44a4-ac15-6d6ce05dbbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:31.482675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8eda5-323e-44a4-ac15-6d6ce05dbbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:31.483161 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8eda5-323e-44a4-ac15-6d6ce05dbbc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:31.483920 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8eda5-323e-44a4-ac15-6d6ce05dbbc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:31.485611 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8eda5-323e-44a4-ac15-6d6ce05dbbc8 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:31.503782 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1399/2780] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:51:31.507938 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14a706-be14-4f7c-a942-7a4d4d72d6eb admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:31.518004 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14a706-be14-4f7c-a942-7a4d4d72d6eb admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:31.522571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee764d6-368a-4f70-ab23-fea03acbd67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:31.523474 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee764d6-368a-4f70-ab23-fea03acbd67b admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:31.523757 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee764d6-368a-4f70-ab23-fea03acbd67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:31.524032 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee764d6-368a-4f70-ab23-fea03acbd67b admin admin] PATH_INFO: `/v3/projects/a3b3756646384286b208f7ddafc0e1ad/users/17106683169d4c46a1ec7586e44422e7/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:31.538664 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee764d6-368a-4f70-ab23-fea03acbd67b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b3756646384286b208f7ddafc0e1ad, user_id=17106683169d4c46a1ec7586e44422e7, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:31.541909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee764d6-368a-4f70-ab23-fea03acbd67b admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:31.554448 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1382/2781] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:51:31 2022] PUT /identity/v3/projects/a3b3756646384286b208f7ddafc0e1ad/users/17106683169d4c46a1ec7586e44422e7/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:51:31.565929 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccf68d-4c53-4324-b845-402336939b10 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:31.566217 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccf68d-4c53-4324-b845-402336939b10 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:31.566492 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccf68d-4c53-4324-b845-402336939b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:31.594823 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-f8ccf68d-4c53-4324-b845-402336939b10 None None] MFA Rules not processed for user `17106683169d4c46a1ec7586e44422e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:51:31.596088 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f8ccf68d-4c53-4324-b845-402336939b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:31.661051 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1400/2782] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:51:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:51:31.673430 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee764d6-368a-4f70-ab23-fea03acbd67b admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:31.675203 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-0ee764d6-368a-4f70-ab23-fea03acbd67b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:31.732952 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee764d6-368a-4f70-ab23-fea03acbd67b admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:31.736707 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290268cb-f543-4daa-9c7a-0e02b9bb9dc4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e04575437341df8127860a5e5abc50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:31.737344 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290268cb-f543-4daa-9c7a-0e02b9bb9dc4 service glance] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:31.737628 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290268cb-f543-4daa-9c7a-0e02b9bb9dc4 service glance] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:31.737906 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290268cb-f543-4daa-9c7a-0e02b9bb9dc4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:31.746620 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290268cb-f543-4daa-9c7a-0e02b9bb9dc4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:31.748077 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290268cb-f543-4daa-9c7a-0e02b9bb9dc4 service glance] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:31.756868 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1383/2783] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:51:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:51:36.633561 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccf68d-4c53-4324-b845-402336939b10 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:51:36.634960 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f8ccf68d-4c53-4324-b845-402336939b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:36.693663 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccf68d-4c53-4324-b845-402336939b10 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:51:36.697326 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff16adf-7b63-445c-9580-f42963c1736e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:51:36.697985 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff16adf-7b63-445c-9580-f42963c1736e service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:51:36.698350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff16adf-7b63-445c-9580-f42963c1736e service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:51:36.698634 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff16adf-7b63-445c-9580-f42963c1736e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:51:36.700476 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-2ff16adf-7b63-445c-9580-f42963c1736e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:51:36.764052 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff16adf-7b63-445c-9580-f42963c1736e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:51:36.765476 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff16adf-7b63-445c-9580-f42963c1736e service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:51:36.776735 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1401/2784] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:51:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:51:41.752875 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=61,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:46.771588 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=85 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:05.644152 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290268cb-f543-4daa-9c7a-0e02b9bb9dc4 service glance] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:52:05.723913 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290268cb-f543-4daa-9c7a-0e02b9bb9dc4 service glance] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:52:05.728420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc4a64-a0c2-4f3b-8c44-103ebcbe428a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:52:05.729280 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc4a64-a0c2-4f3b-8c44-103ebcbe428a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:52:05.729562 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc4a64-a0c2-4f3b-8c44-103ebcbe428a admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:52:05.729837 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc4a64-a0c2-4f3b-8c44-103ebcbe428a admin admin] PATH_INFO: `/v3/users/17106683169d4c46a1ec7586e44422e7` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:52:05.731667 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc4a64-a0c2-4f3b-8c44-103ebcbe428a admin admin] RBAC: Authorizing `identity:delete_user(user_id=17106683169d4c46a1ec7586e44422e7)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:52:05.733590 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc4a64-a0c2-4f3b-8c44-103ebcbe428a admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:52:05.778499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-30dc4a64-a0c2-4f3b-8c44-103ebcbe428a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17106683169d4c46a1ec7586e44422e7'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:52:05.785194 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-30dc4a64-a0c2-4f3b-8c44-103ebcbe428a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17106683169d4c46a1ec7586e44422e7'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:52:05.785854 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-30dc4a64-a0c2-4f3b-8c44-103ebcbe428a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17106683169d4c46a1ec7586e44422e7'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:52:05.798746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-30dc4a64-a0c2-4f3b-8c44-103ebcbe428a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17106683169d4c46a1ec7586e44422e7'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:52:05.805843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-30dc4a64-a0c2-4f3b-8c44-103ebcbe428a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17106683169d4c46a1ec7586e44422e7'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:52:05.811833 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1384/2785] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:52:05 2022] DELETE /identity/v3/users/17106683169d4c46a1ec7586e44422e7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:52:05.816364 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae558f-d87c-4447-8e89-1a1ed6dd3f09 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:52:05.816853 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae558f-d87c-4447-8e89-1a1ed6dd3f09 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:52:05.816980 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae558f-d87c-4447-8e89-1a1ed6dd3f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:52:05.854988 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-c9ae558f-d87c-4447-8e89-1a1ed6dd3f09 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:52:05.856872 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-c9ae558f-d87c-4447-8e89-1a1ed6dd3f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:52:05.914837 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1402/2786] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:52:05.925096 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc4a64-a0c2-4f3b-8c44-103ebcbe428a admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:52:05.926486 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-30dc4a64-a0c2-4f3b-8c44-103ebcbe428a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:52:05.995128 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:06.005536 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc4a64-a0c2-4f3b-8c44-103ebcbe428a admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:52:06.009218 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94662fd-dc23-489e-8a1f-7077b73e41b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:52:06.009857 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94662fd-dc23-489e-8a1f-7077b73e41b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:52:06.010144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94662fd-dc23-489e-8a1f-7077b73e41b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:52:06.010421 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94662fd-dc23-489e-8a1f-7077b73e41b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:52:06.019541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94662fd-dc23-489e-8a1f-7077b73e41b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:52:06.020967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94662fd-dc23-489e-8a1f-7077b73e41b1 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:52:06.030886 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1385/2787] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:52:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:52:06.292571 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae558f-d87c-4447-8e89-1a1ed6dd3f09 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:52:06.294051 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-c9ae558f-d87c-4447-8e89-1a1ed6dd3f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:52:06.307808 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae558f-d87c-4447-8e89-1a1ed6dd3f09 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:52:06.313652 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91dbbb-963f-466c-ab00-396f3a5f273a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:52:06.314381 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91dbbb-963f-466c-ab00-396f3a5f273a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:52:06.314674 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91dbbb-963f-466c-ab00-396f3a5f273a admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:52:06.314952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91dbbb-963f-466c-ab00-396f3a5f273a admin admin] PATH_INFO: `/v3/projects/a3b3756646384286b208f7ddafc0e1ad` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:52:06.316860 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91dbbb-963f-466c-ab00-396f3a5f273a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3b3756646384286b208f7ddafc0e1ad)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:52:06.319011 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91dbbb-963f-466c-ab00-396f3a5f273a admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:52:06.366915 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0d91dbbb-963f-466c-ab00-396f3a5f273a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b3756646384286b208f7ddafc0e1ad', 'request_id': 'req-0d91dbbb-963f-466c-ab00-396f3a5f273a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:52:06.374496 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0d91dbbb-963f-466c-ab00-396f3a5f273a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b3756646384286b208f7ddafc0e1ad', 'request_id': 'req-0d91dbbb-963f-466c-ab00-396f3a5f273a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:52:06.380123 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0d91dbbb-963f-466c-ab00-396f3a5f273a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b3756646384286b208f7ddafc0e1ad', 'request_id': 'req-0d91dbbb-963f-466c-ab00-396f3a5f273a'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:52:06.392869 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0d91dbbb-963f-466c-ab00-396f3a5f273a admin admin] The token cache is being invalidate because project a3b3756646384286b208f7ddafc0e1ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:52:06.393164 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0d91dbbb-963f-466c-ab00-396f3a5f273a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:52:06.393831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-0d91dbbb-963f-466c-ab00-396f3a5f273a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:52:06.395398 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1403/2788] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:52:06 2022] DELETE /identity/v3/projects/a3b3756646384286b208f7ddafc0e1ad => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:52:16.026091 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=7 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:16.389325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=62,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:26.617895 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1068793-bc21-457a-8804-8b474658b0a4 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:52:26.618422 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1068793-bc21-457a-8804-8b474658b0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:52:26.618545 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1068793-bc21-457a-8804-8b474658b0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:52:26.636073 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-c1068793-bc21-457a-8804-8b474658b0a4 None None] MFA Rules not processed for user `8d96e9d955934f0e883df57a3bcf934d`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:52:26.637784 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-c1068793-bc21-457a-8804-8b474658b0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:52:26.691618 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1386/2789] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:52:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:52:26.981081 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91dbbb-963f-466c-ab00-396f3a5f273a admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:52:26.982532 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-0d91dbbb-963f-466c-ab00-396f3a5f273a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:52:27.040394 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91dbbb-963f-466c-ab00-396f3a5f273a admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:52:27.044640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f587f7-0edb-4dc4-b4d3-fb4eee72c45b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:52:27.045282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f587f7-0edb-4dc4-b4d3-fb4eee72c45b service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:52:27.045562 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f587f7-0edb-4dc4-b4d3-fb4eee72c45b service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:52:27.045834 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f587f7-0edb-4dc4-b4d3-fb4eee72c45b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:52:27.047599 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f2f587f7-0edb-4dc4-b4d3-fb4eee72c45b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:52:27.057008 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f587f7-0edb-4dc4-b4d3-fb4eee72c45b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:52:27.058987 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f587f7-0edb-4dc4-b4d3-fb4eee72c45b service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:52:27.067004 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1404/2790] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:52:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:52:36.685129 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=25 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:37.063412 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=26 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:53:03.049327 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1068793-bc21-457a-8804-8b474658b0a4 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:53:03.050704 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-c1068793-bc21-457a-8804-8b474658b0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:53:03.140266 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1068793-bc21-457a-8804-8b474658b0a4 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:53:03.145313 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e897c-5793-4079-9184-bd4f7fb1e0fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746fd8ed517446fe89c53df873abb2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:53:03.145958 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e897c-5793-4079-9184-bd4f7fb1e0fa service placement] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:53:03.146247 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e897c-5793-4079-9184-bd4f7fb1e0fa service placement] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:53:03.146532 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e897c-5793-4079-9184-bd4f7fb1e0fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:53:03.148317 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-8e3e897c-5793-4079-9184-bd4f7fb1e0fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:53:03.159662 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e897c-5793-4079-9184-bd4f7fb1e0fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:53:03.161225 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e897c-5793-4079-9184-bd4f7fb1e0fa service placement] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:53:03.171598 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1387/2791] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:53:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:53:13.166788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=41 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:53:58.207228 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f587f7-0edb-4dc4-b4d3-fb4eee72c45b service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:53:58.209190 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f2f587f7-0edb-4dc4-b4d3-fb4eee72c45b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:53:58.307168 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f587f7-0edb-4dc4-b4d3-fb4eee72c45b service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:53:58.312630 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377b6f7-1b01-47c9-af2c-a9021f3ff7b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:53:58.313280 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377b6f7-1b01-47c9-af2c-a9021f3ff7b1 service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:53:58.313547 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377b6f7-1b01-47c9-af2c-a9021f3ff7b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:53:58.313821 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377b6f7-1b01-47c9-af2c-a9021f3ff7b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:53:58.315597 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-3377b6f7-1b01-47c9-af2c-a9021f3ff7b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:53:58.325933 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377b6f7-1b01-47c9-af2c-a9021f3ff7b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:53:58.327533 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377b6f7-1b01-47c9-af2c-a9021f3ff7b1 service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:53:58.336792 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1405/2792] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:53:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:53:59.747694 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e897c-5793-4079-9184-bd4f7fb1e0fa service placement] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:53:59.749101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-8e3e897c-5793-4079-9184-bd4f7fb1e0fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:53:59.830479 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e897c-5793-4079-9184-bd4f7fb1e0fa service placement] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:53:59.835053 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8824a69-05fe-4066-883f-6f57892159a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:53:59.835739 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8824a69-05fe-4066-883f-6f57892159a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:53:59.836028 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8824a69-05fe-4066-883f-6f57892159a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:53:59.836305 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8824a69-05fe-4066-883f-6f57892159a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:53:59.838357 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e8824a69-05fe-4066-883f-6f57892159a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:53:59.852151 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8824a69-05fe-4066-883f-6f57892159a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:53:59.853565 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8824a69-05fe-4066-883f-6f57892159a5 service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:53:59.864885 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1388/2793] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:53:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:54:07.646951 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377b6f7-1b01-47c9-af2c-a9021f3ff7b1 service nova] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:54:07.657159 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377b6f7-1b01-47c9-af2c-a9021f3ff7b1 service nova] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:54:07.660702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a175acc-ccdd-4fff-88e7-b4dd0280cfaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:54:07.661347 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a175acc-ccdd-4fff-88e7-b4dd0280cfaa service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:54:07.661640 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a175acc-ccdd-4fff-88e7-b4dd0280cfaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:54:07.662445 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a175acc-ccdd-4fff-88e7-b4dd0280cfaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:54:07.664266 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-4a175acc-ccdd-4fff-88e7-b4dd0280cfaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:54:07.678628 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a175acc-ccdd-4fff-88e7-b4dd0280cfaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:54:07.680222 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a175acc-ccdd-4fff-88e7-b4dd0280cfaa service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:54:07.690949 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1406/2794] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:54:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:54:09.859539 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=35 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:54:11.261561 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87724a3d-e095-470f-9353-10132bb40499 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:54:11.262240 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87724a3d-e095-470f-9353-10132bb40499 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:54:11.262240 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87724a3d-e095-470f-9353-10132bb40499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:54:11.279076 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-87724a3d-e095-470f-9353-10132bb40499 None None] MFA Rules not processed for user `f1fa5f1765ed4995b31a1600ce3edb07`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:54:11.280284 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-87724a3d-e095-470f-9353-10132bb40499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:54:11.339896 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1389/2795] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:54:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:54:17.686260 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=52 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:54:18.540345 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db8e3c-99bc-4f0f-ade8-f09ebee6a854 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:54:18.540632 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db8e3c-99bc-4f0f-ade8-f09ebee6a854 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:54:18.540913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db8e3c-99bc-4f0f-ade8-f09ebee6a854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:54:18.559219 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-58db8e3c-99bc-4f0f-ade8-f09ebee6a854 None None] MFA Rules not processed for user `8d96e9d955934f0e883df57a3bcf934d`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:54:18.560435 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-58db8e3c-99bc-4f0f-ade8-f09ebee6a854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:54:18.567141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1407/2796] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:54:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:54:18.872957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87724a3d-e095-470f-9353-10132bb40499 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:54:18.883549 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87724a3d-e095-470f-9353-10132bb40499 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:54:18.887059 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b68461-76bc-49d6-9368-fb9bf6648457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:54:18.887745 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b68461-76bc-49d6-9368-fb9bf6648457 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:54:18.888033 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b68461-76bc-49d6-9368-fb9bf6648457 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:54:18.888307 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b68461-76bc-49d6-9368-fb9bf6648457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:54:18.890038 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-a0b68461-76bc-49d6-9368-fb9bf6648457 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:54:18.901085 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b68461-76bc-49d6-9368-fb9bf6648457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:54:18.902709 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b68461-76bc-49d6-9368-fb9bf6648457 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:54:18.910960 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1390/2797] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:54:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:54:24.552422 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db8e3c-99bc-4f0f-ade8-f09ebee6a854 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:54:24.562731 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db8e3c-99bc-4f0f-ade8-f09ebee6a854 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:54:24.566284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f1d4e-aaba-4316-aa77-fe9728740a81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:54:24.566923 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f1d4e-aaba-4316-aa77-fe9728740a81 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:54:24.567207 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f1d4e-aaba-4316-aa77-fe9728740a81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:54:24.567548 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f1d4e-aaba-4316-aa77-fe9728740a81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:54:24.569338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-dd3f1d4e-aaba-4316-aa77-fe9728740a81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:54:24.578764 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f1d4e-aaba-4316-aa77-fe9728740a81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:54:24.580215 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f1d4e-aaba-4316-aa77-fe9728740a81 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:54:24.588900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1408/2798] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:54:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:54:28.907171 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=31 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:54:34.585122 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=9 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:02.484089 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b68461-76bc-49d6-9368-fb9bf6648457 service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:02.485619 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-a0b68461-76bc-49d6-9368-fb9bf6648457 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:02.504237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b68461-76bc-49d6-9368-fb9bf6648457 service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:02.511061 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a70245-b729-469d-99b0-10c55fc11444 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:02.511776 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a70245-b729-469d-99b0-10c55fc11444 service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:02.512043 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a70245-b729-469d-99b0-10c55fc11444 service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:02.512308 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a70245-b729-469d-99b0-10c55fc11444 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:02.514229 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-88a70245-b729-469d-99b0-10c55fc11444 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:02.527834 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a70245-b729-469d-99b0-10c55fc11444 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:02.529445 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a70245-b729-469d-99b0-10c55fc11444 service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:02.550729 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1391/2799] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:56:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:56:07.398901 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f1d4e-aaba-4316-aa77-fe9728740a81 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:07.400389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-dd3f1d4e-aaba-4316-aa77-fe9728740a81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:07.412353 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f1d4e-aaba-4316-aa77-fe9728740a81 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:07.416228 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470208f-ac1c-4c4e-9b27-cba1289d579e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:07.416867 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470208f-ac1c-4c4e-9b27-cba1289d579e service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:07.417144 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470208f-ac1c-4c4e-9b27-cba1289d579e service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:07.417418 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470208f-ac1c-4c4e-9b27-cba1289d579e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:07.419173 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-9470208f-ac1c-4c4e-9b27-cba1289d579e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:07.483719 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470208f-ac1c-4c4e-9b27-cba1289d579e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:07.485183 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470208f-ac1c-4c4e-9b27-cba1289d579e service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:07.495073 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1409/2800] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:56:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:56:10.533139 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a70245-b729-469d-99b0-10c55fc11444 service nova] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:10.534581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-88a70245-b729-469d-99b0-10c55fc11444 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:10.548809 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a70245-b729-469d-99b0-10c55fc11444 service nova] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:10.554381 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3869d42-4cd6-43b2-aef8-15d5d1d83f04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746fd8ed517446fe89c53df873abb2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:10.555030 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3869d42-4cd6-43b2-aef8-15d5d1d83f04 service placement] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:10.555340 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3869d42-4cd6-43b2-aef8-15d5d1d83f04 service placement] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:10.555620 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3869d42-4cd6-43b2-aef8-15d5d1d83f04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:10.557359 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e3869d42-4cd6-43b2-aef8-15d5d1d83f04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:10.569418 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3869d42-4cd6-43b2-aef8-15d5d1d83f04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:10.570998 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3869d42-4cd6-43b2-aef8-15d5d1d83f04 service placement] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:10.581723 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1392/2801] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:56:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:56:10.595591 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470208f-ac1c-4c4e-9b27-cba1289d579e service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:10.597338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-9470208f-ac1c-4c4e-9b27-cba1289d579e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:10.610338 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470208f-ac1c-4c4e-9b27-cba1289d579e service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:10.616075 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e132a0-1ca0-4dae-a1a3-744540604010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:10.617037 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e132a0-1ca0-4dae-a1a3-744540604010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:10.617323 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e132a0-1ca0-4dae-a1a3-744540604010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:10.617747 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e132a0-1ca0-4dae-a1a3-744540604010 admin admin] PATH_INFO: `/v3/users/8d96e9d955934f0e883df57a3bcf934d` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:10.619149 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e132a0-1ca0-4dae-a1a3-744540604010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d96e9d955934f0e883df57a3bcf934d)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:10.621588 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e132a0-1ca0-4dae-a1a3-744540604010 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:10.667171 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-84e132a0-1ca0-4dae-a1a3-744540604010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d96e9d955934f0e883df57a3bcf934d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:10.667891 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-84e132a0-1ca0-4dae-a1a3-744540604010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d96e9d955934f0e883df57a3bcf934d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:10.674754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-84e132a0-1ca0-4dae-a1a3-744540604010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d96e9d955934f0e883df57a3bcf934d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:10.675959 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-84e132a0-1ca0-4dae-a1a3-744540604010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d96e9d955934f0e883df57a3bcf934d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:10.687501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-84e132a0-1ca0-4dae-a1a3-744540604010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d96e9d955934f0e883df57a3bcf934d'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:10.700575 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1410/2802] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:56:10 2022] DELETE /identity/v3/users/8d96e9d955934f0e883df57a3bcf934d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:56:10.871251 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3869d42-4cd6-43b2-aef8-15d5d1d83f04 service placement] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:10.883422 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3869d42-4cd6-43b2-aef8-15d5d1d83f04 service placement] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:10.941932 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190841b-233d-4812-bf77-0c137e8b3b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:10.942786 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190841b-233d-4812-bf77-0c137e8b3b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:10.943081 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190841b-233d-4812-bf77-0c137e8b3b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:10.943366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190841b-233d-4812-bf77-0c137e8b3b22 admin admin] PATH_INFO: `/v3/projects/43091208be574e6e8cc348667792f751` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:10.944530 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190841b-233d-4812-bf77-0c137e8b3b22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43091208be574e6e8cc348667792f751)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:10.946440 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190841b-233d-4812-bf77-0c137e8b3b22 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:10.991909 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e190841b-233d-4812-bf77-0c137e8b3b22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43091208be574e6e8cc348667792f751', 'request_id': 'req-e190841b-233d-4812-bf77-0c137e8b3b22'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:10.998601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e190841b-233d-4812-bf77-0c137e8b3b22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43091208be574e6e8cc348667792f751', 'request_id': 'req-e190841b-233d-4812-bf77-0c137e8b3b22'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:11.004681 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e190841b-233d-4812-bf77-0c137e8b3b22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43091208be574e6e8cc348667792f751', 'request_id': 'req-e190841b-233d-4812-bf77-0c137e8b3b22'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:11.014701 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e190841b-233d-4812-bf77-0c137e8b3b22 admin admin] The token cache is being invalidate because project 43091208be574e6e8cc348667792f751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:56:11.014985 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e190841b-233d-4812-bf77-0c137e8b3b22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:11.015623 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-e190841b-233d-4812-bf77-0c137e8b3b22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:11.017144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1393/2803] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:56:10 2022] DELETE /identity/v3/projects/43091208be574e6e8cc348667792f751 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:56:11.023040 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a52e8-1370-4928-84f4-2ce165cad95e None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:11.023369 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a52e8-1370-4928-84f4-2ce165cad95e None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:11.023658 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a52e8-1370-4928-84f4-2ce165cad95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:11.071949 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-093a52e8-1370-4928-84f4-2ce165cad95e None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:56:11.073165 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-093a52e8-1370-4928-84f4-2ce165cad95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:11.111510 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:11.132848 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1411/2804] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:56:11.140546 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bededd-be67-4a12-85c9-8e501bc2e5bd None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:11.140837 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bededd-be67-4a12-85c9-8e501bc2e5bd None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:11.141121 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bededd-be67-4a12-85c9-8e501bc2e5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:11.160311 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-b8bededd-be67-4a12-85c9-8e501bc2e5bd None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:56:11.161507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-b8bededd-be67-4a12-85c9-8e501bc2e5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:11.169354 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1394/2805] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:56:11.173386 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a52e8-1370-4928-84f4-2ce165cad95e None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:11.182891 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a52e8-1370-4928-84f4-2ce165cad95e None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:11.187423 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7fd35-a5b1-4a6c-8cc5-5fdac0d3a0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:11.188073 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7fd35-a5b1-4a6c-8cc5-5fdac0d3a0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:11.188355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7fd35-a5b1-4a6c-8cc5-5fdac0d3a0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:11.188632 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7fd35-a5b1-4a6c-8cc5-5fdac0d3a0d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:11.189350 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7fd35-a5b1-4a6c-8cc5-5fdac0d3a0d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:56:11.189658 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7fd35-a5b1-4a6c-8cc5-5fdac0d3a0d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:11.191260 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7fd35-a5b1-4a6c-8cc5-5fdac0d3a0d2 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:11.202594 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1412/2806] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:56:11.207187 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bededd-be67-4a12-85c9-8e501bc2e5bd None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:11.216492 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bededd-be67-4a12-85c9-8e501bc2e5bd None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:11.221223 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15eeff-5092-432a-ac7d-ae82e1e053fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:11.221913 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15eeff-5092-432a-ac7d-ae82e1e053fa admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:11.222732 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15eeff-5092-432a-ac7d-ae82e1e053fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:11.223007 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15eeff-5092-432a-ac7d-ae82e1e053fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:11.223739 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15eeff-5092-432a-ac7d-ae82e1e053fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:11.225734 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15eeff-5092-432a-ac7d-ae82e1e053fa admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:11.254278 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1395/2807] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:56:11 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:56:11.255465 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7fd35-a5b1-4a6c-8cc5-5fdac0d3a0d2 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:11.265282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7fd35-a5b1-4a6c-8cc5-5fdac0d3a0d2 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:11.325568 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3c8de-ba76-45bb-bfd3-4ae1e92c96ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:11.326250 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3c8de-ba76-45bb-bfd3-4ae1e92c96ef admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:11.326519 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3c8de-ba76-45bb-bfd3-4ae1e92c96ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:11.326794 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3c8de-ba76-45bb-bfd3-4ae1e92c96ef admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:11.327526 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3c8de-ba76-45bb-bfd3-4ae1e92c96ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:11.329455 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3c8de-ba76-45bb-bfd3-4ae1e92c96ef admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:11.349646 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1413/2808] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:56:11 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:56:11.353855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15eeff-5092-432a-ac7d-ae82e1e053fa admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:11.364191 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15eeff-5092-432a-ac7d-ae82e1e053fa admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:11.368819 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7040d1-2766-48b5-84ec-132a36be4e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:11.369478 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7040d1-2766-48b5-84ec-132a36be4e74 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:11.369817 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7040d1-2766-48b5-84ec-132a36be4e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:11.370099 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7040d1-2766-48b5-84ec-132a36be4e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:11.370826 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7040d1-2766-48b5-84ec-132a36be4e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:11.372642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7040d1-2766-48b5-84ec-132a36be4e74 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:11.385979 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1396/2809] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:56:11.389982 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3c8de-ba76-45bb-bfd3-4ae1e92c96ef admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:11.400527 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3c8de-ba76-45bb-bfd3-4ae1e92c96ef admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:11.405120 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe3dc8-8664-4bbe-b988-f6caadcc91b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:11.405773 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe3dc8-8664-4bbe-b988-f6caadcc91b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:11.406061 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe3dc8-8664-4bbe-b988-f6caadcc91b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:11.406344 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe3dc8-8664-4bbe-b988-f6caadcc91b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:11.407067 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe3dc8-8664-4bbe-b988-f6caadcc91b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:11.408777 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe3dc8-8664-4bbe-b988-f6caadcc91b8 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:11.418535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1414/2810] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:56:11.422533 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7040d1-2766-48b5-84ec-132a36be4e74 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:11.432359 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7040d1-2766-48b5-84ec-132a36be4e74 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:11.436915 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af22d6-8847-4998-9fec-cf28bc59a580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:11.437774 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af22d6-8847-4998-9fec-cf28bc59a580 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:11.438059 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af22d6-8847-4998-9fec-cf28bc59a580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:11.438333 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af22d6-8847-4998-9fec-cf28bc59a580 admin admin] PATH_INFO: `/v3/projects/4edf8093988e412882d9629af2b122ca/users/2da14502c05746558722c3ae407a274f/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:11.455318 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af22d6-8847-4998-9fec-cf28bc59a580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4edf8093988e412882d9629af2b122ca, user_id=2da14502c05746558722c3ae407a274f, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:11.458576 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af22d6-8847-4998-9fec-cf28bc59a580 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:11.467130 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:11.472540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1397/2811] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:56:11 2022] PUT /identity/v3/projects/4edf8093988e412882d9629af2b122ca/users/2da14502c05746558722c3ae407a274f/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:56:11.483616 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1f9b9-ceac-4656-9c66-5387c2e812c8 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:11.483918 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1f9b9-ceac-4656-9c66-5387c2e812c8 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:11.484200 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1f9b9-ceac-4656-9c66-5387c2e812c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:11.511611 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-c3c1f9b9-ceac-4656-9c66-5387c2e812c8 None None] MFA Rules not processed for user `2da14502c05746558722c3ae407a274f`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:56:11.512741 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-c3c1f9b9-ceac-4656-9c66-5387c2e812c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:11.579508 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1415/2812] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:56:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:56:11.591135 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af22d6-8847-4998-9fec-cf28bc59a580 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:11.592891 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-b5af22d6-8847-4998-9fec-cf28bc59a580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:11.649514 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af22d6-8847-4998-9fec-cf28bc59a580 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:11.653182 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921b4b4-bfe7-4ce8-a472-2d48e0d0d505 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:11.653824 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921b4b4-bfe7-4ce8-a472-2d48e0d0d505 service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:11.654106 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921b4b4-bfe7-4ce8-a472-2d48e0d0d505 service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:11.654380 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921b4b4-bfe7-4ce8-a472-2d48e0d0d505 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:11.662563 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921b4b4-bfe7-4ce8-a472-2d48e0d0d505 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:11.664023 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921b4b4-bfe7-4ce8-a472-2d48e0d0d505 service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:11.672586 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1398/2813] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:56:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:56:20.095267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1f9b9-ceac-4656-9c66-5387c2e812c8 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:20.135875 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:20.158086 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1f9b9-ceac-4656-9c66-5387c2e812c8 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:20.163141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7b30c-129d-419a-b411-210db05e5faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:20.164032 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7b30c-129d-419a-b411-210db05e5faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:20.164314 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7b30c-129d-419a-b411-210db05e5faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:20.164590 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7b30c-129d-419a-b411-210db05e5faa admin admin] PATH_INFO: `/v3/users/2da14502c05746558722c3ae407a274f` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:20.165776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7b30c-129d-419a-b411-210db05e5faa admin admin] RBAC: Authorizing `identity:delete_user(user_id=2da14502c05746558722c3ae407a274f)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:20.167735 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7b30c-129d-419a-b411-210db05e5faa admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:20.210282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-31c7b30c-129d-419a-b411-210db05e5faa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2da14502c05746558722c3ae407a274f'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:20.211169 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-31c7b30c-129d-419a-b411-210db05e5faa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2da14502c05746558722c3ae407a274f'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:20.218023 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-31c7b30c-129d-419a-b411-210db05e5faa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2da14502c05746558722c3ae407a274f'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:20.218668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-31c7b30c-129d-419a-b411-210db05e5faa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2da14502c05746558722c3ae407a274f'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:20.231064 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-31c7b30c-129d-419a-b411-210db05e5faa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2da14502c05746558722c3ae407a274f'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:20.242605 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1416/2814] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:56:20 2022] DELETE /identity/v3/users/2da14502c05746558722c3ae407a274f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:56:20.247052 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d52f6e-4ffe-4c59-8b8f-c8bd1d8c191d None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:20.247632 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d52f6e-4ffe-4c59-8b8f-c8bd1d8c191d None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:20.247632 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d52f6e-4ffe-4c59-8b8f-c8bd1d8c191d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:20.264263 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-26d52f6e-4ffe-4c59-8b8f-c8bd1d8c191d None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:56:20.265451 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-26d52f6e-4ffe-4c59-8b8f-c8bd1d8c191d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:20.323587 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1399/2815] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:56:20.333095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7b30c-129d-419a-b411-210db05e5faa admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:20.334525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-31c7b30c-129d-419a-b411-210db05e5faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:20.391245 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7b30c-129d-419a-b411-210db05e5faa admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:20.394892 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfdaba6-cc96-4c7d-8942-fd76c22744f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:20.395559 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdaba6-cc96-4c7d-8942-fd76c22744f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:20.395844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdaba6-cc96-4c7d-8942-fd76c22744f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:20.396123 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdaba6-cc96-4c7d-8942-fd76c22744f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:20.405298 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfdaba6-cc96-4c7d-8942-fd76c22744f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:20.406739 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfdaba6-cc96-4c7d-8942-fd76c22744f0 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:20.416669 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1417/2816] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:56:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:56:20.679810 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d52f6e-4ffe-4c59-8b8f-c8bd1d8c191d None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:20.681248 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-26d52f6e-4ffe-4c59-8b8f-c8bd1d8c191d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:20.694865 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d52f6e-4ffe-4c59-8b8f-c8bd1d8c191d None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:20.699457 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325101f-4f0b-4caa-8801-1f0494c3663f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:20.700472 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325101f-4f0b-4caa-8801-1f0494c3663f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:20.700754 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325101f-4f0b-4caa-8801-1f0494c3663f admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:20.701023 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325101f-4f0b-4caa-8801-1f0494c3663f admin admin] PATH_INFO: `/v3/projects/4edf8093988e412882d9629af2b122ca` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:20.702751 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325101f-4f0b-4caa-8801-1f0494c3663f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4edf8093988e412882d9629af2b122ca)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:20.704850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325101f-4f0b-4caa-8801-1f0494c3663f admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:20.752731 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-d325101f-4f0b-4caa-8801-1f0494c3663f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4edf8093988e412882d9629af2b122ca', 'request_id': 'req-d325101f-4f0b-4caa-8801-1f0494c3663f'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:20.760594 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-d325101f-4f0b-4caa-8801-1f0494c3663f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4edf8093988e412882d9629af2b122ca', 'request_id': 'req-d325101f-4f0b-4caa-8801-1f0494c3663f'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:20.767010 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-d325101f-4f0b-4caa-8801-1f0494c3663f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4edf8093988e412882d9629af2b122ca', 'request_id': 'req-d325101f-4f0b-4caa-8801-1f0494c3663f'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:20.777784 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-d325101f-4f0b-4caa-8801-1f0494c3663f admin admin] The token cache is being invalidate because project 4edf8093988e412882d9629af2b122ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:56:20.778068 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-d325101f-4f0b-4caa-8801-1f0494c3663f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:20.778690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-d325101f-4f0b-4caa-8801-1f0494c3663f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:20.780268 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1400/2817] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:56:20 2022] DELETE /identity/v3/projects/4edf8093988e412882d9629af2b122ca => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:56:20.785742 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c082dd-a743-4b89-9f4b-434f702175c5 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:20.786029 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c082dd-a743-4b89-9f4b-434f702175c5 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:20.786303 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c082dd-a743-4b89-9f4b-434f702175c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:20.805984 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-00c082dd-a743-4b89-9f4b-434f702175c5 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:56:20.807163 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-00c082dd-a743-4b89-9f4b-434f702175c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:20.857719 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:20.870093 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1418/2818] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:56:20.875106 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56d74a-d2c0-4fe6-886b-44b4f43c50c0 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:20.875444 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56d74a-d2c0-4fe6-886b-44b4f43c50c0 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:20.875730 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56d74a-d2c0-4fe6-886b-44b4f43c50c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:20.893477 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-ae56d74a-d2c0-4fe6-886b-44b4f43c50c0 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:56:20.895166 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-ae56d74a-d2c0-4fe6-886b-44b4f43c50c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:20.902889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1401/2819] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:56:20.906918 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c082dd-a743-4b89-9f4b-434f702175c5 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:20.917329 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c082dd-a743-4b89-9f4b-434f702175c5 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:20.921858 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e00d2-e237-42dc-8953-4fbbd7b857f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:20.922534 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e00d2-e237-42dc-8953-4fbbd7b857f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:20.922815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e00d2-e237-42dc-8953-4fbbd7b857f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:20.923090 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e00d2-e237-42dc-8953-4fbbd7b857f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:20.923864 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e00d2-e237-42dc-8953-4fbbd7b857f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:56:20.924176 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e00d2-e237-42dc-8953-4fbbd7b857f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:20.925770 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e00d2-e237-42dc-8953-4fbbd7b857f2 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:20.937172 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1419/2820] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:56:20.941327 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56d74a-d2c0-4fe6-886b-44b4f43c50c0 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:20.950576 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56d74a-d2c0-4fe6-886b-44b4f43c50c0 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:20.955219 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc895cdd-9360-49fe-8e05-b82806846938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:20.955889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc895cdd-9360-49fe-8e05-b82806846938 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:20.956173 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc895cdd-9360-49fe-8e05-b82806846938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:20.956448 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc895cdd-9360-49fe-8e05-b82806846938 admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:20.957693 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc895cdd-9360-49fe-8e05-b82806846938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:20.959609 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc895cdd-9360-49fe-8e05-b82806846938 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:20.978551 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:20.989970 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1402/2821] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:56:20 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:56:20.991088 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e00d2-e237-42dc-8953-4fbbd7b857f2 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:21.001695 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e00d2-e237-42dc-8953-4fbbd7b857f2 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:21.067783 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1179b3d-75a7-4f60-aa93-90fa829e5da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:21.068451 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1179b3d-75a7-4f60-aa93-90fa829e5da1 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:21.068737 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1179b3d-75a7-4f60-aa93-90fa829e5da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:21.069010 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1179b3d-75a7-4f60-aa93-90fa829e5da1 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:21.069695 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1179b3d-75a7-4f60-aa93-90fa829e5da1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:21.071678 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1179b3d-75a7-4f60-aa93-90fa829e5da1 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:21.091951 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1420/2822] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:56:20 2022] POST /identity/v3/users => generated 302 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:56:21.096026 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc895cdd-9360-49fe-8e05-b82806846938 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:21.106955 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc895cdd-9360-49fe-8e05-b82806846938 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:21.111607 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c12d49-be0b-4ae4-ae65-5ddedbb2224d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:21.112197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c12d49-be0b-4ae4-ae65-5ddedbb2224d admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:21.112477 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c12d49-be0b-4ae4-ae65-5ddedbb2224d admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:21.112747 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c12d49-be0b-4ae4-ae65-5ddedbb2224d admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:21.113488 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c12d49-be0b-4ae4-ae65-5ddedbb2224d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:21.115059 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c12d49-be0b-4ae4-ae65-5ddedbb2224d admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:21.125197 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1403/2823] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:56:21.129429 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1179b3d-75a7-4f60-aa93-90fa829e5da1 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:21.139166 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1179b3d-75a7-4f60-aa93-90fa829e5da1 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:21.143707 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c192405-63d7-4036-a824-76bf2d7e8006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:21.144950 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c192405-63d7-4036-a824-76bf2d7e8006 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:21.145230 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c192405-63d7-4036-a824-76bf2d7e8006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:21.145501 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c192405-63d7-4036-a824-76bf2d7e8006 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:21.146209 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c192405-63d7-4036-a824-76bf2d7e8006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:21.147935 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c192405-63d7-4036-a824-76bf2d7e8006 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:21.157625 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1421/2824] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:56:21.161627 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c12d49-be0b-4ae4-ae65-5ddedbb2224d admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:21.171454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c12d49-be0b-4ae4-ae65-5ddedbb2224d admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:21.175987 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf50132-5f69-406d-9bc8-15ea18623f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:21.176853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf50132-5f69-406d-9bc8-15ea18623f6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:21.177138 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf50132-5f69-406d-9bc8-15ea18623f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:21.177413 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf50132-5f69-406d-9bc8-15ea18623f6e admin admin] PATH_INFO: `/v3/projects/e8d88dbff34c4822921746157296968a/users/23ddefe4e9764b0c990c9aa211de0dcf/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:21.192148 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf50132-5f69-406d-9bc8-15ea18623f6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8d88dbff34c4822921746157296968a, user_id=23ddefe4e9764b0c990c9aa211de0dcf, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:21.194794 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf50132-5f69-406d-9bc8-15ea18623f6e admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:21.208166 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1404/2825] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:56:21 2022] PUT /identity/v3/projects/e8d88dbff34c4822921746157296968a/users/23ddefe4e9764b0c990c9aa211de0dcf/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:56:21.218742 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069a2dd-b0f7-495f-beff-b2d2b6a91835 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:21.219039 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069a2dd-b0f7-495f-beff-b2d2b6a91835 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:21.219394 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069a2dd-b0f7-495f-beff-b2d2b6a91835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:21.246583 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-9069a2dd-b0f7-495f-beff-b2d2b6a91835 None None] MFA Rules not processed for user `23ddefe4e9764b0c990c9aa211de0dcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:56:21.247835 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-9069a2dd-b0f7-495f-beff-b2d2b6a91835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:21.313012 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1422/2826] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:56:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:56:21.320109 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf50132-5f69-406d-9bc8-15ea18623f6e admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:21.382399 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf50132-5f69-406d-9bc8-15ea18623f6e admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:21.386927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e9e34-e552-44ac-9293-b1c28075c7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:21.387608 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e9e34-e552-44ac-9293-b1c28075c7af admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:21.387892 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e9e34-e552-44ac-9293-b1c28075c7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:21.388175 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e9e34-e552-44ac-9293-b1c28075c7af admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:21.388850 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e9e34-e552-44ac-9293-b1c28075c7af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:21.390738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e9e34-e552-44ac-9293-b1c28075c7af admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:21.415780 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1405/2827] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:56:21 2022] POST /identity/v3/projects => generated 405 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:56:21.419911 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069a2dd-b0f7-495f-beff-b2d2b6a91835 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:21.431107 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069a2dd-b0f7-495f-beff-b2d2b6a91835 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:21.481144 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:21.489458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23855835-89b4-4cb5-965f-f4acd0df6f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:21.490312 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23855835-89b4-4cb5-965f-f4acd0df6f71 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:21.490596 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23855835-89b4-4cb5-965f-f4acd0df6f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:21.490877 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23855835-89b4-4cb5-965f-f4acd0df6f71 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:21.491614 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23855835-89b4-4cb5-965f-f4acd0df6f71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:21.493531 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23855835-89b4-4cb5-965f-f4acd0df6f71 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:21.512749 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1423/2828] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:56:21 2022] POST /identity/v3/users => generated 309 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:56:21.516884 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e9e34-e552-44ac-9293-b1c28075c7af admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:21.527666 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e9e34-e552-44ac-9293-b1c28075c7af admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:21.533614 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fb69d-e806-43d2-9816-e8be876716ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:21.534488 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fb69d-e806-43d2-9816-e8be876716ad admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:21.535463 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fb69d-e806-43d2-9816-e8be876716ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:21.535848 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fb69d-e806-43d2-9816-e8be876716ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:21.536663 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fb69d-e806-43d2-9816-e8be876716ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:21.538386 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fb69d-e806-43d2-9816-e8be876716ad admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:21.549437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1406/2829] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:56:21.553421 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23855835-89b4-4cb5-965f-f4acd0df6f71 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:21.563320 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23855835-89b4-4cb5-965f-f4acd0df6f71 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:21.567942 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f149105-1f70-4c39-9e0e-acfeabe828ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:21.568810 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f149105-1f70-4c39-9e0e-acfeabe828ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:21.569094 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f149105-1f70-4c39-9e0e-acfeabe828ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:21.569364 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f149105-1f70-4c39-9e0e-acfeabe828ad admin admin] PATH_INFO: `/v3/projects/569f5a5f937b40c1b2c0e348bce1da61/users/a8ebc2a075654d6b839a2f12ffa84701/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:21.584293 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f149105-1f70-4c39-9e0e-acfeabe828ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=569f5a5f937b40c1b2c0e348bce1da61, user_id=a8ebc2a075654d6b839a2f12ffa84701, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:21.587325 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f149105-1f70-4c39-9e0e-acfeabe828ad admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:21.600785 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1424/2830] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:56:21 2022] PUT /identity/v3/projects/569f5a5f937b40c1b2c0e348bce1da61/users/a8ebc2a075654d6b839a2f12ffa84701/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:56:21.604724 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fb69d-e806-43d2-9816-e8be876716ad admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:21.614608 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fb69d-e806-43d2-9816-e8be876716ad admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:21.670466 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775baad9-e1bc-412b-961c-6ef6f5f687a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:21.671067 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775baad9-e1bc-412b-961c-6ef6f5f687a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:21.671391 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775baad9-e1bc-412b-961c-6ef6f5f687a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:21.671673 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775baad9-e1bc-412b-961c-6ef6f5f687a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:21.672384 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775baad9-e1bc-412b-961c-6ef6f5f687a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:21.673994 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775baad9-e1bc-412b-961c-6ef6f5f687a8 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:21.683738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1407/2831] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:56:21.687913 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f149105-1f70-4c39-9e0e-acfeabe828ad admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:21.698010 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f149105-1f70-4c39-9e0e-acfeabe828ad admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:21.702630 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504967e8-9009-4937-a780-a8a46a2ef1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:21.703544 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504967e8-9009-4937-a780-a8a46a2ef1ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:21.703829 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504967e8-9009-4937-a780-a8a46a2ef1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:21.704110 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504967e8-9009-4937-a780-a8a46a2ef1ec admin admin] PATH_INFO: `/v3/projects/569f5a5f937b40c1b2c0e348bce1da61/users/a8ebc2a075654d6b839a2f12ffa84701/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:21.706108 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504967e8-9009-4937-a780-a8a46a2ef1ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=569f5a5f937b40c1b2c0e348bce1da61, user_id=a8ebc2a075654d6b839a2f12ffa84701, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:21.709324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504967e8-9009-4937-a780-a8a46a2ef1ec admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:21.720366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1425/2832] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:56:21 2022] PUT /identity/v3/projects/569f5a5f937b40c1b2c0e348bce1da61/users/a8ebc2a075654d6b839a2f12ffa84701/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:56:21.732661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ffed7-4140-4bfc-95d1-378d7e9a443c None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:21.733101 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ffed7-4140-4bfc-95d1-378d7e9a443c None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:21.733386 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ffed7-4140-4bfc-95d1-378d7e9a443c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:21.759304 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-3f8ffed7-4140-4bfc-95d1-378d7e9a443c None None] MFA Rules not processed for user `a8ebc2a075654d6b839a2f12ffa84701`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:56:21.760496 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-3f8ffed7-4140-4bfc-95d1-378d7e9a443c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:21.780782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:21.828723 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1408/2833] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:56:21 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:56:21.840249 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504967e8-9009-4937-a780-a8a46a2ef1ec admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:21.842058 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-504967e8-9009-4937-a780-a8a46a2ef1ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:21.898911 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504967e8-9009-4937-a780-a8a46a2ef1ec admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:21.902687 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398d2cd-7904-467f-9ab8-d3a2c3e50a19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:21.903347 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398d2cd-7904-467f-9ab8-d3a2c3e50a19 service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:21.903630 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398d2cd-7904-467f-9ab8-d3a2c3e50a19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:21.903902 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398d2cd-7904-467f-9ab8-d3a2c3e50a19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:21.913237 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398d2cd-7904-467f-9ab8-d3a2c3e50a19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:21.914658 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398d2cd-7904-467f-9ab8-d3a2c3e50a19 service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:21.924670 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1426/2834] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:56:21 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:56:22.062437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ffed7-4140-4bfc-95d1-378d7e9a443c None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:22.125540 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ffed7-4140-4bfc-95d1-378d7e9a443c None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:22.130682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d2826-d5ab-4d44-877d-b954e8f994fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:22.131614 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d2826-d5ab-4d44-877d-b954e8f994fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:22.131891 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d2826-d5ab-4d44-877d-b954e8f994fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:22.132160 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d2826-d5ab-4d44-877d-b954e8f994fb admin admin] PATH_INFO: `/v3/users/23ddefe4e9764b0c990c9aa211de0dcf` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:22.133327 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d2826-d5ab-4d44-877d-b954e8f994fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=23ddefe4e9764b0c990c9aa211de0dcf)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:22.135234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d2826-d5ab-4d44-877d-b954e8f994fb admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:22.179645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-3f8d2826-d5ab-4d44-877d-b954e8f994fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23ddefe4e9764b0c990c9aa211de0dcf'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:22.186244 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-3f8d2826-d5ab-4d44-877d-b954e8f994fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23ddefe4e9764b0c990c9aa211de0dcf'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:22.186885 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-3f8d2826-d5ab-4d44-877d-b954e8f994fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23ddefe4e9764b0c990c9aa211de0dcf'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:22.198782 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-3f8d2826-d5ab-4d44-877d-b954e8f994fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23ddefe4e9764b0c990c9aa211de0dcf'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:22.205160 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-3f8d2826-d5ab-4d44-877d-b954e8f994fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23ddefe4e9764b0c990c9aa211de0dcf'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:22.211752 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1409/2835] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:56:22 2022] DELETE /identity/v3/users/23ddefe4e9764b0c990c9aa211de0dcf => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:56:22.216251 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b7fbf-864e-4089-b2c0-f1cb62698fbb None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:22.216732 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b7fbf-864e-4089-b2c0-f1cb62698fbb None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:22.216837 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b7fbf-864e-4089-b2c0-f1cb62698fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:22.234285 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-3a7b7fbf-864e-4089-b2c0-f1cb62698fbb None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:56:22.235545 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-3a7b7fbf-864e-4089-b2c0-f1cb62698fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:22.292571 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1427/2836] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:56:22.302589 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d2826-d5ab-4d44-877d-b954e8f994fb admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:22.304021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-3f8d2826-d5ab-4d44-877d-b954e8f994fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:22.348658 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:22.365577 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d2826-d5ab-4d44-877d-b954e8f994fb admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:22.369203 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ad336-b412-4c2c-bf2c-d9b833cab787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:22.369845 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ad336-b412-4c2c-bf2c-d9b833cab787 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:22.370128 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ad336-b412-4c2c-bf2c-d9b833cab787 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:22.370400 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ad336-b412-4c2c-bf2c-d9b833cab787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:22.380011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ad336-b412-4c2c-bf2c-d9b833cab787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:22.381422 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ad336-b412-4c2c-bf2c-d9b833cab787 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:22.390666 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1410/2837] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:56:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:56:22.648017 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b7fbf-864e-4089-b2c0-f1cb62698fbb None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:22.649661 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-3a7b7fbf-864e-4089-b2c0-f1cb62698fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:22.668199 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b7fbf-864e-4089-b2c0-f1cb62698fbb None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:22.676187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784da706-4c30-4c27-ba39-dc11dbcc110e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:22.676187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784da706-4c30-4c27-ba39-dc11dbcc110e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:22.676187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784da706-4c30-4c27-ba39-dc11dbcc110e admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:22.676187 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784da706-4c30-4c27-ba39-dc11dbcc110e admin admin] PATH_INFO: `/v3/projects/e8d88dbff34c4822921746157296968a` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:22.677497 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784da706-4c30-4c27-ba39-dc11dbcc110e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8d88dbff34c4822921746157296968a)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:22.679682 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784da706-4c30-4c27-ba39-dc11dbcc110e admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:22.725851 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:22.729675 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-784da706-4c30-4c27-ba39-dc11dbcc110e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8d88dbff34c4822921746157296968a', 'request_id': 'req-784da706-4c30-4c27-ba39-dc11dbcc110e'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:22.739363 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-784da706-4c30-4c27-ba39-dc11dbcc110e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8d88dbff34c4822921746157296968a', 'request_id': 'req-784da706-4c30-4c27-ba39-dc11dbcc110e'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:22.745536 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-784da706-4c30-4c27-ba39-dc11dbcc110e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8d88dbff34c4822921746157296968a', 'request_id': 'req-784da706-4c30-4c27-ba39-dc11dbcc110e'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:22.756535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-784da706-4c30-4c27-ba39-dc11dbcc110e admin admin] The token cache is being invalidate because project e8d88dbff34c4822921746157296968a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:56:22.756822 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-784da706-4c30-4c27-ba39-dc11dbcc110e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:22.757445 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-784da706-4c30-4c27-ba39-dc11dbcc110e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:22.758969 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1428/2838] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:56:22 2022] DELETE /identity/v3/projects/e8d88dbff34c4822921746157296968a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:56:22.762919 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ad336-b412-4c2c-bf2c-d9b833cab787 service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:22.772670 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ad336-b412-4c2c-bf2c-d9b833cab787 service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:22.828714 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d87231-4339-48e5-89ad-58fa341f98d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:22.829589 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d87231-4339-48e5-89ad-58fa341f98d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:22.829876 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d87231-4339-48e5-89ad-58fa341f98d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:22.830152 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d87231-4339-48e5-89ad-58fa341f98d2 admin admin] PATH_INFO: `/v3/users/a8ebc2a075654d6b839a2f12ffa84701` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:22.831394 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d87231-4339-48e5-89ad-58fa341f98d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8ebc2a075654d6b839a2f12ffa84701)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:22.833350 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d87231-4339-48e5-89ad-58fa341f98d2 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:22.878366 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-28d87231-4339-48e5-89ad-58fa341f98d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8ebc2a075654d6b839a2f12ffa84701'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:22.885434 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-28d87231-4339-48e5-89ad-58fa341f98d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8ebc2a075654d6b839a2f12ffa84701'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:22.886077 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-28d87231-4339-48e5-89ad-58fa341f98d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8ebc2a075654d6b839a2f12ffa84701'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:22.897970 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-28d87231-4339-48e5-89ad-58fa341f98d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8ebc2a075654d6b839a2f12ffa84701'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:22.905244 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-28d87231-4339-48e5-89ad-58fa341f98d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8ebc2a075654d6b839a2f12ffa84701'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:22.912399 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1411/2839] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:56:22 2022] DELETE /identity/v3/users/a8ebc2a075654d6b839a2f12ffa84701 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:56:23.180132 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784da706-4c30-4c27-ba39-dc11dbcc110e admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:23.181587 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-784da706-4c30-4c27-ba39-dc11dbcc110e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:23.196079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784da706-4c30-4c27-ba39-dc11dbcc110e admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:23.253918 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafbfe0-2f2c-462f-b53b-b3306a3ae723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:23.254776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafbfe0-2f2c-462f-b53b-b3306a3ae723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:23.255057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafbfe0-2f2c-462f-b53b-b3306a3ae723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:23.255429 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafbfe0-2f2c-462f-b53b-b3306a3ae723 admin admin] PATH_INFO: `/v3/projects/569f5a5f937b40c1b2c0e348bce1da61` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:23.256659 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfafbfe0-2f2c-462f-b53b-b3306a3ae723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=569f5a5f937b40c1b2c0e348bce1da61)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:23.258526 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfafbfe0-2f2c-462f-b53b-b3306a3ae723 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:23.306416 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-dfafbfe0-2f2c-462f-b53b-b3306a3ae723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '569f5a5f937b40c1b2c0e348bce1da61', 'request_id': 'req-dfafbfe0-2f2c-462f-b53b-b3306a3ae723'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:23.313525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-dfafbfe0-2f2c-462f-b53b-b3306a3ae723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '569f5a5f937b40c1b2c0e348bce1da61', 'request_id': 'req-dfafbfe0-2f2c-462f-b53b-b3306a3ae723'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:23.320026 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-dfafbfe0-2f2c-462f-b53b-b3306a3ae723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '569f5a5f937b40c1b2c0e348bce1da61', 'request_id': 'req-dfafbfe0-2f2c-462f-b53b-b3306a3ae723'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:23.333088 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-dfafbfe0-2f2c-462f-b53b-b3306a3ae723 admin admin] The token cache is being invalidate because project 569f5a5f937b40c1b2c0e348bce1da61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:56:23.333342 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-dfafbfe0-2f2c-462f-b53b-b3306a3ae723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:23.334064 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-dfafbfe0-2f2c-462f-b53b-b3306a3ae723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:56:23.335634 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1429/2840] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:56:23 2022] DELETE /identity/v3/projects/569f5a5f937b40c1b2c0e348bce1da61 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:56:23.340832 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad80a6-3ecd-4546-b289-929a2366f9db None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:23.341121 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad80a6-3ecd-4546-b289-929a2366f9db None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:23.341396 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad80a6-3ecd-4546-b289-929a2366f9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:23.359462 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-1aad80a6-3ecd-4546-b289-929a2366f9db None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:56:23.360649 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-1aad80a6-3ecd-4546-b289-929a2366f9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:23.410936 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:23.420171 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1412/2841] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:56:23.427838 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df26c0-5144-4498-bf73-c4922bcc0011 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:23.428129 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df26c0-5144-4498-bf73-c4922bcc0011 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:23.428409 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df26c0-5144-4498-bf73-c4922bcc0011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:23.446549 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-95df26c0-5144-4498-bf73-c4922bcc0011 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:56:23.447756 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-95df26c0-5144-4498-bf73-c4922bcc0011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:23.455392 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1430/2842] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:56:23.460015 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad80a6-3ecd-4546-b289-929a2366f9db None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:23.469927 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad80a6-3ecd-4546-b289-929a2366f9db None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:23.474451 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64743f8b-fe0a-4cd9-b73e-e033c06ca551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:23.475098 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64743f8b-fe0a-4cd9-b73e-e033c06ca551 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:23.475420 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64743f8b-fe0a-4cd9-b73e-e033c06ca551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:23.475695 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64743f8b-fe0a-4cd9-b73e-e033c06ca551 admin admin] PATH_INFO: `/v3/domains` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:23.476409 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64743f8b-fe0a-4cd9-b73e-e033c06ca551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:56:23.476716 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64743f8b-fe0a-4cd9-b73e-e033c06ca551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:23.478322 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64743f8b-fe0a-4cd9-b73e-e033c06ca551 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:23.489975 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1413/2843] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:56:23.493984 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df26c0-5144-4498-bf73-c4922bcc0011 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:23.503025 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df26c0-5144-4498-bf73-c4922bcc0011 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:23.508177 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70408dcf-6b44-4540-85f8-4f1835194ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:23.508759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70408dcf-6b44-4540-85f8-4f1835194ceb admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:23.509035 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70408dcf-6b44-4540-85f8-4f1835194ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:23.509304 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70408dcf-6b44-4540-85f8-4f1835194ceb admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:23.509987 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70408dcf-6b44-4540-85f8-4f1835194ceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:23.511918 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70408dcf-6b44-4540-85f8-4f1835194ceb admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:23.536572 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1431/2844] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:56:23 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:56:23.540660 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64743f8b-fe0a-4cd9-b73e-e033c06ca551 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:23.550478 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64743f8b-fe0a-4cd9-b73e-e033c06ca551 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:23.605682 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd333ad5-04af-40af-abc3-44654029f86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:23.606336 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd333ad5-04af-40af-abc3-44654029f86a admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:23.606604 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd333ad5-04af-40af-abc3-44654029f86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:23.606881 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd333ad5-04af-40af-abc3-44654029f86a admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:23.607665 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd333ad5-04af-40af-abc3-44654029f86a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:23.609560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd333ad5-04af-40af-abc3-44654029f86a admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:23.629288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1414/2845] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:56:23 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:56:23.634038 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70408dcf-6b44-4540-85f8-4f1835194ceb admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:23.644084 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70408dcf-6b44-4540-85f8-4f1835194ceb admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:23.649089 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0a830-bfe0-4a12-b745-1214a0df8ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:23.649735 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0a830-bfe0-4a12-b745-1214a0df8ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:23.650014 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0a830-bfe0-4a12-b745-1214a0df8ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:23.650287 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0a830-bfe0-4a12-b745-1214a0df8ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:23.650995 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0a830-bfe0-4a12-b745-1214a0df8ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:23.652622 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0a830-bfe0-4a12-b745-1214a0df8ae6 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:23.662668 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1432/2846] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:56:23.666428 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd333ad5-04af-40af-abc3-44654029f86a admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:23.676181 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd333ad5-04af-40af-abc3-44654029f86a admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:23.680753 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca414a1a-f1cc-4ab3-9543-51ffb7cc5f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:23.681396 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca414a1a-f1cc-4ab3-9543-51ffb7cc5f42 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:23.681680 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca414a1a-f1cc-4ab3-9543-51ffb7cc5f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:23.681957 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca414a1a-f1cc-4ab3-9543-51ffb7cc5f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:23.682672 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca414a1a-f1cc-4ab3-9543-51ffb7cc5f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:23.684279 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca414a1a-f1cc-4ab3-9543-51ffb7cc5f42 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:23.694542 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1415/2847] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:56:23.698899 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0a830-bfe0-4a12-b745-1214a0df8ae6 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:23.711419 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0a830-bfe0-4a12-b745-1214a0df8ae6 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:23.716068 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60df578-b97d-455a-8e97-db9a6ee57e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:23.716943 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60df578-b97d-455a-8e97-db9a6ee57e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:23.717222 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60df578-b97d-455a-8e97-db9a6ee57e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:23.717496 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60df578-b97d-455a-8e97-db9a6ee57e90 admin admin] PATH_INFO: `/v3/projects/83cfe2d096b44398a3bbfad8112fc91b/users/dc41fd5d88a04bcf8a2e82666b71d5cf/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:23.732137 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60df578-b97d-455a-8e97-db9a6ee57e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83cfe2d096b44398a3bbfad8112fc91b, user_id=dc41fd5d88a04bcf8a2e82666b71d5cf, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:23.734788 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60df578-b97d-455a-8e97-db9a6ee57e90 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:23.743692 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:23.748745 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1433/2848] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:56:23 2022] PUT /identity/v3/projects/83cfe2d096b44398a3bbfad8112fc91b/users/dc41fd5d88a04bcf8a2e82666b71d5cf/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:56:23.760401 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d393d06-50c4-48b7-8db8-a6ca1c0ed830 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:23.760628 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d393d06-50c4-48b7-8db8-a6ca1c0ed830 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:23.760908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d393d06-50c4-48b7-8db8-a6ca1c0ed830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:23.786910 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-3d393d06-50c4-48b7-8db8-a6ca1c0ed830 None None] MFA Rules not processed for user `dc41fd5d88a04bcf8a2e82666b71d5cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:56:23.788159 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-3d393d06-50c4-48b7-8db8-a6ca1c0ed830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:23.852577 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1416/2849] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:56:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:56:23.857192 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60df578-b97d-455a-8e97-db9a6ee57e90 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:23.917317 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60df578-b97d-455a-8e97-db9a6ee57e90 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:23.921963 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644c397-4b8a-4160-a925-fda8efcba090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:23.922610 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644c397-4b8a-4160-a925-fda8efcba090 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:23.922892 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644c397-4b8a-4160-a925-fda8efcba090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:23.923166 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644c397-4b8a-4160-a925-fda8efcba090 admin admin] PATH_INFO: `/v3/projects` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:23.923876 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644c397-4b8a-4160-a925-fda8efcba090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:23.926356 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644c397-4b8a-4160-a925-fda8efcba090 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:23.951475 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1434/2850] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:56:23 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:56:23.955714 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d393d06-50c4-48b7-8db8-a6ca1c0ed830 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:23.966570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d393d06-50c4-48b7-8db8-a6ca1c0ed830 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:24.015231 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:24.022488 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b32de-5102-48a1-856e-c03628be0ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:24.023192 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b32de-5102-48a1-856e-c03628be0ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:24.023544 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b32de-5102-48a1-856e-c03628be0ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:24.023855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b32de-5102-48a1-856e-c03628be0ee3 admin admin] PATH_INFO: `/v3/users` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:24.024552 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b32de-5102-48a1-856e-c03628be0ee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:24.026571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b32de-5102-48a1-856e-c03628be0ee3 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:24.045908 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1417/2851] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:56:23 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:56:24.049914 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644c397-4b8a-4160-a925-fda8efcba090 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:24.060905 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644c397-4b8a-4160-a925-fda8efcba090 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:24.065614 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65847bf-77d8-4680-ab17-3a34f2d8dfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:24.066835 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65847bf-77d8-4680-ab17-3a34f2d8dfcd admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:24.067123 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65847bf-77d8-4680-ab17-3a34f2d8dfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:24.067446 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65847bf-77d8-4680-ab17-3a34f2d8dfcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:24.068197 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65847bf-77d8-4680-ab17-3a34f2d8dfcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:24.069809 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65847bf-77d8-4680-ab17-3a34f2d8dfcd admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:24.081360 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1435/2852] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 09:56:24.085618 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b32de-5102-48a1-856e-c03628be0ee3 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:24.095753 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b32de-5102-48a1-856e-c03628be0ee3 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:24.100418 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891db83-4705-4bf9-9f91-623c584df06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:24.101288 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891db83-4705-4bf9-9f91-623c584df06b admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:24.101574 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891db83-4705-4bf9-9f91-623c584df06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:24.101853 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891db83-4705-4bf9-9f91-623c584df06b admin admin] PATH_INFO: `/v3/projects/51c72533e9ac4b01beb88c89bfa2418e/users/e341aadf1b1d48a18b953286f8cf6d48/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:24.116895 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891db83-4705-4bf9-9f91-623c584df06b admin admin] RBAC: Authorizing `identity:create_grant(project_id=51c72533e9ac4b01beb88c89bfa2418e, user_id=e341aadf1b1d48a18b953286f8cf6d48, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:24.119583 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891db83-4705-4bf9-9f91-623c584df06b admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:24.133024 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1418/2853] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:56:24 2022] PUT /identity/v3/projects/51c72533e9ac4b01beb88c89bfa2418e/users/e341aadf1b1d48a18b953286f8cf6d48/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:56:24.137041 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65847bf-77d8-4680-ab17-3a34f2d8dfcd admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:24.146779 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65847bf-77d8-4680-ab17-3a34f2d8dfcd admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:24.201623 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8109e6-80ee-49d0-b7f4-3ab853eb0f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:24.202283 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8109e6-80ee-49d0-b7f4-3ab853eb0f51 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:24.202567 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8109e6-80ee-49d0-b7f4-3ab853eb0f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:24.202846 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8109e6-80ee-49d0-b7f4-3ab853eb0f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:24.203588 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8109e6-80ee-49d0-b7f4-3ab853eb0f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:24.205196 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8109e6-80ee-49d0-b7f4-3ab853eb0f51 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:24.214863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1436/2854] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:56:24.218864 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891db83-4705-4bf9-9f91-623c584df06b admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:24.229580 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891db83-4705-4bf9-9f91-623c584df06b admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:24.234055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e088a-4fce-4218-8379-771cc8b47309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:24.234917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e088a-4fce-4218-8379-771cc8b47309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:24.235198 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e088a-4fce-4218-8379-771cc8b47309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:24.235518 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e088a-4fce-4218-8379-771cc8b47309 admin admin] PATH_INFO: `/v3/projects/51c72533e9ac4b01beb88c89bfa2418e/users/e341aadf1b1d48a18b953286f8cf6d48/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:24.237437 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e088a-4fce-4218-8379-771cc8b47309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51c72533e9ac4b01beb88c89bfa2418e, user_id=e341aadf1b1d48a18b953286f8cf6d48, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:24.240733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e088a-4fce-4218-8379-771cc8b47309 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:24.250831 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1419/2855] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:56:24 2022] PUT /identity/v3/projects/51c72533e9ac4b01beb88c89bfa2418e/users/e341aadf1b1d48a18b953286f8cf6d48/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:56:24.261932 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de18618-2465-4073-806b-d163840f4573 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:24.262430 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de18618-2465-4073-806b-d163840f4573 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:24.262544 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de18618-2465-4073-806b-d163840f4573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:24.288424 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-6de18618-2465-4073-806b-d163840f4573 None None] MFA Rules not processed for user `e341aadf1b1d48a18b953286f8cf6d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:56:24.289618 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-6de18618-2465-4073-806b-d163840f4573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:24.354131 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:24.364754 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1437/2856] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:56:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:56:24.376072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e088a-4fce-4218-8379-771cc8b47309 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:24.377841 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e52e088a-4fce-4218-8379-771cc8b47309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:24.416723 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de18618-2465-4073-806b-d163840f4573 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:24.418157 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-6de18618-2465-4073-806b-d163840f4573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:24.436638 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e088a-4fce-4218-8379-771cc8b47309 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:24.440347 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcdf4f-3d39-467f-aca6-43731ce9b243 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:24.441047 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcdf4f-3d39-467f-aca6-43731ce9b243 service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:24.441333 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcdf4f-3d39-467f-aca6-43731ce9b243 service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:24.441617 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcdf4f-3d39-467f-aca6-43731ce9b243 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:24.450729 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcdf4f-3d39-467f-aca6-43731ce9b243 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:24.452184 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcdf4f-3d39-467f-aca6-43731ce9b243 service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:24.461848 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1420/2857] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:56:24 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:56:24.477907 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de18618-2465-4073-806b-d163840f4573 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:24.481647 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542da898-1ad8-44d0-ac12-068b077cf50f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:24.482295 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542da898-1ad8-44d0-ac12-068b077cf50f service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:24.482582 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542da898-1ad8-44d0-ac12-068b077cf50f service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:24.482855 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542da898-1ad8-44d0-ac12-068b077cf50f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:24.484673 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-542da898-1ad8-44d0-ac12-068b077cf50f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:24.536739 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcdf4f-3d39-467f-aca6-43731ce9b243 service cinder] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:24.545521 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcdf4f-3d39-467f-aca6-43731ce9b243 service cinder] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:24.545860 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542da898-1ad8-44d0-ac12-068b077cf50f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:24.547411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542da898-1ad8-44d0-ac12-068b077cf50f service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:24.549354 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f411de7-2a3d-4fb9-bf02-83fe4522bef7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:24.550055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411de7-2a3d-4fb9-bf02-83fe4522bef7 service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:24.550435 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411de7-2a3d-4fb9-bf02-83fe4522bef7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:24.550776 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411de7-2a3d-4fb9-bf02-83fe4522bef7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:24.556464 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1438/2858] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:56:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:56:24.615234 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f411de7-2a3d-4fb9-bf02-83fe4522bef7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:24.616816 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f411de7-2a3d-4fb9-bf02-83fe4522bef7 service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:24.626374 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1421/2859] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:56:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 09:56:34.552327 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=50 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:34.621737 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=73,keystone:INSERT=5 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:39.758044 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b8cb9-bca3-45db-b713-43ba284adb16 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:39.758644 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b8cb9-bca3-45db-b713-43ba284adb16 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:39.758644 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b8cb9-bca3-45db-b713-43ba284adb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:39.775988 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-de9b8cb9-bca3-45db-b713-43ba284adb16 None None] MFA Rules not processed for user `f1fa5f1765ed4995b31a1600ce3edb07`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:56:39.777208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-de9b8cb9-bca3-45db-b713-43ba284adb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:39.784102 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1439/2860] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:56:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:56:40.560516 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f411de7-2a3d-4fb9-bf02-83fe4522bef7 service cinder] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:40.562025 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-4f411de7-2a3d-4fb9-bf02-83fe4522bef7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:40.640607 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f411de7-2a3d-4fb9-bf02-83fe4522bef7 service cinder] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:40.646237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50af3cb-c0ca-4e02-b7e0-cffad585af6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746fd8ed517446fe89c53df873abb2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:40.646945 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50af3cb-c0ca-4e02-b7e0-cffad585af6d service placement] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:40.647441 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50af3cb-c0ca-4e02-b7e0-cffad585af6d service placement] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:40.647804 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50af3cb-c0ca-4e02-b7e0-cffad585af6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:40.649600 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-d50af3cb-c0ca-4e02-b7e0-cffad585af6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:40.661106 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50af3cb-c0ca-4e02-b7e0-cffad585af6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:40.662697 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50af3cb-c0ca-4e02-b7e0-cffad585af6d service placement] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:40.672619 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1422/2861] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:56:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:56:49.770876 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=3 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:50.668337 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=32 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:59.668443 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b8cb9-bca3-45db-b713-43ba284adb16 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:56:59.670470 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-de9b8cb9-bca3-45db-b713-43ba284adb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:59.748720 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b8cb9-bca3-45db-b713-43ba284adb16 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:56:59.754038 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3f3e1-cb14-4793-b856-00a8d7e4fc27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:56:59.754683 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3f3e1-cb14-4793-b856-00a8d7e4fc27 service nova] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:56:59.754962 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3f3e1-cb14-4793-b856-00a8d7e4fc27 service nova] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:56:59.755258 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3f3e1-cb14-4793-b856-00a8d7e4fc27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:56:59.757018 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-59c3f3e1-cb14-4793-b856-00a8d7e4fc27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:56:59.768793 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3f3e1-cb14-4793-b856-00a8d7e4fc27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:56:59.770366 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3f3e1-cb14-4793-b856-00a8d7e4fc27 service nova] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:56:59.780974 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1440/2862] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:56:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:57:06.423269 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50af3cb-c0ca-4e02-b7e0-cffad585af6d service placement] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:06.424723 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-d50af3cb-c0ca-4e02-b7e0-cffad585af6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:57:06.481166 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50af3cb-c0ca-4e02-b7e0-cffad585af6d service placement] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:06.484753 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae87bbf-7836-49fe-9c75-1084767dee7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:06.485394 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae87bbf-7836-49fe-9c75-1084767dee7f service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:06.485677 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae87bbf-7836-49fe-9c75-1084767dee7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:06.485956 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae87bbf-7836-49fe-9c75-1084767dee7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:06.487744 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-0ae87bbf-7836-49fe-9c75-1084767dee7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:57:06.549570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae87bbf-7836-49fe-9c75-1084767dee7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:06.550995 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae87bbf-7836-49fe-9c75-1084767dee7f service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:06.561412 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1423/2863] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:57:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:57:09.776526 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=34 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:57:16.556887 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=50 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:57:19.471574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3f3e1-cb14-4793-b856-00a8d7e4fc27 service nova] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:19.536540 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3f3e1-cb14-4793-b856-00a8d7e4fc27 service nova] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:19.541019 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acd78f-f813-495b-aed3-eda85aafff0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:19.541891 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd78f-f813-495b-aed3-eda85aafff0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:19.542174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd78f-f813-495b-aed3-eda85aafff0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:19.542452 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd78f-f813-495b-aed3-eda85aafff0b admin admin] PATH_INFO: `/v3/users/dc41fd5d88a04bcf8a2e82666b71d5cf` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:19.543654 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acd78f-f813-495b-aed3-eda85aafff0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc41fd5d88a04bcf8a2e82666b71d5cf)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:19.545579 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acd78f-f813-495b-aed3-eda85aafff0b admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:19.590554 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-d2acd78f-f813-495b-aed3-eda85aafff0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc41fd5d88a04bcf8a2e82666b71d5cf'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:19.591190 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-d2acd78f-f813-495b-aed3-eda85aafff0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc41fd5d88a04bcf8a2e82666b71d5cf'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:19.597995 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-d2acd78f-f813-495b-aed3-eda85aafff0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc41fd5d88a04bcf8a2e82666b71d5cf'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:19.598606 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-d2acd78f-f813-495b-aed3-eda85aafff0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc41fd5d88a04bcf8a2e82666b71d5cf'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:19.610565 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-d2acd78f-f813-495b-aed3-eda85aafff0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc41fd5d88a04bcf8a2e82666b71d5cf'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:19.624244 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1441/2864] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:57:19 2022] DELETE /identity/v3/users/dc41fd5d88a04bcf8a2e82666b71d5cf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:57:19.628811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f75a9-b643-4147-a7e4-b7d393281a35 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:19.629327 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f75a9-b643-4147-a7e4-b7d393281a35 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:19.629446 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f75a9-b643-4147-a7e4-b7d393281a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:19.646784 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-c22f75a9-b643-4147-a7e4-b7d393281a35 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:57:19.648123 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-c22f75a9-b643-4147-a7e4-b7d393281a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:57:19.706855 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1424/2865] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:57:19.716703 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acd78f-f813-495b-aed3-eda85aafff0b admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:19.718129 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d2acd78f-f813-495b-aed3-eda85aafff0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:57:19.775153 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acd78f-f813-495b-aed3-eda85aafff0b admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:19.778818 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac3442-8965-439f-abe7-c65f605d90b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:19.779491 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac3442-8965-439f-abe7-c65f605d90b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:19.779773 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac3442-8965-439f-abe7-c65f605d90b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:19.780047 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac3442-8965-439f-abe7-c65f605d90b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:19.788940 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac3442-8965-439f-abe7-c65f605d90b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:19.790364 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac3442-8965-439f-abe7-c65f605d90b1 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:19.799823 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1442/2866] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:57:20.069804 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f75a9-b643-4147-a7e4-b7d393281a35 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:20.073079 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-c22f75a9-b643-4147-a7e4-b7d393281a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:57:20.085341 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f75a9-b643-4147-a7e4-b7d393281a35 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:20.090468 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57e33b-26dc-4eeb-87bd-50148f29f6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:20.091361 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57e33b-26dc-4eeb-87bd-50148f29f6eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:20.091648 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57e33b-26dc-4eeb-87bd-50148f29f6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:20.091925 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57e33b-26dc-4eeb-87bd-50148f29f6eb admin admin] PATH_INFO: `/v3/projects/83cfe2d096b44398a3bbfad8112fc91b` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:20.093105 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57e33b-26dc-4eeb-87bd-50148f29f6eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=83cfe2d096b44398a3bbfad8112fc91b)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:20.095004 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57e33b-26dc-4eeb-87bd-50148f29f6eb admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:20.145058 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-cb57e33b-26dc-4eeb-87bd-50148f29f6eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83cfe2d096b44398a3bbfad8112fc91b', 'request_id': 'req-cb57e33b-26dc-4eeb-87bd-50148f29f6eb'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:20.151668 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-cb57e33b-26dc-4eeb-87bd-50148f29f6eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83cfe2d096b44398a3bbfad8112fc91b', 'request_id': 'req-cb57e33b-26dc-4eeb-87bd-50148f29f6eb'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:20.157912 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-cb57e33b-26dc-4eeb-87bd-50148f29f6eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83cfe2d096b44398a3bbfad8112fc91b', 'request_id': 'req-cb57e33b-26dc-4eeb-87bd-50148f29f6eb'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:20.169115 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-cb57e33b-26dc-4eeb-87bd-50148f29f6eb admin admin] The token cache is being invalidate because project 83cfe2d096b44398a3bbfad8112fc91b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:57:20.169399 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-cb57e33b-26dc-4eeb-87bd-50148f29f6eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:20.170049 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-cb57e33b-26dc-4eeb-87bd-50148f29f6eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:20.171626 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1425/2867] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:57:20 2022] DELETE /identity/v3/projects/83cfe2d096b44398a3bbfad8112fc91b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:57:20.175700 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac3442-8965-439f-abe7-c65f605d90b1 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:20.185863 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac3442-8965-439f-abe7-c65f605d90b1 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:20.203376 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:57:20.243006 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63ada7-fef3-4746-ae4c-5fc9f13ab930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:20.244036 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63ada7-fef3-4746-ae4c-5fc9f13ab930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:20.244319 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63ada7-fef3-4746-ae4c-5fc9f13ab930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:20.244594 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63ada7-fef3-4746-ae4c-5fc9f13ab930 admin admin] PATH_INFO: `/v3/users/e341aadf1b1d48a18b953286f8cf6d48` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:20.245756 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63ada7-fef3-4746-ae4c-5fc9f13ab930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e341aadf1b1d48a18b953286f8cf6d48)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:20.247701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63ada7-fef3-4746-ae4c-5fc9f13ab930 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:20.293324 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-9e63ada7-fef3-4746-ae4c-5fc9f13ab930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e341aadf1b1d48a18b953286f8cf6d48'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:20.293972 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-9e63ada7-fef3-4746-ae4c-5fc9f13ab930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e341aadf1b1d48a18b953286f8cf6d48'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:20.301434 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-9e63ada7-fef3-4746-ae4c-5fc9f13ab930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e341aadf1b1d48a18b953286f8cf6d48'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:20.302007 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-9e63ada7-fef3-4746-ae4c-5fc9f13ab930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e341aadf1b1d48a18b953286f8cf6d48'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:20.313693 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-9e63ada7-fef3-4746-ae4c-5fc9f13ab930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e341aadf1b1d48a18b953286f8cf6d48'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:20.325759 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1443/2868] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:57:20 2022] DELETE /identity/v3/users/e341aadf1b1d48a18b953286f8cf6d48 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:57:20.587022 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57e33b-26dc-4eeb-87bd-50148f29f6eb admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:20.588619 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-cb57e33b-26dc-4eeb-87bd-50148f29f6eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:57:20.601671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57e33b-26dc-4eeb-87bd-50148f29f6eb admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:20.661929 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af9997-0438-4289-bd78-561ad8cff4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:20.663472 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af9997-0438-4289-bd78-561ad8cff4fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:20.663757 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af9997-0438-4289-bd78-561ad8cff4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:20.664027 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af9997-0438-4289-bd78-561ad8cff4fc admin admin] PATH_INFO: `/v3/projects/51c72533e9ac4b01beb88c89bfa2418e` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:20.665223 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af9997-0438-4289-bd78-561ad8cff4fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=51c72533e9ac4b01beb88c89bfa2418e)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:20.667123 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af9997-0438-4289-bd78-561ad8cff4fc admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:20.697891 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:57:20.715543 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-36af9997-0438-4289-bd78-561ad8cff4fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51c72533e9ac4b01beb88c89bfa2418e', 'request_id': 'req-36af9997-0438-4289-bd78-561ad8cff4fc'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:20.722491 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-36af9997-0438-4289-bd78-561ad8cff4fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51c72533e9ac4b01beb88c89bfa2418e', 'request_id': 'req-36af9997-0438-4289-bd78-561ad8cff4fc'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:20.729088 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-36af9997-0438-4289-bd78-561ad8cff4fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51c72533e9ac4b01beb88c89bfa2418e', 'request_id': 'req-36af9997-0438-4289-bd78-561ad8cff4fc'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:20.739158 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-36af9997-0438-4289-bd78-561ad8cff4fc admin admin] The token cache is being invalidate because project 51c72533e9ac4b01beb88c89bfa2418e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:57:20.739470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-36af9997-0438-4289-bd78-561ad8cff4fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:20.740092 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-36af9997-0438-4289-bd78-561ad8cff4fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:20.742194 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1426/2869] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:57:20 2022] DELETE /identity/v3/projects/51c72533e9ac4b01beb88c89bfa2418e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:57:20.747188 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb2dfc-10c8-4a48-8542-871fffd25515 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:20.747711 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb2dfc-10c8-4a48-8542-871fffd25515 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:20.747900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb2dfc-10c8-4a48-8542-871fffd25515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:20.767115 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-d7eb2dfc-10c8-4a48-8542-871fffd25515 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:57:20.768346 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-d7eb2dfc-10c8-4a48-8542-871fffd25515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:57:20.826222 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1444/2870] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:57:20.834137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c64ef1-559a-4c9d-9bcc-e8e5004a09b6 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:20.834387 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c64ef1-559a-4c9d-9bcc-e8e5004a09b6 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:20.834755 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c64ef1-559a-4c9d-9bcc-e8e5004a09b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:20.853452 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-e3c64ef1-559a-4c9d-9bcc-e8e5004a09b6 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:57:20.854640 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-e3c64ef1-559a-4c9d-9bcc-e8e5004a09b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:57:20.862487 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1427/2871] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:57:20.867356 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb2dfc-10c8-4a48-8542-871fffd25515 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:20.876963 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb2dfc-10c8-4a48-8542-871fffd25515 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:20.881553 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d75f0-aee3-4bf3-a025-8ba88364ed87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:20.882204 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d75f0-aee3-4bf3-a025-8ba88364ed87 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:20.882490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d75f0-aee3-4bf3-a025-8ba88364ed87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:20.882775 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d75f0-aee3-4bf3-a025-8ba88364ed87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:20.883533 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d75f0-aee3-4bf3-a025-8ba88364ed87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:57:20.883844 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d75f0-aee3-4bf3-a025-8ba88364ed87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:20.885441 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d75f0-aee3-4bf3-a025-8ba88364ed87 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:20.896798 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1445/2872] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:57:20.900819 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c64ef1-559a-4c9d-9bcc-e8e5004a09b6 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:20.909918 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c64ef1-559a-4c9d-9bcc-e8e5004a09b6 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:20.915226 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47dc884-5fea-4502-a4de-c1ffb235cc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:20.915898 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dc884-5fea-4502-a4de-c1ffb235cc9c admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:20.916183 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dc884-5fea-4502-a4de-c1ffb235cc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:20.916454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dc884-5fea-4502-a4de-c1ffb235cc9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:20.917136 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47dc884-5fea-4502-a4de-c1ffb235cc9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:20.919011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47dc884-5fea-4502-a4de-c1ffb235cc9c admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:20.944467 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1428/2873] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:57:20 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:57:20.949565 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d75f0-aee3-4bf3-a025-8ba88364ed87 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:20.959465 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d75f0-aee3-4bf3-a025-8ba88364ed87 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:20.985701 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:57:21.020473 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc81a4-2799-45ba-9c04-ea21192bf896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:21.021145 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc81a4-2799-45ba-9c04-ea21192bf896 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:21.021428 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc81a4-2799-45ba-9c04-ea21192bf896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:21.021702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc81a4-2799-45ba-9c04-ea21192bf896 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:21.022934 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc81a4-2799-45ba-9c04-ea21192bf896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:21.024887 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc81a4-2799-45ba-9c04-ea21192bf896 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:21.045647 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1446/2874] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:57:20 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:57:21.049652 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47dc884-5fea-4502-a4de-c1ffb235cc9c admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:21.059849 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47dc884-5fea-4502-a4de-c1ffb235cc9c admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:21.064430 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bf373-7cd9-4055-a3d2-387e852a960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:21.065083 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bf373-7cd9-4055-a3d2-387e852a960a admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:21.065367 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bf373-7cd9-4055-a3d2-387e852a960a admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:21.065642 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bf373-7cd9-4055-a3d2-387e852a960a admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:21.066360 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bf373-7cd9-4055-a3d2-387e852a960a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:21.067992 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bf373-7cd9-4055-a3d2-387e852a960a admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:21.078515 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1429/2875] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:57:21.082356 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc81a4-2799-45ba-9c04-ea21192bf896 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:21.093211 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc81a4-2799-45ba-9c04-ea21192bf896 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:21.097809 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f44caf-6ac4-43b7-9e48-58dcbd914025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:21.098468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f44caf-6ac4-43b7-9e48-58dcbd914025 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:21.098751 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f44caf-6ac4-43b7-9e48-58dcbd914025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:21.099028 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f44caf-6ac4-43b7-9e48-58dcbd914025 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:21.099793 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f44caf-6ac4-43b7-9e48-58dcbd914025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:21.101982 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f44caf-6ac4-43b7-9e48-58dcbd914025 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:21.111921 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1447/2876] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:57:21.115946 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bf373-7cd9-4055-a3d2-387e852a960a admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:21.125912 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bf373-7cd9-4055-a3d2-387e852a960a admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:21.130489 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfb456-0511-49a4-b551-227de487ff88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:21.131393 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfb456-0511-49a4-b551-227de487ff88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:21.131705 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfb456-0511-49a4-b551-227de487ff88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:21.131981 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfb456-0511-49a4-b551-227de487ff88 admin admin] PATH_INFO: `/v3/projects/3c71eee21f474ff789b08634742923a5/users/fd72d0da19854cfc9a428d5bba112d6c/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:21.146160 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfb456-0511-49a4-b551-227de487ff88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c71eee21f474ff789b08634742923a5, user_id=fd72d0da19854cfc9a428d5bba112d6c, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:21.149372 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfb456-0511-49a4-b551-227de487ff88 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:21.161742 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1430/2877] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:57:21 2022] PUT /identity/v3/projects/3c71eee21f474ff789b08634742923a5/users/fd72d0da19854cfc9a428d5bba112d6c/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:57:21.218799 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91445eff-4b25-493e-86d2-5f8b3adb1d71 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:21.219090 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91445eff-4b25-493e-86d2-5f8b3adb1d71 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:21.219412 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91445eff-4b25-493e-86d2-5f8b3adb1d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:21.245815 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-91445eff-4b25-493e-86d2-5f8b3adb1d71 None None] MFA Rules not processed for user `fd72d0da19854cfc9a428d5bba112d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:57:21.247057 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-91445eff-4b25-493e-86d2-5f8b3adb1d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:57:21.309308 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1448/2878] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:57:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:57:21.313920 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfb456-0511-49a4-b551-227de487ff88 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:21.375469 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfb456-0511-49a4-b551-227de487ff88 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:21.379994 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426efe9a-71a1-4e29-9461-3d64ff0a059e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:21.380645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426efe9a-71a1-4e29-9461-3d64ff0a059e admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:21.380931 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426efe9a-71a1-4e29-9461-3d64ff0a059e admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:21.381237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426efe9a-71a1-4e29-9461-3d64ff0a059e admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:21.381926 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426efe9a-71a1-4e29-9461-3d64ff0a059e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:21.383863 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426efe9a-71a1-4e29-9461-3d64ff0a059e admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:21.408581 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1431/2879] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:57:21 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 09:57:21.412606 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91445eff-4b25-493e-86d2-5f8b3adb1d71 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:21.423919 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91445eff-4b25-493e-86d2-5f8b3adb1d71 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:21.478725 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4fc7b-d959-4ae1-99c8-3b630387aea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:21.479418 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4fc7b-d959-4ae1-99c8-3b630387aea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:21.479702 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4fc7b-d959-4ae1-99c8-3b630387aea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:21.479975 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4fc7b-d959-4ae1-99c8-3b630387aea0 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:21.480651 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4fc7b-d959-4ae1-99c8-3b630387aea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:21.482557 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4fc7b-d959-4ae1-99c8-3b630387aea0 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:21.505859 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1449/2880] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:57:21 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:57:21.510416 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426efe9a-71a1-4e29-9461-3d64ff0a059e admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:21.520803 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426efe9a-71a1-4e29-9461-3d64ff0a059e admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:21.529351 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba839749-67a6-4b41-a140-a33db7d21383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:21.530011 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba839749-67a6-4b41-a140-a33db7d21383 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:21.530297 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba839749-67a6-4b41-a140-a33db7d21383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:21.530571 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba839749-67a6-4b41-a140-a33db7d21383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:21.531312 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba839749-67a6-4b41-a140-a33db7d21383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:21.532906 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba839749-67a6-4b41-a140-a33db7d21383 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:21.544690 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1432/2881] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:57:21.548926 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4fc7b-d959-4ae1-99c8-3b630387aea0 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:21.558935 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4fc7b-d959-4ae1-99c8-3b630387aea0 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:21.563568 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c332633-94be-4008-8d56-f8e77d1065be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:21.564441 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c332633-94be-4008-8d56-f8e77d1065be admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:21.564727 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c332633-94be-4008-8d56-f8e77d1065be admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:21.565007 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c332633-94be-4008-8d56-f8e77d1065be admin admin] PATH_INFO: `/v3/projects/0dc936f62ab94e75ae72cf4047a8bcc2/users/1f7ea32363a549fa9b92625b3b48ea5e/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:21.580321 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c332633-94be-4008-8d56-f8e77d1065be admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dc936f62ab94e75ae72cf4047a8bcc2, user_id=1f7ea32363a549fa9b92625b3b48ea5e, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:21.583002 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c332633-94be-4008-8d56-f8e77d1065be admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:21.597573 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1450/2882] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:57:21 2022] PUT /identity/v3/projects/0dc936f62ab94e75ae72cf4047a8bcc2/users/1f7ea32363a549fa9b92625b3b48ea5e/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:57:21.601477 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba839749-67a6-4b41-a140-a33db7d21383 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:21.611301 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba839749-67a6-4b41-a140-a33db7d21383 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:21.630734 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:57:21.669671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b1914-b42b-4b5e-8eb3-1c1619abd425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:21.670340 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b1914-b42b-4b5e-8eb3-1c1619abd425 admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:21.670622 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b1914-b42b-4b5e-8eb3-1c1619abd425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:21.670896 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b1914-b42b-4b5e-8eb3-1c1619abd425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:21.671643 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b1914-b42b-4b5e-8eb3-1c1619abd425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:21.673213 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b1914-b42b-4b5e-8eb3-1c1619abd425 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:21.682817 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1433/2883] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:57:21.687100 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c332633-94be-4008-8d56-f8e77d1065be admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:21.692565 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:57:21.699900 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c332633-94be-4008-8d56-f8e77d1065be admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:21.704792 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539677c-883f-4b5b-9f50-041b747371ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:21.705680 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539677c-883f-4b5b-9f50-041b747371ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:21.705966 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539677c-883f-4b5b-9f50-041b747371ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:21.706246 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539677c-883f-4b5b-9f50-041b747371ee admin admin] PATH_INFO: `/v3/projects/0dc936f62ab94e75ae72cf4047a8bcc2/users/1f7ea32363a549fa9b92625b3b48ea5e/roles/bb6c5483d9be4a16ac64750536c5e2e2` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:21.708424 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539677c-883f-4b5b-9f50-041b747371ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dc936f62ab94e75ae72cf4047a8bcc2, user_id=1f7ea32363a549fa9b92625b3b48ea5e, role_id=bb6c5483d9be4a16ac64750536c5e2e2)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:21.711977 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539677c-883f-4b5b-9f50-041b747371ee admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:21.722685 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1451/2884] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:57:21 2022] PUT /identity/v3/projects/0dc936f62ab94e75ae72cf4047a8bcc2/users/1f7ea32363a549fa9b92625b3b48ea5e/roles/bb6c5483d9be4a16ac64750536c5e2e2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:57:21.733845 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c414dd-a7f4-4be8-9dd1-e1d16bc074cd None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:21.734256 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c414dd-a7f4-4be8-9dd1-e1d16bc074cd None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:21.734541 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c414dd-a7f4-4be8-9dd1-e1d16bc074cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:21.760486 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-51c414dd-a7f4-4be8-9dd1-e1d16bc074cd None None] MFA Rules not processed for user `1f7ea32363a549fa9b92625b3b48ea5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:57:21.761672 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-51c414dd-a7f4-4be8-9dd1-e1d16bc074cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:57:21.828184 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1434/2885] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:57:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:57:21.838825 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539677c-883f-4b5b-9f50-041b747371ee admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:21.840592 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-0539677c-883f-4b5b-9f50-041b747371ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:57:21.895690 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539677c-883f-4b5b-9f50-041b747371ee admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:21.899242 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be1f61-d241-4aaa-9231-edaa4097750a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:21.899904 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be1f61-d241-4aaa-9231-edaa4097750a service cinder] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:21.900185 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be1f61-d241-4aaa-9231-edaa4097750a service cinder] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:21.900461 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be1f61-d241-4aaa-9231-edaa4097750a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:21.954976 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be1f61-d241-4aaa-9231-edaa4097750a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:21.956440 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be1f61-d241-4aaa-9231-edaa4097750a service cinder] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:21.965355 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1452/2886] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:57:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:57:28.614100 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c414dd-a7f4-4be8-9dd1-e1d16bc074cd None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:28.623711 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c414dd-a7f4-4be8-9dd1-e1d16bc074cd None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:28.627214 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06371aeb-7f63-4b63-9d3b-07354f2927c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:28.627887 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06371aeb-7f63-4b63-9d3b-07354f2927c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:28.628194 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06371aeb-7f63-4b63-9d3b-07354f2927c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:28.628470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06371aeb-7f63-4b63-9d3b-07354f2927c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:28.638210 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06371aeb-7f63-4b63-9d3b-07354f2927c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:28.639671 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06371aeb-7f63-4b63-9d3b-07354f2927c5 service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:28.649672 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1435/2887] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:57:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:57:31.961445 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:57:38.644753 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=58 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:57:58.486634 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be1f61-d241-4aaa-9231-edaa4097750a service cinder] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:58.546949 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be1f61-d241-4aaa-9231-edaa4097750a service cinder] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:58.551388 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883440a1-0e04-4bac-86e4-8e8c9823230f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:58.552239 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883440a1-0e04-4bac-86e4-8e8c9823230f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:58.552515 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883440a1-0e04-4bac-86e4-8e8c9823230f admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:58.552789 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883440a1-0e04-4bac-86e4-8e8c9823230f admin admin] PATH_INFO: `/v3/users/fd72d0da19854cfc9a428d5bba112d6c` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:58.553945 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883440a1-0e04-4bac-86e4-8e8c9823230f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd72d0da19854cfc9a428d5bba112d6c)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:58.556034 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883440a1-0e04-4bac-86e4-8e8c9823230f admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:58.600925 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-883440a1-0e04-4bac-86e4-8e8c9823230f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd72d0da19854cfc9a428d5bba112d6c'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:58.601560 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-883440a1-0e04-4bac-86e4-8e8c9823230f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd72d0da19854cfc9a428d5bba112d6c'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:58.608316 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-883440a1-0e04-4bac-86e4-8e8c9823230f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd72d0da19854cfc9a428d5bba112d6c'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:58.608933 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-883440a1-0e04-4bac-86e4-8e8c9823230f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd72d0da19854cfc9a428d5bba112d6c'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:58.620456 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-883440a1-0e04-4bac-86e4-8e8c9823230f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd72d0da19854cfc9a428d5bba112d6c'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:58.633538 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1453/2888] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:57:58 2022] DELETE /identity/v3/users/fd72d0da19854cfc9a428d5bba112d6c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:57:58.638042 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb646c7-8107-4b7f-b1b5-1b610d7c5b7c None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:58.638507 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb646c7-8107-4b7f-b1b5-1b610d7c5b7c None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:58.638639 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb646c7-8107-4b7f-b1b5-1b610d7c5b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:58.656560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-beb646c7-8107-4b7f-b1b5-1b610d7c5b7c None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:57:58.657748 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-beb646c7-8107-4b7f-b1b5-1b610d7c5b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:57:58.715092 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1436/2889] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:57:58.724574 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883440a1-0e04-4bac-86e4-8e8c9823230f admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:58.725990 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-883440a1-0e04-4bac-86e4-8e8c9823230f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:57:58.782637 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883440a1-0e04-4bac-86e4-8e8c9823230f admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:58.786186 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74918d-af39-4402-96db-b32b260de985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:58.786936 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74918d-af39-4402-96db-b32b260de985 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:58.787222 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74918d-af39-4402-96db-b32b260de985 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:58.787543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74918d-af39-4402-96db-b32b260de985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:58.796591 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74918d-af39-4402-96db-b32b260de985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:58.798194 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74918d-af39-4402-96db-b32b260de985 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:58.807477 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1454/2890] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:57:59.071137 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb646c7-8107-4b7f-b1b5-1b610d7c5b7c None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:59.072603 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-beb646c7-8107-4b7f-b1b5-1b610d7c5b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:57:59.088063 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb646c7-8107-4b7f-b1b5-1b610d7c5b7c None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:59.093244 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddb7b4-af48-4d19-b45f-79c188ec9114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:59.094258 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddb7b4-af48-4d19-b45f-79c188ec9114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:59.094537 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddb7b4-af48-4d19-b45f-79c188ec9114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:59.094815 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddb7b4-af48-4d19-b45f-79c188ec9114 admin admin] PATH_INFO: `/v3/projects/3c71eee21f474ff789b08634742923a5` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:59.095996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ddb7b4-af48-4d19-b45f-79c188ec9114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c71eee21f474ff789b08634742923a5)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:59.097967 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ddb7b4-af48-4d19-b45f-79c188ec9114 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:59.143995 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-b5ddb7b4-af48-4d19-b45f-79c188ec9114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c71eee21f474ff789b08634742923a5', 'request_id': 'req-b5ddb7b4-af48-4d19-b45f-79c188ec9114'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:59.150972 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-b5ddb7b4-af48-4d19-b45f-79c188ec9114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c71eee21f474ff789b08634742923a5', 'request_id': 'req-b5ddb7b4-af48-4d19-b45f-79c188ec9114'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:59.157122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-b5ddb7b4-af48-4d19-b45f-79c188ec9114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c71eee21f474ff789b08634742923a5', 'request_id': 'req-b5ddb7b4-af48-4d19-b45f-79c188ec9114'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:59.167143 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-b5ddb7b4-af48-4d19-b45f-79c188ec9114 admin admin] The token cache is being invalidate because project 3c71eee21f474ff789b08634742923a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:57:59.167458 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-b5ddb7b4-af48-4d19-b45f-79c188ec9114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:59.168072 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-b5ddb7b4-af48-4d19-b45f-79c188ec9114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:59.169576 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1437/2891] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:57:59 2022] DELETE /identity/v3/projects/3c71eee21f474ff789b08634742923a5 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:57:59.173491 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74918d-af39-4402-96db-b32b260de985 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:59.183438 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74918d-af39-4402-96db-b32b260de985 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:59.201525 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:57:59.242293 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9f91e-04ad-4d67-b07d-8b57cbb488fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:59.243712 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9f91e-04ad-4d67-b07d-8b57cbb488fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:59.243997 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9f91e-04ad-4d67-b07d-8b57cbb488fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:59.244267 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9f91e-04ad-4d67-b07d-8b57cbb488fb admin admin] PATH_INFO: `/v3/users/1f7ea32363a549fa9b92625b3b48ea5e` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:59.245481 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9f91e-04ad-4d67-b07d-8b57cbb488fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f7ea32363a549fa9b92625b3b48ea5e)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:59.247374 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9f91e-04ad-4d67-b07d-8b57cbb488fb admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:59.292460 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-8ca9f91e-04ad-4d67-b07d-8b57cbb488fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f7ea32363a549fa9b92625b3b48ea5e'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:59.293089 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-8ca9f91e-04ad-4d67-b07d-8b57cbb488fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f7ea32363a549fa9b92625b3b48ea5e'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:59.299741 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-8ca9f91e-04ad-4d67-b07d-8b57cbb488fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f7ea32363a549fa9b92625b3b48ea5e'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:59.300354 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-8ca9f91e-04ad-4d67-b07d-8b57cbb488fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f7ea32363a549fa9b92625b3b48ea5e'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:59.312232 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-8ca9f91e-04ad-4d67-b07d-8b57cbb488fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f7ea32363a549fa9b92625b3b48ea5e'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:59.325001 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1455/2892] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:57:59 2022] DELETE /identity/v3/users/1f7ea32363a549fa9b92625b3b48ea5e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:57:59.596296 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddb7b4-af48-4d19-b45f-79c188ec9114 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:59.597774 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-b5ddb7b4-af48-4d19-b45f-79c188ec9114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:57:59.612454 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddb7b4-af48-4d19-b45f-79c188ec9114 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:59.672165 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c52a3-3b82-4311-8f4b-1454ff84648d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:59.673037 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c52a3-3b82-4311-8f4b-1454ff84648d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:59.673323 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c52a3-3b82-4311-8f4b-1454ff84648d admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:59.673601 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c52a3-3b82-4311-8f4b-1454ff84648d admin admin] PATH_INFO: `/v3/projects/0dc936f62ab94e75ae72cf4047a8bcc2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:59.674774 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c52a3-3b82-4311-8f4b-1454ff84648d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dc936f62ab94e75ae72cf4047a8bcc2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:59.676709 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c52a3-3b82-4311-8f4b-1454ff84648d admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:59.714870 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:57:59.734537 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-7e7c52a3-3b82-4311-8f4b-1454ff84648d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dc936f62ab94e75ae72cf4047a8bcc2', 'request_id': 'req-7e7c52a3-3b82-4311-8f4b-1454ff84648d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:59.742472 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-7e7c52a3-3b82-4311-8f4b-1454ff84648d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dc936f62ab94e75ae72cf4047a8bcc2', 'request_id': 'req-7e7c52a3-3b82-4311-8f4b-1454ff84648d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:59.750189 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-7e7c52a3-3b82-4311-8f4b-1454ff84648d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dc936f62ab94e75ae72cf4047a8bcc2', 'request_id': 'req-7e7c52a3-3b82-4311-8f4b-1454ff84648d'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:59.762753 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-7e7c52a3-3b82-4311-8f4b-1454ff84648d admin admin] The token cache is being invalidate because project 0dc936f62ab94e75ae72cf4047a8bcc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:57:59.763038 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-7e7c52a3-3b82-4311-8f4b-1454ff84648d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:59.764150 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-7e7c52a3-3b82-4311-8f4b-1454ff84648d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:57:59.766746 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1438/2893] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:57:59 2022] DELETE /identity/v3/projects/0dc936f62ab94e75ae72cf4047a8bcc2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:57:59.772475 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11512a62-0952-497c-b0b2-b33f9887cdf0 None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:59.772960 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11512a62-0952-497c-b0b2-b33f9887cdf0 None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:59.772960 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11512a62-0952-497c-b0b2-b33f9887cdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:59.791493 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-11512a62-0952-497c-b0b2-b33f9887cdf0 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:57:59.792677 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-11512a62-0952-497c-b0b2-b33f9887cdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:57:59.849904 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1456/2894] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:57:59.858390 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc8413-88af-4ce0-872b-c8b28c4957b5 None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:59.858683 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc8413-88af-4ce0-872b-c8b28c4957b5 None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:59.858962 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc8413-88af-4ce0-872b-c8b28c4957b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:59.877315 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-77fc8413-88af-4ce0-872b-c8b28c4957b5 None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:57:59.878496 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-77fc8413-88af-4ce0-872b-c8b28c4957b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:57:59.887013 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1439/2895] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 09:57:59.891472 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11512a62-0952-497c-b0b2-b33f9887cdf0 None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:59.901819 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11512a62-0952-497c-b0b2-b33f9887cdf0 None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:59.906403 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30a470-345d-42d5-8f88-70e61334b40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:59.907058 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30a470-345d-42d5-8f88-70e61334b40d admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:59.907379 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30a470-345d-42d5-8f88-70e61334b40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:59.907664 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30a470-345d-42d5-8f88-70e61334b40d admin admin] PATH_INFO: `/v3/domains` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:59.908389 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30a470-345d-42d5-8f88-70e61334b40d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 09:57:59.908700 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30a470-345d-42d5-8f88-70e61334b40d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:59.910308 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30a470-345d-42d5-8f88-70e61334b40d admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:59.922142 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1457/2896] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 09:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 09:57:59.926353 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc8413-88af-4ce0-872b-c8b28c4957b5 None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:59.936201 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc8413-88af-4ce0-872b-c8b28c4957b5 None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:57:59.940863 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604cebe-bd7f-4927-9d9a-67c51234ee0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:57:59.941511 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604cebe-bd7f-4927-9d9a-67c51234ee0c admin admin] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:57:59.941798 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604cebe-bd7f-4927-9d9a-67c51234ee0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:57:59.942078 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604cebe-bd7f-4927-9d9a-67c51234ee0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:57:59.942765 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604cebe-bd7f-4927-9d9a-67c51234ee0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:57:59.944692 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604cebe-bd7f-4927-9d9a-67c51234ee0c admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:57:59.980418 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1440/2897] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 09:57:59 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:57:59.984426 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30a470-345d-42d5-8f88-70e61334b40d admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:57:59.994397 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30a470-345d-42d5-8f88-70e61334b40d admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:58:00.020456 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:58:00.052588 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7361a2d-8807-4a38-8688-c5155ee17fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:58:00.053175 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7361a2d-8807-4a38-8688-c5155ee17fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:58:00.053458 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7361a2d-8807-4a38-8688-c5155ee17fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:58:00.053733 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7361a2d-8807-4a38-8688-c5155ee17fe0 admin admin] PATH_INFO: `/v3/users` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:58:00.054411 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7361a2d-8807-4a38-8688-c5155ee17fe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:58:00.056356 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7361a2d-8807-4a38-8688-c5155ee17fe0 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:58:00.076221 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1458/2898] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 09:57:59 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 09:58:00.080382 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604cebe-bd7f-4927-9d9a-67c51234ee0c admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:58:00.091614 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604cebe-bd7f-4927-9d9a-67c51234ee0c admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:58:00.096209 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3bb4b-c93c-40e7-9d00-2293ea27743b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:58:00.096889 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3bb4b-c93c-40e7-9d00-2293ea27743b admin admin] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:58:00.097175 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3bb4b-c93c-40e7-9d00-2293ea27743b admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:58:00.097455 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3bb4b-c93c-40e7-9d00-2293ea27743b admin admin] PATH_INFO: `/v3/roles` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:58:00.098173 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3bb4b-c93c-40e7-9d00-2293ea27743b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:58:00.099798 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3bb4b-c93c-40e7-9d00-2293ea27743b admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:58:00.109711 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1441/2899] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:58:00.113488 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7361a2d-8807-4a38-8688-c5155ee17fe0 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:58:00.123468 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7361a2d-8807-4a38-8688-c5155ee17fe0 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:58:00.128174 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6028c1-13f5-4be4-a806-1f68b561d5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:58:00.128827 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6028c1-13f5-4be4-a806-1f68b561d5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:58:00.129114 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6028c1-13f5-4be4-a806-1f68b561d5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:58:00.129424 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6028c1-13f5-4be4-a806-1f68b561d5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:58:00.130208 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6028c1-13f5-4be4-a806-1f68b561d5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:58:00.131882 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6028c1-13f5-4be4-a806-1f68b561d5d5 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:58:00.142282 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1459/2900] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 09:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 09:58:00.146406 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3bb4b-c93c-40e7-9d00-2293ea27743b admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:58:00.156806 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3bb4b-c93c-40e7-9d00-2293ea27743b admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:58:00.161348 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff4d31-020c-4810-8157-dc58c2ddc7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:58:00.162216 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff4d31-020c-4810-8157-dc58c2ddc7c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:58:00.162499 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff4d31-020c-4810-8157-dc58c2ddc7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:58:00.162774 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff4d31-020c-4810-8157-dc58c2ddc7c4 admin admin] PATH_INFO: `/v3/projects/d85fc88eb8ea475b8257c763a5bd1778/users/1603c22e46a74115a3b34876608331f1/roles/207b29fd2d8344ceb403e1c2e9d91ac2` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:58:00.176996 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff4d31-020c-4810-8157-dc58c2ddc7c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85fc88eb8ea475b8257c763a5bd1778, user_id=1603c22e46a74115a3b34876608331f1, role_id=207b29fd2d8344ceb403e1c2e9d91ac2)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:58:00.179675 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff4d31-020c-4810-8157-dc58c2ddc7c4 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:58:00.192281 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1442/2901] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 09:58:00 2022] PUT /identity/v3/projects/d85fc88eb8ea475b8257c763a5bd1778/users/1603c22e46a74115a3b34876608331f1/roles/207b29fd2d8344ceb403e1c2e9d91ac2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:58:00.202831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4da322-8f29-419f-9237-38e0049117fd None None] REQUEST_METHOD: `POST` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:58:00.203125 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4da322-8f29-419f-9237-38e0049117fd None None] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:58:00.203450 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4da322-8f29-419f-9237-38e0049117fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:58:00.229986 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.auth.core [None req-4d4da322-8f29-419f-9237-38e0049117fd None None] MFA Rules not processed for user `1603c22e46a74115a3b34876608331f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:58:00.231195 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-4d4da322-8f29-419f-9237-38e0049117fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:58:00.294583 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1460/2902] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:58:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:58:00.305594 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff4d31-020c-4810-8157-dc58c2ddc7c4 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:58:00.307203 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-4fff4d31-020c-4810-8157-dc58c2ddc7c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:58:00.364492 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff4d31-020c-4810-8157-dc58c2ddc7c4 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:58:00.368661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3dd72-1a07-47f8-9637-c5240621d47a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '192c3d179fdb43c9885f637446c83a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:58:00.369294 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3dd72-1a07-47f8-9637-c5240621d47a service cinder] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:58:00.369573 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3dd72-1a07-47f8-9637-c5240621d47a service cinder] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:58:00.369843 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3dd72-1a07-47f8-9637-c5240621d47a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:58:00.377928 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f3dd72-1a07-47f8-9637-c5240621d47a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:58:00.379367 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f3dd72-1a07-47f8-9637-c5240621d47a service cinder] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:58:00.388597 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1443/2903] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:58:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:58:00.412631 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4da322-8f29-419f-9237-38e0049117fd None None] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:58:00.473409 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4da322-8f29-419f-9237-38e0049117fd None None] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:58:00.477981 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9090c-033c-4aef-a378-6fb764b1a70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:58:00.478843 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9090c-033c-4aef-a378-6fb764b1a70d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:58:00.479122 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9090c-033c-4aef-a378-6fb764b1a70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:58:00.479425 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9090c-033c-4aef-a378-6fb764b1a70d admin admin] PATH_INFO: `/v3/users/1603c22e46a74115a3b34876608331f1` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:58:00.480641 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9090c-033c-4aef-a378-6fb764b1a70d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1603c22e46a74115a3b34876608331f1)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:58:00.482571 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9090c-033c-4aef-a378-6fb764b1a70d admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:58:00.523596 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:58:00.530343 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-a6b9090c-033c-4aef-a378-6fb764b1a70d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1603c22e46a74115a3b34876608331f1'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:58:00.531330 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-a6b9090c-033c-4aef-a378-6fb764b1a70d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1603c22e46a74115a3b34876608331f1'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:58:00.538811 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-a6b9090c-033c-4aef-a378-6fb764b1a70d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1603c22e46a74115a3b34876608331f1'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:58:00.539486 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-a6b9090c-033c-4aef-a378-6fb764b1a70d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1603c22e46a74115a3b34876608331f1'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:58:00.550847 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-a6b9090c-033c-4aef-a378-6fb764b1a70d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1603c22e46a74115a3b34876608331f1'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:58:00.563676 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1461/2904] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:58:00 2022] DELETE /identity/v3/users/1603c22e46a74115a3b34876608331f1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:58:00.568084 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f9922-29e7-46d7-acf7-d8ea429a7f5c None None] REQUEST_METHOD: `POST` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:58:00.568371 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f9922-29e7-46d7-acf7-d8ea429a7f5c None None] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:58:00.568645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f9922-29e7-46d7-acf7-d8ea429a7f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:58:00.586021 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.auth.core [None req-823f9922-29e7-46d7-acf7-d8ea429a7f5c None None] MFA Rules not processed for user `0745bfc9958247ec85586308336b6dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 09:58:00.587200 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-823f9922-29e7-46d7-acf7-d8ea429a7f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:58:00.626046 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:58:00.646872 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1444/2905] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 09:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 09:58:00.656543 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9090c-033c-4aef-a378-6fb764b1a70d admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:58:00.657989 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-a6b9090c-033c-4aef-a378-6fb764b1a70d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:58:00.714556 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9090c-033c-4aef-a378-6fb764b1a70d admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:58:00.718235 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba4d2b-6f33-4ddf-a422-1d77227e2643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:58:00.718880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba4d2b-6f33-4ddf-a422-1d77227e2643 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:58:00.719165 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba4d2b-6f33-4ddf-a422-1d77227e2643 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:58:00.719480 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba4d2b-6f33-4ddf-a422-1d77227e2643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:58:00.729023 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba4d2b-6f33-4ddf-a422-1d77227e2643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:58:00.730462 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba4d2b-6f33-4ddf-a422-1d77227e2643 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:58:00.739803 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1462/2906] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:58:01.000891 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f9922-29e7-46d7-acf7-d8ea429a7f5c None None] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:58:01.002405 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-823f9922-29e7-46d7-acf7-d8ea429a7f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:58:01.014076 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f9922-29e7-46d7-acf7-d8ea429a7f5c None None] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:58:01.018611 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cfc25-47f0-45c8-b731-25a9208afdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:58:01.019506 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cfc25-47f0-45c8-b731-25a9208afdeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:58:01.019788 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cfc25-47f0-45c8-b731-25a9208afdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:58:01.020057 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cfc25-47f0-45c8-b731-25a9208afdeb admin admin] PATH_INFO: `/v3/projects/d85fc88eb8ea475b8257c763a5bd1778` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:58:01.021228 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cfc25-47f0-45c8-b731-25a9208afdeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85fc88eb8ea475b8257c763a5bd1778)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:58:01.023122 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cfc25-47f0-45c8-b731-25a9208afdeb admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:58:01.071133 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-712cfc25-47f0-45c8-b731-25a9208afdeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85fc88eb8ea475b8257c763a5bd1778', 'request_id': 'req-712cfc25-47f0-45c8-b731-25a9208afdeb'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:58:01.078375 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-712cfc25-47f0-45c8-b731-25a9208afdeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85fc88eb8ea475b8257c763a5bd1778', 'request_id': 'req-712cfc25-47f0-45c8-b731-25a9208afdeb'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:58:01.084406 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-712cfc25-47f0-45c8-b731-25a9208afdeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85fc88eb8ea475b8257c763a5bd1778', 'request_id': 'req-712cfc25-47f0-45c8-b731-25a9208afdeb'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:58:01.094917 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-712cfc25-47f0-45c8-b731-25a9208afdeb admin admin] The token cache is being invalidate because project d85fc88eb8ea475b8257c763a5bd1778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:58:01.095232 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-712cfc25-47f0-45c8-b731-25a9208afdeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:58:01.095888 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-712cfc25-47f0-45c8-b731-25a9208afdeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:58:01.097470 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1445/2907] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:58:00 2022] DELETE /identity/v3/projects/d85fc88eb8ea475b8257c763a5bd1778 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:58:10.010352 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba4d2b-6f33-4ddf-a422-1d77227e2643 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:58:10.011778 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-aaba4d2b-6f33-4ddf-a422-1d77227e2643 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:58:10.080830 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba4d2b-6f33-4ddf-a422-1d77227e2643 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:58:10.131831 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:58:10.139995 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed2310-4cfc-4d94-b0f3-603d74d87c9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746fd8ed517446fe89c53df873abb2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:58:10.140742 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed2310-4cfc-4d94-b0f3-603d74d87c9f service placement] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:58:10.141034 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed2310-4cfc-4d94-b0f3-603d74d87c9f service placement] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:58:10.141494 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed2310-4cfc-4d94-b0f3-603d74d87c9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:58:10.143587 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-26ed2310-4cfc-4d94-b0f3-603d74d87c9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:58:10.154788 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed2310-4cfc-4d94-b0f3-603d74d87c9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:58:10.156404 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed2310-4cfc-4d94-b0f3-603d74d87c9f service placement] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:58:10.166097 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1463/2908] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:58:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:58:11.091733 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=34,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:58:20.161957 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=4 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:59:28.677524 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cfc25-47f0-45c8-b731-25a9208afdeb admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:59:28.679210 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-712cfc25-47f0-45c8-b731-25a9208afdeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:59:28.768039 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cfc25-47f0-45c8-b731-25a9208afdeb admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:59:28.775192 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fdc6b-a578-4abf-98b5-388de79e6398 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b1c12e88c549208894fc0dd0c60b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:59:28.776007 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fdc6b-a578-4abf-98b5-388de79e6398 service nova] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:59:28.776301 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fdc6b-a578-4abf-98b5-388de79e6398 service nova] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:59:28.776576 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fdc6b-a578-4abf-98b5-388de79e6398 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:59:28.778728 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-1f6fdc6b-a578-4abf-98b5-388de79e6398 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:59:28.800661 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fdc6b-a578-4abf-98b5-388de79e6398 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:59:28.802860 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fdc6b-a578-4abf-98b5-388de79e6398 service nova] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:59:28.816933 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1446/2909] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:59:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:59:28.879435 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed2310-4cfc-4d94-b0f3-603d74d87c9f service placement] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:59:28.881030 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-26ed2310-4cfc-4d94-b0f3-603d74d87c9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:59:28.938456 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed2310-4cfc-4d94-b0f3-603d74d87c9f service placement] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:59:28.942289 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d13d3-9fc3-4c1c-a294-65e6e2f04618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:59:28.942941 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d13d3-9fc3-4c1c-a294-65e6e2f04618 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:59:28.943227 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d13d3-9fc3-4c1c-a294-65e6e2f04618 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:59:28.943534 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d13d3-9fc3-4c1c-a294-65e6e2f04618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:59:28.945341 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-802d13d3-9fc3-4c1c-a294-65e6e2f04618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:59:28.959079 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d13d3-9fc3-4c1c-a294-65e6e2f04618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:59:28.960562 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d13d3-9fc3-4c1c-a294-65e6e2f04618 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:59:28.972533 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1464/2910] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:59:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:59:29.987191 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fdc6b-a578-4abf-98b5-388de79e6398 service nova] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:59:29.997090 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fdc6b-a578-4abf-98b5-388de79e6398 service nova] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:59:30.000582 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443b035-d71f-4908-baa2-574a6d7dc245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:59:30.001237 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443b035-d71f-4908-baa2-574a6d7dc245 service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:59:30.001518 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443b035-d71f-4908-baa2-574a6d7dc245 service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:59:30.001796 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443b035-d71f-4908-baa2-574a6d7dc245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:59:30.003562 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-5443b035-d71f-4908-baa2-574a6d7dc245 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:59:30.012826 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443b035-d71f-4908-baa2-574a6d7dc245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:59:30.014224 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443b035-d71f-4908-baa2-574a6d7dc245 service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:59:30.022174 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1447/2911] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:59:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:59:30.174605 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d13d3-9fc3-4c1c-a294-65e6e2f04618 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:59:30.185880 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d13d3-9fc3-4c1c-a294-65e6e2f04618 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:59:30.191141 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77307908-edb4-41df-be1d-119cfff06b80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:59:30.192337 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77307908-edb4-41df-be1d-119cfff06b80 service neutron] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:59:30.192776 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77307908-edb4-41df-be1d-119cfff06b80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:59:30.193205 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77307908-edb4-41df-be1d-119cfff06b80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:59:30.195909 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-77307908-edb4-41df-be1d-119cfff06b80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:59:30.215383 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77307908-edb4-41df-be1d-119cfff06b80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:59:30.216826 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77307908-edb4-41df-be1d-119cfff06b80 service neutron] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:59:30.228462 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1465/2912] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:59:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:59:40.018473 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=40 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:59:40.223560 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=32 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:59:42.223182 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443b035-d71f-4908-baa2-574a6d7dc245 service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:59:42.235882 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443b035-d71f-4908-baa2-574a6d7dc245 service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:59:42.241664 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47467f95-0819-461d-9f5b-3c6a57ba7ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1103a08484048da82c5e4627552253e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:59:42.242621 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47467f95-0819-461d-9f5b-3c6a57ba7ece service neutron] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:59:42.243055 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47467f95-0819-461d-9f5b-3c6a57ba7ece service neutron] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:59:42.243520 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47467f95-0819-461d-9f5b-3c6a57ba7ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:59:42.245593 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-47467f95-0819-461d-9f5b-3c6a57ba7ece service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:59:42.308132 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47467f95-0819-461d-9f5b-3c6a57ba7ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:59:42.309570 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47467f95-0819-461d-9f5b-3c6a57ba7ece service neutron] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:59:42.319811 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1448/2913] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:59:48.180002 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77307908-edb4-41df-be1d-119cfff06b80 service neutron] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:59:48.182117 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-77307908-edb4-41df-be1d-119cfff06b80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:59:48.199088 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77307908-edb4-41df-be1d-119cfff06b80 service neutron] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:59:48.204498 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e3764-81d4-44a1-a07a-46359c77756e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746fd8ed517446fe89c53df873abb2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:59:48.206393 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e3764-81d4-44a1-a07a-46359c77756e service placement] REQUEST_METHOD: `GET` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:59:48.206888 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e3764-81d4-44a1-a07a-46359c77756e service placement] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:59:48.207264 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e3764-81d4-44a1-a07a-46359c77756e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:59:48.209580 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-f52e3764-81d4-44a1-a07a-46359c77756e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:59:48.224744 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e3764-81d4-44a1-a07a-46359c77756e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:59:48.226524 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e3764-81d4-44a1-a07a-46359c77756e service placement] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:59:48.235421 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47467f95-0819-461d-9f5b-3c6a57ba7ece service neutron] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:59:48.236947 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-47467f95-0819-461d-9f5b-3c6a57ba7ece service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:59:48.249980 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47467f95-0819-461d-9f5b-3c6a57ba7ece service neutron] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:59:48.251484 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1466/2914] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 09:59:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 09:59:48.263560 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71012632-4b50-4271-8a5f-11b8d8224b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:59:48.264687 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71012632-4b50-4271-8a5f-11b8d8224b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:59:48.265025 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71012632-4b50-4271-8a5f-11b8d8224b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:59:48.265365 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71012632-4b50-4271-8a5f-11b8d8224b4e admin admin] PATH_INFO: `/v3/users/f1fa5f1765ed4995b31a1600ce3edb07` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:59:48.266738 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71012632-4b50-4271-8a5f-11b8d8224b4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1fa5f1765ed4995b31a1600ce3edb07)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:59:48.269727 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71012632-4b50-4271-8a5f-11b8d8224b4e admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:59:48.329450 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-71012632-4b50-4271-8a5f-11b8d8224b4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1fa5f1765ed4995b31a1600ce3edb07'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:59:48.337164 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-71012632-4b50-4271-8a5f-11b8d8224b4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1fa5f1765ed4995b31a1600ce3edb07'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:59:48.337898 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-71012632-4b50-4271-8a5f-11b8d8224b4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1fa5f1765ed4995b31a1600ce3edb07'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:59:48.350187 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-71012632-4b50-4271-8a5f-11b8d8224b4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1fa5f1765ed4995b31a1600ce3edb07'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:59:48.357221 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-71012632-4b50-4271-8a5f-11b8d8224b4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1fa5f1765ed4995b31a1600ce3edb07'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:59:48.363845 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1449/2915] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:59:48 2022] DELETE /identity/v3/users/f1fa5f1765ed4995b31a1600ce3edb07 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:59:48.535441 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e3764-81d4-44a1-a07a-46359c77756e service placement] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:59:48.546490 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e3764-81d4-44a1-a07a-46359c77756e service placement] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:59:48.605081 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6daa2-ce9b-44a7-aa29-54e6b77f7816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:59:48.605938 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6daa2-ce9b-44a7-aa29-54e6b77f7816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:59:48.606219 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6daa2-ce9b-44a7-aa29-54e6b77f7816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:59:48.606494 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6daa2-ce9b-44a7-aa29-54e6b77f7816 admin admin] PATH_INFO: `/v3/projects/0fb2f335c9b540af8f7119c85656efad` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:59:48.607697 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6daa2-ce9b-44a7-aa29-54e6b77f7816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fb2f335c9b540af8f7119c85656efad)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:59:48.609713 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6daa2-ce9b-44a7-aa29-54e6b77f7816 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:59:48.653908 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-54d6daa2-ce9b-44a7-aa29-54e6b77f7816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fb2f335c9b540af8f7119c85656efad', 'request_id': 'req-54d6daa2-ce9b-44a7-aa29-54e6b77f7816'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:59:48.660779 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-54d6daa2-ce9b-44a7-aa29-54e6b77f7816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fb2f335c9b540af8f7119c85656efad', 'request_id': 'req-54d6daa2-ce9b-44a7-aa29-54e6b77f7816'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:59:48.666128 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-54d6daa2-ce9b-44a7-aa29-54e6b77f7816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fb2f335c9b540af8f7119c85656efad', 'request_id': 'req-54d6daa2-ce9b-44a7-aa29-54e6b77f7816'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:59:48.677284 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-54d6daa2-ce9b-44a7-aa29-54e6b77f7816 admin admin] The token cache is being invalidate because project 0fb2f335c9b540af8f7119c85656efad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:59:48.677573 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-54d6daa2-ce9b-44a7-aa29-54e6b77f7816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:59:48.678222 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-54d6daa2-ce9b-44a7-aa29-54e6b77f7816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:59:48.679769 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1467/2916] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:59:48 2022] DELETE /identity/v3/projects/0fb2f335c9b540af8f7119c85656efad => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:59:48.683813 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71012632-4b50-4271-8a5f-11b8d8224b4e admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:59:48.685271 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-71012632-4b50-4271-8a5f-11b8d8224b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:59:48.698387 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71012632-4b50-4271-8a5f-11b8d8224b4e admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:59:48.755042 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9cf63-9eea-4b3c-af37-1fd80ba592f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:59:48.755882 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9cf63-9eea-4b3c-af37-1fd80ba592f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:59:48.756165 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9cf63-9eea-4b3c-af37-1fd80ba592f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:59:48.756442 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9cf63-9eea-4b3c-af37-1fd80ba592f1 admin admin] PATH_INFO: `/v3/users/0029abfb31974095afcca4bd9c3a3202` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:59:48.757613 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9cf63-9eea-4b3c-af37-1fd80ba592f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0029abfb31974095afcca4bd9c3a3202)` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:59:48.759596 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9cf63-9eea-4b3c-af37-1fd80ba592f1 admin admin] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:59:48.765487 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:59:48.806798 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-53d9cf63-9eea-4b3c-af37-1fd80ba592f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0029abfb31974095afcca4bd9c3a3202'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:59:48.813526 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-53d9cf63-9eea-4b3c-af37-1fd80ba592f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0029abfb31974095afcca4bd9c3a3202'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:59:48.814170 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-53d9cf63-9eea-4b3c-af37-1fd80ba592f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0029abfb31974095afcca4bd9c3a3202'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:59:48.825919 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-53d9cf63-9eea-4b3c-af37-1fd80ba592f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0029abfb31974095afcca4bd9c3a3202'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:59:48.833595 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.notifications [None req-53d9cf63-9eea-4b3c-af37-1fd80ba592f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0029abfb31974095afcca4bd9c3a3202'} {{(pid=80091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:59:48.839649 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1450/2917] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 09:59:48 2022] DELETE /identity/v3/users/0029abfb31974095afcca4bd9c3a3202 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:59:49.007767 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6daa2-ce9b-44a7-aa29-54e6b77f7816 admin admin] Authenticating user token {{(pid=80090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 09:59:49.009209 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.fernet_utils [None req-54d6daa2-ce9b-44a7-aa29-54e6b77f7816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 09:59:49.023492 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6daa2-ce9b-44a7-aa29-54e6b77f7816 admin admin] Validating token access rules against request {{(pid=80090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 09:59:49.089535 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c4234-96a9-4bfd-bb9d-c0a87fb5eef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0745bfc9958247ec85586308336b6dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfb9d6b014e38a0011fb0eee6eae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 09:59:49.090397 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c4234-96a9-4bfd-bb9d-c0a87fb5eef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 09:59:49.090678 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c4234-96a9-4bfd-bb9d-c0a87fb5eef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 09:59:49.090952 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c4234-96a9-4bfd-bb9d-c0a87fb5eef0 admin admin] PATH_INFO: `/v3/projects/581004a638af4993abf350d76570222b` {{(pid=80090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 09:59:49.092178 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c4234-96a9-4bfd-bb9d-c0a87fb5eef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=581004a638af4993abf350d76570222b)` {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 09:59:49.094095 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c4234-96a9-4bfd-bb9d-c0a87fb5eef0 admin admin] RBAC: Authorization granted {{(pid=80090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 09:59:49.114765 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:59:49.141518 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-509c4234-96a9-4bfd-bb9d-c0a87fb5eef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '581004a638af4993abf350d76570222b', 'request_id': 'req-509c4234-96a9-4bfd-bb9d-c0a87fb5eef0'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:59:49.148971 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-509c4234-96a9-4bfd-bb9d-c0a87fb5eef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '581004a638af4993abf350d76570222b', 'request_id': 'req-509c4234-96a9-4bfd-bb9d-c0a87fb5eef0'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:59:49.155063 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-509c4234-96a9-4bfd-bb9d-c0a87fb5eef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '581004a638af4993abf350d76570222b', 'request_id': 'req-509c4234-96a9-4bfd-bb9d-c0a87fb5eef0'} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:59:49.165994 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-509c4234-96a9-4bfd-bb9d-c0a87fb5eef0 admin admin] The token cache is being invalidate because project 581004a638af4993abf350d76570222b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 09:59:49.166283 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-509c4234-96a9-4bfd-bb9d-c0a87fb5eef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:59:49.166931 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG keystone.notifications [None req-509c4234-96a9-4bfd-bb9d-c0a87fb5eef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 09:59:49.168491 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: [pid: 80090|app: 0|req: 1468/2918] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 09:59:49 2022] DELETE /identity/v3/projects/581004a638af4993abf350d76570222b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 09:59:58.836144 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:59:59.162973 dv-cinder-797608-21-iscsi devstack@keystone.service[80090]: DEBUG dbcounter [-] [80090] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:03:18.985302 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9cf63-9eea-4b3c-af37-1fd80ba592f1 admin admin] Authenticating user token {{(pid=80091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 10:03:18.987551 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-53d9cf63-9eea-4b3c-af37-1fd80ba592f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 10:03:19.143114 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9cf63-9eea-4b3c-af37-1fd80ba592f1 admin admin] Validating token access rules against request {{(pid=80091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 10:03:19.201351 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093fab4-93c2-4a52-b59e-ac9f6ce845f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746fd8ed517446fe89c53df873abb2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1d802dc0211467fa4e709cd01d411dc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 10:03:19.201995 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093fab4-93c2-4a52-b59e-ac9f6ce845f8 service placement] REQUEST_METHOD: `GET` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 10:03:19.202273 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093fab4-93c2-4a52-b59e-ac9f6ce845f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 10:03:19.202543 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093fab4-93c2-4a52-b59e-ac9f6ce845f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 10:03:19.204328 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.fernet_utils [None req-8093fab4-93c2-4a52-b59e-ac9f6ce845f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 10:03:19.216061 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093fab4-93c2-4a52-b59e-ac9f6ce845f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 10:03:19.217645 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093fab4-93c2-4a52-b59e-ac9f6ce845f8 service placement] RBAC: Authorization granted {{(pid=80091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 10:03:19.227247 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: [pid: 80091|app: 0|req: 1451/2919] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 10:03:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 10:03:29.223079 dv-cinder-797608-21-iscsi devstack@keystone.service[80091]: DEBUG dbcounter [-] [80091] Writing DB stats keystone:SELECT=89 {{(pid=80091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}